Skip to the content
2 layers99.9 × 85.1 mmMidi controller pcb, the printed circuit board in 3D

Robots in Musical Improvisation: Learning Algorithms Respecting Motion Constraints

Size
99.9 × 85.1 mm
Copper layers
2
Thickness
1.6 mm
Parts
30
Nets
33
Pads
114
Tracks, vias
142, 5
Pours
2
Routed
Yes
KiCad
KiCad 5 (file 20171130)
Created
26 Jun 2018
Updated
1 Jul 2020

Overview

Midi controller pcb is an open-source printed circuit board by Roboy, from the Roboy/tss18-robotsinmusicalimprovisation repository on GitHub, published under the BSD-3-Clause licence. It is a 2-layer board of 99.9 × 85.1 mm with 30 parts on 33 nets, routed with 142 tracks and 5 vias.

Its parts include 9 resistors, 7 capacitors, 5 switches, 2 diodes and 1 IC. It belongs with the audio and music and robots and motor control boards of this library.

README

README.md

Robots in Musical Improvisation

Robots in Musical Improvisation: Learning Algorithms Respecting Motion Constrains

Master's Thesis in Robotics, Cognition, Intelligence - Technical University of Munich (TUM)

Abstract

Humanoid robots have been exposed to increasingly challenging tasks since they steadily grow in resemblance to humans particularly in their skill to intelligently and socially interact with their environment. Recent developments in machine learning and control of musculoskeletal systems allow humanoid robots to perform creative tasks, e.g., drawing or playing instruments. For humans, it takes years of practice to develop creative skills in arts or music. Musical improvisation, the act of creating a spontaneous response to a currently presented musical sequence, demands high proficiency in an instrument. How would a humanoid robot learn to elaborately improvise on an instrument?

This work proposes an end-to-end framework for robotic improvisation with focus on machine learning algorithms in interaction with the control of a musculoskeletal robot. In spite of sophisticated sampling methods, variational autoencoders were chosen to be the basis for musical improvisation. A new framework that eases the control of musculoskeletal robots was applied to play musical sequences on the marimba.

System Design

System Design

The systems input sequence is played with W-101 MIDI controller or any MIDI keyboard. The sequence is then parsed to matrix M which serves as the input to the encoder of the variational autoencoder (VAE). Next it can either be

  1. reconstructed (Path 1) --> No changes in latent space
  2. modified (Path 2) --> Latent space modifier GUI
  3. processed by an LSTM network --> LSTM

Irrespective of the path, z gets decoded by the VAE decoder. After that, the new sequence can be smoothed by a Note smoother and then sent to the robot or to a software synthesizer.

Examples on YouTube

Software synthesis

Variational Autoencoder with Latent space modifier (GUI) - "Generate Mode"

Variational Autoencoder with Latent space modifier (GUI) - "Interact Mode"

Variational Autoencoder with Latent space modifier (GUI) - "Endless Mode"

Human robot interaction

Variational Autoencoder (GUI) with Roboy robot - "Interact Mode"

Variational Autoencoder (GUI) with Roboy robot - "Endless Mode"

Simulation

To setup simulation please visit Roboy Control

Pretrained models

Get pretrained models following this link and move the "pretrained_models" folder to /path/to/tss18-robotsinmusicalimprovisation/utils

Installation

Prerequisites

  1. Create virtual environment one above the root folder of this project and activate it:
bash
virtualenv ../.rimi -p python3 --no-site-packages
source ../.rimi/bin/activate
  1. Set PYTHONPATH to the root directory of this project or add to ~/.bashrc
bash
export PYTHONPATH=$PYTHONPATH:/path/to/dir
  1. OPTIONAL (for Ubuntu): You will need these for python-rtmidi:
bash
sudo apt-get install libasound-dev
sudo apt-get install libjack-dev
  1. Pip install all packages
bash
pip3 install -r requirements.txt
  1. Install PyTorch

If you are working on Ubuntu with CUDA 9.0, try:

bash
pip3 install torch torchvision

For other systems or CUDA versions, please visit https://pytorch.org/

VAEsemane for Raspberry Pi

I added a clean repository containing the VAE with an updated GUI (to fit smaller screen sizes like 720x480, e.g. Raspberry Pi touchscreens), please follow this link to the repository.

Parts

30
QtyValueFootprintReferences
7100NCapacitor_SMD:C_0402_1005MetricC1, C2, C3, C4, C5, C6, C7
410kResistor_SMD:R_0402_1005MetricR4, R5, R6, R7
3100Resistor_SMD:R_0402_1005MetricR1, R2, R3
310kPotentiometer_THT:Potentiometer_Alps_RK09L_Single_VerticalRV1, RV5, RV6
310kPotentiometer_THT:Potentiometer_Bourns_PTA6043_Single_SlideRV2, RV3, RV4
21kResistor_SMD:R_0402_1005MetricR8, R9
2LEDLED_THT:LED_D1.8mm_W3.3mm_H2.4mmD1, D2
127722772:2772IC1
1SW_Push1Connector_PinHeader_2.54mm:PinHeader_1x02_P2.54mm_VerticalSW2
1SW_Push2Connector_PinHeader_2.54mm:PinHeader_1x02_P2.54mm_VerticalSW3
1SW_Push3Connector_PinHeader_2.54mm:PinHeader_1x02_P2.54mm_VerticalSW4
1SW_Push4Connector_PinHeader_2.54mm:PinHeader_1x02_P2.54mm_VerticalSW5
1SW_SPSTConnector_PinHeader_2.54mm:PinHeader_1x02_P2.54mm_VerticalSW1

Similar boards

  • 2 layers52.2 × 52.2 mmBase promicro, the printed circuit board in 3D

    Base promicro

    google/mozc-devices

    Circuit diagrams and firmware source code for Gboard DIY keyboards

    30 parts3kApache-2.0
  • 2 layers40.6 × 15.2 mmVr mmm, the printed circuit board in 3D

    Vr mmm

    rusefi/rusefi

    rusefi - GPL internal combustion engine control unit

    30 parts1.2k
  • 2 layers270 × 11 mmDaylight, the printed circuit board in 3D

    Daylight

    VoronDesign/Voron-Hardware

    Cool Hardware designed by the Voron Design group

    30 parts1.1kGPL-3.0
  • 2 layers65 × 30 mmRgb to hdmi, the printed circuit board in 3D

    Rgb to hdmi

    hoglet67/RGBtoHDMI

    Bare-metal Raspberry Pi project that provides pixel-perfect sampling of Retro Computer RGB/YUV video and conversion to HDMI

    30 parts1kGPL-3.0
  • 2 layers40.5 × 58 mmInitial v, the printed circuit board in 3D

    Initial v

    tenderlove/initial-v

    It's a BMW shifter converted to a Bluetooth Keyboard that you use with Vim

    30 parts1kApache-2.0
  • 2 layers34.3 × 41.8 mmMotionCubeViewAllForces, the printed circuit board in 3D

    MotionCubeViewAllForces

    hackclub/OnBoard

    💡 Join 1,000 teenagers and make your first PCB with a $100 grant!

    30 parts915
  • 2 layers57.4 × 62 mmPicoWS2812, the printed circuit board in 3D

    PicoWS2812

    ErichStyger/mcuoneclipse

    McuOnEclipse projects and examples

    30 parts765
  • 2 layers52.1 × 46.8 mmFIRE TEST PANEL, the printed circuit board in 3D

    FIRE TEST PANEL

    jrsteensen/OpenHornet

    OpenHornet 1:1 F/A-18C Simulator Repository

    30 parts431

Questions

How big is the Midi controller pcb PCB?

It measures 99.9 × 85.1 mm and has 2 copper layers, 1.6 mm thick.

What parts does the Midi controller pcb use?

30 parts. The full list of its parts is on this page, with links to each part's symbol and footprint where PCBKit's library has them.

Where can I download the Midi controller pcb KiCad files?

From the Roboy/tss18-robotsinmusicalimprovisation repository on GitHub, at the commit this page was made from: the board is midi_controller/pcb/midi_controller_pcb.kicad_pcb. PCBKit opens the board in the browser, with nothing to install.

Can I use the Midi controller pcb design in my own project?

Its repository publishes it under the BSD-3-Clause licence: you may reuse it on that licence's terms (keep the author's notice, and for a copyleft licence share your changes alike).