Auto~Wave~Machine

A guitar effect pedal that adjusts real-time values based on posture detection, which creates a medium to enhance the dynamic of the music performance.

How algorithms are enhancing the creativity of music？
How to create a more dynamic music performance?

Posture is a important factor of music performance, like the body sways slightly when playing jazz, while we also have the “headbanging” for metal. And these postures are not associated with tones, Auto~Wave~Machine provides a connection between them. Furthermore, this approach create a methodology that allows for the connections between more postures, instruments, and effects.



The first prototype ran the PseNet model in a p5.js sketch, and used p5.serialcontrol to communicate the model with a micro-controller. An additional servo module is attached to a tremolo effect pedal, and the parameters (body angle) will be mapped to the rotation angle of the knobs.

-Prototype 1 / Technical Schematic


To further optimize complex wiring and connections, the second prototype embedded all the parts into one unit by using Raspberry Pi and an effect pedal kit. The model for pose detection upgraded to MoveNet as a newer model Tenserflow has released. The GPIO pins directly control the servo motors to rotate the potentiometers of the pedal.


-Prototype 2 Technical Schematic


I designed a container to frame all the components including Raspberry Pi, servo motors, and the pedal pcb. I used Grasshopper to design the physical interaction interface of the pedal: the ripple shape that interferes with each other corresponds to the position of switches, camera, and knob. A standard 1/4 nut is on the bottom, adaptable to any tripod. This prototype was manufactured from laser-cut acrylic sheets, and 3D printed PLA material.

This version of the prototype also runs into some issues. For example, the 3D printed front side is seperated into two parts because of the limitation of the printer size. For thr circuit part, the electromagnetic interference that occurs when the Raspberry Pi is operating causes a huge noise in the pedal’s analog circuit. It requires further iteration of a shielding structure to avoid this problem.


-Prototype 2 (Front)



-Prototype 2 (Back)



-Prototype 2 (Inner Structures)



-Prototype 2 (CAD Sketch)







>>>Back to Home