Gesture Synth is an interactive musical instrument created by Eric Wei. This page is a faithful replica of the original, built with MediaPipe + Web Audio. Use your hands to create chords, melodies, and sounds in real-time!
Tilt
Inward → Major
Outward → Minor
Fingers (Scale Degree)
1 → I
2 → II
3 → III
4 → IV
5 → V
Index + Pinky → VI
Index + Pinky + Thumb → VII
Fingers (Chord Quality)
1 → Root Position
2 → 1st Inversion
3 → Major/Minor 7th
4 → Dominant/Diminished 7th
Octave
Thumb In → higher octave
Thumb Out → lower octave
Tilt
Inward → More Filter
Outward → Less Filter
Height
Higher → Louder
Lower → Softer