Gesture-controlled sound

Hand synth

Pinch your right thumb and index finger for loudness; move your hands apart for pitch.

Use headphones and start at a low listening level.

The camera image is analysed in your browser and never leaves it.

Allow camera access to begin.

Hand tracking

Camera off
Ready when you are
Place both hands in view, palms facing the camera.
Right hand: waiting · Left hand: waitingKeep both hands in frame

Right-hand pinch

—

Thumb tip ↔ index tip sets loudness

Index-knuckle span

—

Left index knuckle ↔ right index knuckle sets pitch

1Open the right-hand pinch for a louder sound; close it for silence.
2Move your hands apart for a higher pitch and together for a lower pitch.

The synth is a soft sine tone. Both hands must be visible to play.

More about this app

How it works

A webcam and MediaPipe track both hands. The distance between the right thumb tip and index tip sets the loudness of a continuous sine tone, and the distance between the two index knuckles sets its pitch. On first use, the MediaPipe code, WebAssembly files, and hand model are downloaded from jsDelivr and Google to your device.

Artists to explore

@neles0n · @wxll.hx

Hand landmarks are detected with MediaPipe Hand Landmarker.