HandSymphony
Conduct a soundscape with your hands. Sway to swell the music, wave to add vibrato, tap to play notes, and raise your hand to brighten the sound.
New here? Start in 30 seconds
You don’t need to know any music. A conductor leads an orchestra with hand movements: bigger motions mean louder music, and faster motions mean a quicker pace. This app borrows that idea. Your hand movements shape music that the app plays for you, and every note is chosen to sound good together, so you can’t play a wrong one.
- Set up. Sit or stand about an arm’s length from the camera in a well-lit room, with your hand fully in view. No camera? Choose pointer mode and move your mouse or finger on the stage. Headphones make the effects easier to hear.
- Press Start, then slowly move your hand up and down. Low sounds mellow and dark, high sounds bright and light.
- Sway your hand slowly left and right, like rocking a boat. The music swells, and the sound drifts left and right with your hand.
- Tap the air with one fingertip, like pressing a button. Each tap plays a note.
- Close your hand into a fist for a calm, sparse sound. Open it wide for a fuller, busier one.
- Use both hands (camera mode). Raise your left hand to make the harmony more tense and dramatic, and lower it to settle back to calm.
Pick an input. Camera mode tracks your hands on this device only, and no video leaves it. Pointer mode lets you play with a mouse or finger.
What the labels on the stage mean
- Gesture
- The movement the app thinks you are making: Sway, Wave, Tap or Hold (hand still). “No hand” means it can’t see you.
- Chord
- The group of notes playing underneath, named by its root note, for example Dm7. You don’t need to read it. It changes every few seconds.
- Tempo
- The speed of the music in beats per minute (bpm). A slow, steady sway usually keeps it relaxed.
- Energy
- How big and lively your movement is. More energy means louder music, a brighter sound, and drums in some genres.
Music words in plain language
- Tempo
- How fast the music moves, like a walking pace versus a run.
- Dynamics
- How loud or soft the music is. Conductors shape this with the size of their movements.
- Pitch
- How high or low a note sounds.
- Chord
- Several notes played together. Chords give music its mood, for example happy, sad or tense.
- Key and scale
- The set of notes that sound right together. The Key menu picks the home note. The app only plays notes from the chosen set, which is why nothing sounds off.
- Arpeggio
- The notes of a chord played one after another instead of all at once. The app does this automatically, more when your hand is open and moving.
- Vibrato
- A gentle wobble in the pitch that makes a note feel alive. Waving your hand creates it.
- Reverb
- The echo of a large hall. More reverb sounds more spacious and dreamy.
- Timbre
- The character of a sound, such as bright, dark, soft or sharp. Raising your hand opens up the brightness.
- Genre
- The musical style. Each genre picks its own notes, chord pattern, speed range and drums.
How real conductors signal, and how this app differs
In an orchestra, the conductor’s right hand traditionally keeps time by tracing a pattern in the air, with a downward motion for the first beat and different shapes for two, three or four beats per bar. The left hand shapes the feeling: louder or softer, entrances, and expression. HandSymphony borrows the two-hand idea, with the right hand playing and the left hand steering the harmony. It doesn’t read formal beat patterns yet. Instead, you lead by feel: bigger and faster movements raise the energy, and slow, smooth ones calm the music.
If something isn’t working
- No sound
- Check your volume and the Pause sound button. Browsers only allow sound after you press a Start button.
- Hand not detected
- Add light in front of you, keep your whole hand in the frame, and try a plain background.
- Notes trigger too easily or not enough
- Tap with a quicker, sharper fingertip flick, and keep the rest of your hand steady.
- Camera blocked
- Allow camera access when your browser asks, or use pointer mode.
How gestures become music
| Gesture | Camera | Pointer | Musical result |
|---|---|---|---|
| Sway | Swing your hand side to side, slowly | Drag left and right slowly | Louder and more intense; sway speed nudges the tempo; sound pans with your hand |
| Wave | Quick, small side-to-side motion | Wiggle quickly | Vibrato and extra reverb |
| Tap | Flick a fingertip downward | Click or tap | Plays a note, snapped to the current chord and scale |
| Height | Raise or lower your hand | Move up or down | Higher register and a brighter timbre |
| Openness | Open palm versus fist | Openness slider | Sparse to dense arpeggios |
| Second hand | Raise your left hand higher for a more tense chord | Not available | Picks the chord from the progression |