Multimodal Interfaces I ws2011-12
Download as PPTX, PDF0 likes159 views
A wearable gestural controller allows a singer to manipulate their live vocal performance in real time. The controller uses flex sensors on the arm and a pressure sensor on the finger to detect conducting-like gestures that let the performer capture and hold notes, increase volume with arm stretches, and other effects. The system provides an intuitive way for singers to augment their voice during performances that is clear for audiences to understand.
1 of 4
Download to read offline
Multimodal Interfaces I ws2011-12
- 1. Vocal augmentation and Manipulation prosthesis Gesture-based wearable controller for livetime vocal performance ELENA JESSOP MIT MEDIA LAB
- 2. real time audio manipulation Allows a singer to capture and manipulate single notes that he or she sings, using a gestural vocabulary developed from choral conducting
- 3. gestures Clear for the audience Intuitive for the performer • Pinch = hold a note • Stretch the arm = crescendo • ...
- 4. how? Sensors • Two 4.5" flex sensors (one over the elbow joint and one over the wrist joint) • accelerometer attached to the top of the forearm. • pressure sensor attached to the index finger