Full Program »
Extending the piano through spatial transformation of motion capture dataThis paper explores the use of motion capture data to provide intuitive input to a spatialization system that ex-tends the resonating capabilities of the piano. A camera is placed inside of an amplified piano, which tracks the motion of internal mechanisms such as hammer move-ment. This data is processed so that singular pitches, chords, and other motions inside the piano can produce meaningful sonic results. The data is subsequently sent to an ambisonics software module, which spatializes the piano sounds in an effort to provide a meaningful con-nection between the sound location and the perceived “vertical” frequency space produced when creating sound on the piano. This provides an audible link be-tween the pitches performed and their location, and an effective option for integrating spatialization of the piano during performance.