International Computer Music Conference 2016 Papers Track

Full Program »

Extending the piano through spatial transformation of motion capture data

This paper explores the use of motion capture data to provide intuitive input to a spatialization system that ex-tends the resonating capabilities of the piano. A camera is placed inside of an amplified piano, which tracks the motion of internal mechanisms such as hammer move-ment. This data is processed so that singular pitches, chords, and other motions inside the piano can produce meaningful sonic results. The data is subsequently sent to an ambisonics software module, which spatializes the piano sounds in an effort to provide a meaningful con-nection between the sound location and the perceived “vertical” frequency space produced when creating sound on the piano. This provides an audible link be-tween the pitches performed and their location, and an effective option for integrating spatialization of the piano during performance.


Martin Ritter     web site
Computational Media Design
University of Calgary

Alyssa Aska     web site
University of Calgary


Powered by OpenConf®
Copyright©2002-2015 Zakon Group LLC