Full Program »
Gesture-based Collaborative Virtual Reality Performance in CarillonWithin immersive computer-based rendered environments, the control of virtual musical instruments and sound-making entities demands new compositional frameworks, interaction models and mapping schemata for composer and per- former alike. One set of strategies focuses compositional attention on crossmodal and multimodal interaction schema, coupling physical real-world gesture to the action and motion of virtual entities, themselves driving the creation and control of procedurally-generated musical sound. This paper explores the interaction design and compositional processes engaged in the creation of Carillon, a musical composition and interactive performance environment focused around a multiplayer collaboratively-controlled virtual instrument and presented using head-mounted displays (HMD) and gesture-based hand tracking.
California College of the Arts