Sonification of Brain and Body Signals in Collaborative Tasks Using a Tabletop Musical Interface

TitleSonification of Brain and Body Signals in Collaborative Tasks Using a Tabletop Musical Interface
Publication TypeConference Paper
Year of Publication2011
Conference Name International Conference on Auditory Display (ICAD)
AuthorsMealla, S., Väljamäe A., Bosi M., & Jordà S.
Conference Start Date20/06/2011
Conference LocationBudapest, Hungary
AbstractPhysiological Computing has been applied in different disciplines, and is becoming popular and widespread in Human-Computer Interaction, due to device miniaturization and improvements in real- time processing. However, most of the studies on physiology- based interfaces focus on single-user systems, while their use in Computer-Supported Collaborative Work (CSCW) is still emerging. The present work explores how sonification of human brain and body signals can enhance user experience in collaborative mu- sic composition. For this task, a novel multimodal interactive sys- tem is built using a musical tabletop interface (Reactable) and a hybrid Brain-Computer Interface (BCI). The described system al- lows performers to generate and control sounds using their own or their fellow team member’s physiology. Recently, we assessed this physiology-based collaboration system in a pilot experiment. Discussion on the results and future work on new sonifications will be accompanied by practical demonstration during the conference.
intranet