Note:
This bibliographic page is archived and will no longer be updated.
For an up-to-date list of publications from the Music Technology Group see the
Publications list
.
Listening to Your Brain: Implicit Interaction in Collaborative Music Performances
| Title | Listening to Your Brain: Implicit Interaction in Collaborative Music Performances |
| Publication Type | Conference Paper |
| Year of Publication | 2011 |
| Conference Name | The International Conference on New Interfaces for Musical Expression (NIME) |
| Authors | Mealla, S. , Väljamäe A. , Bosi M. , & Jordà S. |
| Conference Start Date | 30/05/2011 |
| Publisher | NIME |
| Conference Location | Oslo, Norway |
| Abstract | The use of physiological signals in Human Computer Interaction (HCI) is becoming popular and widespread, mostly due to sensors miniaturization and advances in real-time processing. However, most of the studies that use physiology-based interaction focus on single-user paradigms, and its usage in collaborative scenarios is still in its beginnings. In this paper we explore how interactive sonification of brain and heart signals, and its representation through physical objects (physiopucks) in a tabletop interface may enhance motivational and controlling aspects of music collaboration. A multimodal system is presented, based on a Hybrid Brain-Computer Interface (BCI) and the Reactable, a musical tabletop interface. Performance and motivation variables were assessed in an experiment involving a test“Physio” group (N=22) and a control “Placebo” group (N=10). Pairs of participants used two methods for sound creation: implicit interaction through physiological signals, and explicit interaction by means of gestural manipulation. The results showed that pairs in the Physio Group declared less difficulty, higher confidence and more symmetric control than the Placebo Group, where no real-time sonification was provided as subjects were using pre-recorded physiological signal being unaware of it. These results support the feasibility of introducing physiology-based interaction in multimodal interfaces for collaborative music generation. |
| preprint/postprint document | files/publications/listening_to_your_brain_camera_ready.pdf |
