Note: This bibliographic page is archived and will no longer be updated. For an up-to-date list of publications from the Music Technology Group see the Publications list .

Enriched Multimodal Representations of Music Performances: Online Access and Visualization

Title Enriched Multimodal Representations of Music Performances: Online Access and Visualization
Publication Type Journal Article
Year of Publication 2017
Authors Maestre, E. , Papiotis P. , Marchini M. , Llimona Q. , Mayor O. , Pérez A. , & Wanderley M. M.
Journal Title IEEE MultiMedia
Volume 24
Issue 1
Pages 24-34
Journal Date Jan
Start Page 24
ISSN 1070-986X
Abstract In this paper, we provide a first-person outlook on the technical challenges and developments involved in the recording, analysis, archiving, and cloud-based interchange of multimodal string quartet performance data as part of a collaborative research project on ensemble music making. In order to facilitate the sharing of our own collection of multimodal recordings and extracted descriptors and annotations, we developed a hosting platform and data archival protocol through which multimodal data (audio, video, motion capture, descriptor signals) can be stored, visualized, annotated, and selectively retrieved via a web interface and a dedicated API. By way of this paper we make a twofold contribution: (a) we open our collection of enriched multimodal datasets to the community, the Quartet Dataset; and (b) we introduce and enable access to our multimodal data exchange platform, the Repovizz system, through which users can upload recorded data, and navigate, playback, or edit existing datasets via a standard Internet browser.
preprint/postprint document http://hdl.handle.net/10230/37218
Final publication 10.1109/MMUL.2017.3