Note: This bibliographic page is archived and will no longer be updated. For an up-to-date list of publications from the Music Technology Group see the Publications list .

A qualitative assessment of measures for the evaluation of a cover song identification system

Title A qualitative assessment of measures for the evaluation of a cover song identification system
Publication Type Conference Paper
Year of Publication 2007
Conference Name International Conference on Music Information Retrieval (ISMIR)
Authors Serrà, J.
Pagination 319-322
Conference Location Viena, Austria
Abstract The evaluation of effectiveness in Information Retrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem bpref and Normalized Lift Curves.
preprint/postprint document files/publications/3f39b7-ISMIR-2007-jserra.pdf