A qualitative assessment of measures for the evaluation of a cover song identification system

TitleA qualitative assessment of measures for the evaluation of a cover song identification system
Publication TypeConference Paper
Year of Publication2007
Conference NameInternational Conference on Music Information Retrieval (ISMIR)
AuthorsSerrà, J.
Pagination319-322
Conference LocationViena, Austria
AbstractThe evaluation of effectiveness in Information Retrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem bpref and Normalized Lift Curves.
preprint/postprint documentfiles/publications/3f39b7-ISMIR-2007-jserra.pdf
intranet