|Title||A qualitative assessment of measures for the evaluation of a cover song identification system |
|Publication Type||Conference Paper |
|Year of Publication||2007 |
|Conference Name||International Conference on Music Information Retrieval (ISMIR) |
|Authors||Serrà, J. |
|Conference Location||Viena, Austria |
|Abstract||The evaluation of effectiveness in Information Retrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem bpref and Normalized Lift Curves.
|Published document||files/publications/3f39b7-ISMIR-2007-jserra.pdf |