| Title | A qualitative assessment of measures for the evaluation of a cover song identification system |
| Publication Type | Conference Paper |
| Year of Publication | 2007 |
| Conference Name | International Conference on Music Information Retrieval (ISMIR) |
| Authors | Serrà, J. |
| Conference Location | Viena, Austria |
| Abstract | The evaluation of effectiveness in Information Retrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem bpref and Normalized Lift Curves.
|
| Full Document | files/publications/3f39b7-ISMIR-2007-jserra.pdf |
