Note:
This bibliographic page is archived and will no longer be updated.
For an up-to-date list of publications from the Music Technology Group see the
Publications list
.
A New Approach to Evaluating Novel Recommendations
| Title | A New Approach to Evaluating Novel Recommendations |
| Publication Type | Conference Paper |
| Year of Publication | 2008 |
| Conference Name | 2008 ACM Conference on Recommender Systems |
| Authors | Celma, Ò. , & Herrera P. |
| Conference Start Date | 23/10/2008 |
| Conference Location | Lausanne, Switzerland |
| Abstract |
This paper presents two methods, named Item– and User– centric, to evaluate the quality of novel recommendations. The former method focuses on analyzing the item–based recommendation network. The aim is to detect whether the network topology has any pathology that hinders novel recommendations. The latter, user–centric evaluation, aims at measuring users’ perceived quality of novel recommendations. The results of the experiments, done in the music recommendation context, show that last.fm social recommender, based on collaborative filtering, is prone to popularity bias. This has direct consequences on the topology of the item–based recommendation network. Pure audio content–based methods (CB) are not affected by popularity. However, a user–centric experiment done with 288 subjects shows that even though a social–based approach recommends less novel items than our CB, users’ perceived quality is better than those recommended by a pure CB method. |
