Towards an Approach for Analyzing Dynamic Aspects of Bias and Beyond-Accuracy Measures

Abstract

The quality of recommender systems has traditionally only been assessed using accuracy measures. Research has shown that accuracy is only one side of the medallion and that we should also consider quality features that go beyond accuracy. Recently, also fairness-related aspects and bias have increasingly been considered as outcome dimensions in this context. While beyond-accuracy measures including diversity, novelty and serendipity and bias in recommendation have been subject to the research discourse, their interrelation and temporal and group dynamics are clearly under-explored. In this position paper, we propose an approach that groups users based on their behaviors and preferences and that addresses beyond-accuracy needs of those groups while controlling for bias. Further, we consider the analysis of long-term dynamics of different interrelated beyond-accuracy measures and bias as crucial research direction since it helps to advance the field and to address societal issues related to recommender systems and personalization.