Practitioners Versus Users: A Value-Sensitive Evaluation of Current Industrial Recommender System Design

• Published in: Proceedings of the ACM on human-computer interaction 2022-11, Vol.6 (CSCW2), p.1-32, Article 533
• Main Authors: Chen, Zhilong, Piao, Jinghua, Lan, Xiaochong, Cao, Hancheng, Gao, Chen, Lu, Zhicong, Li, Yong
• Format: Article
• Language: English
• Subjects: Collaborative and social computing; Empirical studies in collaborative and social computing; Empirical studies in HCI; Human computer interaction (HCI); Human-centered computing
• ISSN: 2573-0142; 2573-0142
• DOI: 10.1145/3555646

Recommender systems are playing an increasingly important role in alleviating information overload and supporting users' various needs, e.g., consumption, socialization, and entertainment. However, limited research focuses on how values should be extensively considered in industrial deployments of recommender systems, the ignorance of which can be problematic. To fill this gap, in this paper, we adopt Value Sensitive Design to comprehensively explore how practitioners and users recognize different values of current industrial recommender systems. Based on conceptual and empirical investigations, we focus on five values: recommendation quality, privacy, transparency, fairness, and trustworthiness. We further conduct in-depth qualitative interviews with 20 users and 10 practitioners to delve into their opinions about these values. Our results reveal the existence and sources of tensions between practitioners and users in terms of value interpretation, evaluation, and practice, which provide novel implications for designing more human-centric and value-sensitive recommender systems.