Paradoxical Tensions Related to AI-Powered Evaluation Systems in Competitive Sports

• Published in: Information systems frontiers 2022-06, Vol.24 (3), p.897-922
• Main Authors: Mazurova, Elena, Standaert, Willem, Penttinen, Esko, Tan, Felix Ter Chian
• Format: Article
• Language: English
• Subjects: Accuracy; Artificial intelligence; Bias; Business & economic sciences; Business and Management; Case studies; Control; Federations; Gestion des systèmes d’information; Gymnastics; Information systems; IT in Business; Literature reviews; Management information systems; Management of Computing and Information Systems; Operations Research/Decision Theory; Sciences économiques & de gestion; Sports; Stakeholders; Systems Theory
• ISSN: 1387-3326; 1572-9419; 1572-9419
• DOI: 10.1007/s10796-021-10215-8

Judging in competitive sports is prone to errors arising from the inherent limitations to humans’ cognitive and sensorial capabilities and from various potential sources of bias that influence judges. Artistic gymnastics offers a case in point: given the complexity of scoring and the ever-increasing speed of athletes’ performance, systems powered by artificial intelligence (AI) seem to promise benefits for the judging process and its outcomes. To characterize today’s human judging process for artistic gymnastics and examine contrasts against an AI-powered system currently being introduced in this context, an in-depth case study analyzed interview data from various stakeholder groups (judges, gymnasts, coaches, federations, technology providers, and fans). This exploratory study unearthed several paradoxical tensions accompanying AI-based evaluations in this setting. The paper identifies and illustrates tensions of this nature related to AI-powered systems’ accuracy, objectivity, explainability, relationship with artistry, interaction with humans, and consistency.