WeBuildAI: Participatory Framework for Algorithmic Governance

• Published in: Proceedings of the ACM on human-computer interaction 2019-11, Vol.3 (CSCW), p.1-35
• Main Authors: Lee, Min Kyung, Kusbit, Daniel, Kahng, Anson, Kim, Ji Tae, Yuan, Xinran, Chan, Allissa, See, Daniel, Noothigattu, Ritesh, Lee, Siheon, Psomas, Alexandros, Procaccia, Ariel D.
• Format: Article
• Language: English
• ISSN: 2573-0142; 2573-0142
• DOI: 10.1145/3359283

Algorithms increasingly govern societal functions, impacting multiple stakeholders and social groups. How can we design these algorithms to balance varying interests in a moral, legitimate way? As one answer to this question, we present WeBuildAI, a collective participatory framework that enables people to build algorithmic policy for their communities. The key idea of the framework is to enable stakeholders to construct a computational model that represents their views and to have those models vote on their behalf to create algorithmic policy. As a case study, we applied this framework to a matching algorithm that operates an on-demand food donation transportation service in order to adjudicate equity and efficiency trade-offs. The service's stakeholders--donors, volunteers, recipient organizations, and nonprofit employees--used the framework to design the algorithm through a series of studies in which we researched their experiences. Our findings suggest that the framework successfully enabled participants to build models that they felt confident represented their own beliefs. Participatory algorithm design also improved both procedural fairness and the distributive outcomes of the algorithm, raised participants' algorithmic awareness, and helped identify inconsistencies in human decision-making in the governing organization. Our work demonstrates the feasibility, potential and challenges of community involvement in algorithm design.