Empowering stakeholders with participatory auditing of predictive AI : perspectives from end-users and decision subjects without AI expertise

Tools

Di Campli San Vito, Patrizia and Fringi, Eva and Johnston, Penny and Bezerra, Leonardo C.T. and Aristodemou, Marios and Shahandashti, Siamak F. and O'Hara, Emily and Whyte, Laura Fiona and Luo, Lin and Wong, Mark and Soufan, Ayah and Moshfeghi, Yashar and Stumpf, Simone; (2026) Empowering stakeholders with participatory auditing of predictive AI : perspectives from end-users and decision subjects without AI expertise. In: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM), ESP. (In Press)

[thumbnail of Di-Campli-San-Vito-etal-ACM-CHI-2026-Empowering-stakeholders-with-participatory-auditing-of-predictive-AI] Text. Filename: Di-Campli-San-Vito-etal-ACM-CHI-2026-Empowering-stakeholders-with-participatory-auditing-of-predictive-AI.pdf
Accepted Author Manuscript
Restricted to Repository staff only until 1 January 2099.
Download (35MB) | Request a copy

Abstract

Artificial intelligence (AI) applications have become ubiquitous in their impact on individuals and society, highlighting a crucial need for their responsible development. Recent research has called for participatory AI auditing, empowering individuals without AI expertise to audit AI applications throughout the entire AI development pipeline. Our work focuses on investigating how to support these kinds of auditors through participatory AI auditing tools and processes. We conducted a series of co-design workshops, using two health-related predictive AI applications as examples. Our results show that participants wanted to be part of AI audits, and were insightful in identifying the potential impacts of applications, but needed to be assisted in conducting audits, especially how to measure impacts. Importantly, participants provided examples of impacts not considered in current risk/harm taxonomies. Our findings provide implications for the design of tools and processes to empower everyone to contribute to responsible AI development in the future.

ORCID iDs

Di Campli San Vito, Patrizia, Fringi, Eva, Johnston, Penny, Bezerra, Leonardo C.T., Aristodemou, Marios, Shahandashti, Siamak F., O'Hara, Emily, Whyte, Laura Fiona, Luo, Lin, Wong, Mark, Soufan, Ayah ORCID logoORCID: https://orcid.org/0000-0002-1689-5633, Moshfeghi, Yashar ORCID logoORCID: https://orcid.org/0000-0003-4186-1088 and Stumpf, Simone;
CORE (COnnecting REpositories)