Impact of agents' errors on performance, reliance and trust in human-agent collaboration

Daronnat, Sylvain and Azzopardi, Leif and Halvey, Martin (2021) Impact of agents' errors on performance, reliance and trust in human-agent collaboration. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64 (1). pp. 405-409. ISSN 1071-1813 (https://doi.org/10.1177/1071181320641091)

[thumbnail of Daronnat-etal-HFESAM-2020-Impact-of-agents-errors-on-performance-reliance-and-trust]
Preview
 Text. Filename: Daronnat_etal_HFESAM_2020_Impact_of_agents_errors_on_performance_reliance_and_trust.pdf
Accepted Author Manuscript
Download (285kB)| Preview

Abstract

Trust in automation is often strongly tied to an agent’s performance. However, our understanding of imperfect agents’ behaviours and its impact on trust is limited. In this paper, we study the relationship between performance, reliance and trust in a set of human-agent collaborative tasks. Participants collaborated with different automated agents that performed similarly but made errors in different ways; namely mistakes (error of prioritization), lapses (error of omission) and slips (lowered accuracy). We conducted a 4x2 within-subjects experiment (n=24) varying the agent behaviours (no error, slips, mistakes and lapses) and task difficulty (easy/hard) during a real-time collaborative game. Our results show that, at the same level of agent performance, agents’ errors are perceived differently and change the way participants interact with agents. For instance, slips and mistakes are more harmful to performance than lapses while slips are more harmful to reliance than mistakes.

ORCID iDs

Daronnat, Sylvain ORCID logoORCID: https://orcid.org/0000-0002-4779-9601, Azzopardi, Leif and Halvey, Martin ORCID logoORCID: https://orcid.org/0000-0001-6387-8679;
CORE (COnnecting REpositories)