Impact of agent reliability and predictability on trust in real time human-agent collaboration

Daronnat, Sylvain and Azzopardi, Leif and Halvey, Martin and Dubiel, Mateusz; (2020) Impact of agent reliability and predictability on trust in real time human-agent collaboration. In: HAI '20: Proceedings of the 8th International Conference on Human-Agent Interaction. ACM, AUS, pp. 131-139. ISBN 978-1-4503-8054-6 (https://doi.org/10.1145/3406499.3415063)

[thumbnail of Daronnat-etal-HAI-2020-Impact-of-agent-reliabiilty-and-predictability-on-trust]
Preview
 Text. Filename: Daronnat_etal_HAI_2020_Impact_of_agent_reliabiilty_and_predictability_on_trust.pdf
Accepted Author Manuscript
License: All rights reserved
Download (988kB)| Preview

Abstract

Trust is a prerequisite for effective human-agent collaboration. While past work has studied how trust relates to an agent's reliability, it has been mainly carried out in turn based scenarios, rather than during real-time ones. Previous research identified the performance of an agent as a key factor influencing trust. In this work, we posit that an agent's predictability also plays an important role in the trust relationship, which may be observed based on users' interactions. We designed a 2x2 within-groups experiment with two baseline conditions: (1) no agent (users' individual performance), and (2) near-flawless agent (upper bound). Participants took part in an interactive aiming task where they had to collaborate with different agents that varied in terms of their predictability, and were controlled in terms of their performance. Our results show that agents whose behaviours are easier to predict have a more positive impact on task performance, reliance and trust while reducing cognitive workload. In addition, we modelled the human-agent trust relationship and demonstrated that it is possible to reliably predict users' trust ratings using real-time interaction data. This work seeks to pave the way for the development of trust-aware agents capable of adapting and responding more appropriately to users.

ORCID iDs

Daronnat, Sylvain ORCID logoORCID: https://orcid.org/0000-0002-4779-9601, Azzopardi, Leif, Halvey, Martin ORCID logoORCID: https://orcid.org/0000-0001-6387-8679 and Dubiel, Mateusz ORCID logoORCID: https://orcid.org/0000-0001-8250-3370;
CORE (COnnecting REpositories)