The role of valence, dominance, and pitch in social perceptions of artificial intelligence (AI) conversational agents' voices

M. Shiramizu, Victor Kenji and Lee, Anthony J and Altenburg, Daria and Feinberg, David R. and Jones, Benedict C. (2022) The role of valence, dominance, and pitch in social perceptions of artificial intelligence (AI) conversational agents' voices. Scientific Reports, 12. 22479. ISSN 2045-2322 (https://doi.org/10.1038/s41598-022-27124-8)

[thumbnail of Shiramizu-etal-SR-2022-The-role-of-valence-dominance-and-pitch-in-social-perceptions-of-artificial-intelligence]
Preview
 Text. Filename: Shiramizu_etal_SR_2022_The_role_of_valence_dominance_and_pitch_in_social_perceptions_of_artificial_intelligence.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

There is growing concern that artificial intelligence (AI) conversational agents (e.g., Siri, Alexa) reinforce voice-based social stereotypes. Because little is known about social perceptions of conversational agents’ voices, we investigated the perceptual dimensions that underpin social perceptions of these synthetic voices and the role that acoustic parameters play in these perceptions. In Study 1 (N = 504), Principal Component Analysis of ratings of synthetic voices on a range of traits (trustworthiness, emotional stability, responsibility, sociability, caringness, attractiveness, intelligence, confidence, weirdness, unhappiness, meanness, aggressiveness, dominance, competence, age, masculinity, femininity) suggested that social perceptions of synthetic voices are underpinned by Valence and Dominance components that are highly similar to those previously reported for natural human stimuli. Study 1 also found that scores on the Dominance component were strongly and negatively related to voice pitch. Study 2 (N = 160) found that experimentally manipulating pitch in synthetic voices directly influenced perceptions of their dominance and aggressiveness, but not their competence or trustworthiness. Collectively, these results suggest that greater consideration of the role that voice pitch plays in dominance-related social perceptions when designing conversational agents will be effective in controlling stereotypic perceptions of their voices and the downstream consequences of those perceptions.

ORCID iDs

M. Shiramizu, Victor Kenji, Lee, Anthony J, Altenburg, Daria, Feinberg, David R. and Jones, Benedict C. ORCID logoORCID: https://orcid.org/0000-0001-7777-0220;
CORE (COnnecting REpositories)