Evaluating synthetic speech workload with oculo-motor indices : preliminary observations for Japanese speech
Dubiel, Mateusz and Nakayama, Minoru and Wang, Xin (2021) Evaluating synthetic speech workload with oculo-motor indices : preliminary observations for Japanese speech. In: BIOSIGNALS 2021, 2021-02-11 - 2021-02-13, Online Event. (https://doi.org/10.5220/0010341303350342)
Preview |
Text.
Filename: Dubiel_etal_Biosignal_2021_Evaluating_synthetic_speech_workload_with_oculo_motor_indices.pdf
Accepted Author Manuscript Download (539kB)| Preview |
Abstract
Pupillometry has recently been introduced as a method to evaluate cognitive workload of synthetic speech. Prior research conducted on English speech indicates that in noisy listening conditions, pupil dilation is significantly higher for synthetic speech as compared to natural speech. In a lab-based listening experiment, we evaluated participants' (n=16) pupil responses to Japanese speech (natural vs. synthetic) at three different signal-to-noise levels (-1dB, -3dB and -5dB). Our research expands on previous work by evaluating pupillary responses both in terms of temporal changes in pupil size and degree of pupil oscillations. We observe statistically significant differences in pupil sizes at the recall stage between each type of speech. For pupil oscillations, we register statistically significant differences in frequency power spectrum densities (PSDs). Our investigation proposes an expansion of the current synthetic speech evaluation methods that are based on pupillary responses and outlines possible avenues for future research that arise from the findings of this work.
ORCID iDs
Dubiel, Mateusz ORCID: https://orcid.org/0000-0001-8250-3370, Nakayama, Minoru and Wang, Xin;-
-
Item type: Conference or Workshop Item(Paper) ID code: 75113 Dates: DateEvent11 February 2021Published4 December 2020AcceptedSubjects: Science > Mathematics > Computer software Department: Faculty of Science > Computer and Information Sciences Depositing user: Pure Administrator Date deposited: 21 Jan 2021 13:07 Last modified: 12 Dec 2024 16:35 Related URLs: URI: https://strathprints.strath.ac.uk/id/eprint/75113