Combining oculo-motor indices to measure cognitive load of synthetic speech in noisy listening conditions

Dubiel, Mateusz and Nakayama, Minoru and Wang, Xin (2021) Combining oculo-motor indices to measure cognitive load of synthetic speech in noisy listening conditions. In: 2021 ACM Symposium on Eye Tracking Research and Applications, 2021-04-24 - 2021-04-27, Virtual. (In Press)

[thumbnail of Dubiel-etal-ETRA2021-Combining-oculo-motor-indices-to-measure-cognitive-load] Text (Dubiel-etal-ETRA2021-Combining-oculo-motor-indices-to-measure-cognitive-load)
Dubiel_etal_ETRA2021_Combining_oculo_motor_indices_to_measure_cognitive_load.pdf
Accepted Author Manuscript
Restricted to Repository staff only until 24 May 2021.

Download (825kB) | Request a copy from the Strathclyde author

    Abstract

    Gaze-based assistive technologies (ATs) that feature speech have the potential to improve the life of people with communication disorders. However, due to a limited understanding of how different speech types affect the cognitive load of users, an evaluation of ATs remains a challenge. Expanding on previous work, we combined temporal changes in pupil size and ocular movements (saccades and fixation differentials) to evaluate cognitive workload of two types of speech (natural and synthetic) mixed with noise, through a listening test. While observed pupil sizes were significantly larger at lower signal-to-noise levels, as participants listened and memorised speech stimuli; saccadic eye-movements were significantly more frequent for synthetic speech. In the synthetic condition, there was a strong negative correlation between pupil dilation and fixation differentials, indicating a higher strain on participants’ cognitive resources. These results suggest that combining oculo-motor indices can aid our understanding of the cognitive implications of different speech types.

    ORCID iDs

    Dubiel, Mateusz ORCID logoORCID: https://orcid.org/0000-0001-8250-3370, Nakayama, Minoru and Wang, Xin;