Multi-Moji : Combining thermal, vibrotactile & visual stimuli to expand the affective range of feedback

Wilson, Graham and Brewster, Stephen A.; (2017) Multi-Moji : Combining thermal, vibrotactile & visual stimuli to expand the affective range of feedback. In: CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems - Proceedings . ACM, USA, pp. 1743-1755. ISBN 9781450346559 (https://doi.org/10.1145/3025453.3025614)

[thumbnail of Wilson-Brewster-CHI-2017-Multi-moji-combining-thermal-vibrotactile-and-visual-stimuli-to-expand-the-affective-range-of-feedback]
Preview
 Text. Filename: Wilson_Brewster_CHI_2017_Multi_moji_combining_thermal_vibrotactile_and_visual_stimuli_to_expand_the_affective_range_of_feedback.pdf
Accepted Author Manuscript
Download (1MB)| Preview

Abstract

This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valence-arousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions.

ORCID iDs

Wilson, Graham ORCID logoORCID: https://orcid.org/0000-0003-2664-1634 and Brewster, Stephen A.;
CORE (COnnecting REpositories)