A novel user-based gesture vocabulary for conceptual design

Vuletic, Tijana and Duffy, Alex and McTeague, Chris and Hay, Laura and Brisco, Ross and Campbell, Gerard and Grealy, Madeleine (2021) A novel user-based gesture vocabulary for conceptual design. International Journal of Human Computer Studies, 150. 102609. ISSN 1071-5819 (https://doi.org/10.1016/j.ijhcs.2021.102609)

[thumbnail of Vuletic-etal-IJHCS-2021-A-novel-user-based-gesture-vocabulary-for-conceptual-design]
Preview
 Text. Filename: Vuletic_etal_IJHCS_2021_A_novel_user_based_gesture_vocabulary_for_conceptual_design.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (3MB)| Preview

Abstract

Research into hand gestures for human computer interaction has been prolific recently, but within it research on hand gestures for conceptual design has either focused on gestures that were defined by the researchers rather than the users, or those that were heavily influenced by what can be achieved using currently available technology. This paper reports on the study performed to identify a user elicited vocabulary of gestures for conceptual design, disassociated from the currently available technology, and its subsequent evaluation. The study included 44 product design engineering students (3rd, 4th year and recent graduates) and identified 1772 gestures that were analysed to build a novel gesture consensus set of vocabulary of hand gestures for conceptual design. This set is then evaluated by 10 other professionals, in order to generalise this set for a wider range of users and possibly reduce the need for training. The evaluation has shown that majority of gestures added to the vocabulary were easy to perform and appropriate for the activities, but that at the implementation stage the vocabulary will require another round of evaluation to account for the technology capabilities. The aim of this work is to create a starting point for a potential future system that could adapt to individual designers and allow them to use non-prescribed gestures that will support rather than inhibit their conceptual design thinking processes, akin to the developments that happened in hand writing recognition or predictive texting.

ORCID iDs

Vuletic, Tijana ORCID logoORCID: https://orcid.org/0000-0002-9808-9087, Duffy, Alex ORCID logoORCID: https://orcid.org/0000-0002-5661-4314, McTeague, Chris ORCID logoORCID: https://orcid.org/0000-0002-7414-3245, Hay, Laura ORCID logoORCID: https://orcid.org/0000-0002-3259-9463, Brisco, Ross ORCID logoORCID: https://orcid.org/0000-0002-8216-9218, Campbell, Gerard ORCID logoORCID: https://orcid.org/0009-0005-0186-1464 and Grealy, Madeleine ORCID logoORCID: https://orcid.org/0000-0002-2823-8841;
CORE (COnnecting REpositories)