Systematic literature review of hand gestures used in human computer interaction interfaces

Vuletic, Tijana and Duffy, Alex and Hay, Laura and McTeague, Chris and Campbell, Gerard and Grealy, Madeleine (2019) Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human Computer Studies, 129. pp. 74-94. ISSN 1071-5819 (https://doi.org/10.1016/j.ijhcs.2019.03.011)

[thumbnail of Vuletic-etal-IJHCS2019-Systematic-literature-review-of-hand-gestures-used-in-human-computer]
Preview
 Text. Filename: Vuletic_etal_IJHCS2019_Systematic_literature_review_of_hand_gestures_used_in_human_computer.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (1MB)| Preview

Abstract

Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.

ORCID iDs

Vuletic, Tijana ORCID logoORCID: https://orcid.org/0000-0002-9808-9087, Duffy, Alex ORCID logoORCID: https://orcid.org/0000-0002-5661-4314, Hay, Laura ORCID logoORCID: https://orcid.org/0000-0002-3259-9463, McTeague, Chris ORCID logoORCID: https://orcid.org/0000-0002-7414-3245, Campbell, Gerard ORCID logoORCID: https://orcid.org/0009-0005-0186-1464 and Grealy, Madeleine ORCID logoORCID: https://orcid.org/0000-0002-2823-8841;
CORE (COnnecting REpositories)