Control of a drone with body gestures

Gio, Nicolas and Brisco, Ross and Vuletic, Tijana (2021) Control of a drone with body gestures. Proceedings of the Design Society: International Conference on Engineering Design, 1. pp. 761-770. ISSN 2220-4342 (https://doi.org/10.1017/pds.2021.76)

[thumbnail of Gio-etal-PDS-ICED-2021-Control-of-a-drone-with-body]
Preview
 Text. Filename: Gio_etal_PDS_ICED_2021_Control_of_a_drone_with_body.pdf
Final Published Version
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (855kB)| Preview

Abstract

Drones are becoming more popular within military applications and civil aviation by hobbyists and business. Achieving a natural Human-Drone Interaction (HDI) would enable unskilled drone pilots to take part in the flying of these devices and more generally easy the use of drones. The research within this paper focuses on the design and development of a Natural User Interface (NUI) allowing a user to pilot a drone with body gestures. A Microsoft Kinect was used to capture the user's body information which was processed by a motion recognition algorithm and converted into commands for the drone. The implementation of a Graphical User Interface (GUI) gives feedback to the user. Visual feedback from the drone's onboard camera is provided on a screen and an interactive menu controlled by body gestures and allowing the choice of functionalities such as photo and video capture or take-off and landing has been implemented. This research resulted in an efficient and functional system, more instinctive, natural, immersive and fun than piloting using a physical controller, including innovative aspects such as the implementation of additional functionalities to the drone's piloting and control of the flight speed.

ORCID iDs

Gio, Nicolas, Brisco, Ross ORCID logoORCID: https://orcid.org/0000-0002-8216-9218 and Vuletic, Tijana ORCID logoORCID: https://orcid.org/0000-0002-9808-9087;
CORE (COnnecting REpositories)