Human emotion recognition in video using subtraction pre-processing

He, Zhihao and Jin, Tian and Basu, Amlan and Soraghan, John and Di Caterina, Gaetano and Petropoulakis, Lykourgos; (2019) Human emotion recognition in video using subtraction pre-processing. In: ICMLC '19 Proceedings of the 2019 11th International Conference on Machine Learning and Computing. ACM, CHN, pp. 374-379. ISBN 978-1-4503-6600-7 (https://doi.org/10.1145/3318299.3318321)

[thumbnail of He-etal-ICMLC-2018-Human-emotion-recognition-in-video]
Preview
 Text. Filename: He_etal_ICMLC_2018_Human_emotion_recognition_in_video.pdf
Accepted Author Manuscript
Download (1MB)| Preview

Abstract

In this paper, we describe a new image pre-processing method, which can show features or important information clearly. Deep learning methods have grown rapidly in the last ten years and have better performance than the traditional machine learning methods in many domains. Deep learning shows its powerful ability particular in difficult multi-classes classification challenges. Video Facial expression recognition is one of the most popular classification topics and will become essential in robotics and auto-motion fields. The new system presented is a combination of new video pre-processing and Convolutional Neural Network (CNN). The new pre-processing method is proposed because we believe individual emotions are dynamic, which means the change of the face is the key feature. RAVDESS is the video set used, to train and test the neural network. From RAVDESS dataset the video songs without audio are taken for focusing on video frames differences. The chosen video set has six different classes of emotions. Each video presents a sentence in a melodious way. Based on the chosen video set, the new system with a new pre-processing method has been designed and trained. Later, the classification result of the new method has been compared with others in which the same dataset for video emotion recognition was used.

ORCID iDs

He, Zhihao, Jin, Tian, Basu, Amlan ORCID logoORCID: https://orcid.org/0000-0002-0180-8090, Soraghan, John ORCID logoORCID: https://orcid.org/0000-0003-4418-7391, Di Caterina, Gaetano ORCID logoORCID: https://orcid.org/0000-0002-7256-0897 and Petropoulakis, Lykourgos ORCID logoORCID: https://orcid.org/0000-0003-3230-9670;
CORE (COnnecting REpositories)