Yawn analysis with mouth occlusion detection

Mat Ibrahim, Masrullizam and Soraghan, John J. and Petropoulakis, Lykourgos and Di Caterina, Gaetano (2015) Yawn analysis with mouth occlusion detection. Biomedical Signal Processing and Control, 18. pp. 360-369. ISSN 1746-8094 (https://doi.org/10.1016/j.bspc.2015.02.006)

[thumbnail of Ibrahim-etal-BSPC2015-yawn-analysis-with-mouth-occlusion-detection]
Preview
 PDF. Filename: Ibrahim_etal_BSPC2015_yawn_analysis_with_mouth_occlusion_detection.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (888kB)| Preview

Abstract

One of the most common signs of tiredness or fatigue is yawning. Naturally, identification of fatigued individuals would be helped if yawning is detected. Existing techniques for yawn detection are centred on measuring the mouth opening. This approach, however, may fail if the mouth is occluded by the hand, as it is frequently the case. The work presented in this paper focuses on a technique to detect yawning whilst also allowing for cases of occlusion. For measuring the mouth opening, a new technique which applies adaptive colour region is introduced. For detecting yawning whilst the mouth is occluded, Local Binary Pattern (LBP) features are used to also identify facial distortions during yawning. In this research, the Strathclyde Facial Fatigue (SFF) database which contains genuine video footage of fatigued individuals is used for training, testing and evaluation of the system.

ORCID iDs

Mat Ibrahim, Masrullizam, Soraghan, John J. ORCID logoORCID: https://orcid.org/0000-0003-4418-7391, Petropoulakis, Lykourgos ORCID logoORCID: https://orcid.org/0000-0003-3230-9670 and Di Caterina, Gaetano ORCID logoORCID: https://orcid.org/0000-0002-7256-0897;
CORE (COnnecting REpositories)