On time series cross-validation for deep learning classification model of mental workload levels based on EEG signals

Kingphai, Kunjira and Moshfeghi, Yashar; Nicosia, Giuseppe and Giuffrida, Giovanni and Ojha, Varun and La Malfa, Emanuele and La Malfa, Gabriele and Pardalos, Panos and Di Fatta, Giuseppe and Umeton, Renato, eds. (2023) On time series cross-validation for deep learning classification model of mental workload levels based on EEG signals. In: Machine Learning, Optimization, and Data Science - 8th International Conference, LOD 2022, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13811 . Springer Science and Business Media Deutschland GmbH, ITA, pp. 402-416. ISBN 9783031258916 (https://doi.org/10.1007/978-3-031-25891-6_30)

[thumbnail of Kingphai-Moshfeghi-2022-On-time-series-cross-validation-for-deep-learning-classification-model-of-mental-workload-levels] Text. Filename: Kingphai_Moshfeghi_2022_On_time_series_cross_validation_for_deep_learning_classification_model_of_mental_workload_levels.pdf
Accepted Author Manuscript
Restricted to Repository staff only until 10 March 2025.
License: Strathprints license 1.0
Download (716kB) | Request a copy

Abstract

The determination of a subject's mental workload (MWL) from an electroencephalogram (EEG) is a well-studied area in the brain-computer interface (BCI) field. A high MWL level can significantly contribute to mental fatigue, decreased performance, and long-term health problems. Inspired by the success of machine learning in various areas, researchers have investigated the use of deep learning models to classify subjects' MWL levels. A common approach that is used to evaluate such classification models is the cross-validation (CV) technique. However, the CV technique used for such models does not take into account the time series nature of EEG signals. Therefore, in this paper we propose a modification of CV techniques, i.e. a blocked form of CV with rolling window and expanding window strategies, which are more suitable for EEG signals. Then, we investigate the effectiveness of the two strategies and also explore the effects of different block sizes for each strategy. We then apply these models to several state-of-the-art deep learning models used for MWL classification from EEG signals using a publicly available dataset, STEW. There were two classification tasks: Task 1- resting vs testing state, and Task 2- low vs moderate vs high MWL. Our results show that the model evaluated by the expanding window strategy, when it was trained using the 90% of data, provided a better performance than the rolling window strategy and that the BGRU-GRU model outperformed the other models for both tasks.

ORCID iDs

Kingphai, Kunjira and Moshfeghi, Yashar ORCID logoORCID: https://orcid.org/0000-0003-4186-1088; Nicosia, Giuseppe, Giuffrida, Giovanni, Ojha, Varun, La Malfa, Emanuele, La Malfa, Gabriele, Pardalos, Panos, Di Fatta, Giuseppe and Umeton, Renato
CORE (COnnecting REpositories)