Siamese residual neural network for musical shape evaluation in piano performance assessment

Li, Xiaoquan and Weiss, Stephan and Yan, Yijun and Li, Yinhe and Ren, Jinchang and Soraghan, John and Gong, Ming (2023) Siamese residual neural network for musical shape evaluation in piano performance assessment. In: 31st European Signal Processing Conference, 2023-09-04 - 2023-09-08.

[thumbnail of Li-etal-EUSIPCO-2023-Siamese-residual-neural-network-for-musical-shape-evaluation-in-piano-performance-assessment]
Preview
 Text. Filename: Li_etal_EUSIPCO_2023_Siamese_residual_neural_network_for_musical_shape_evaluation_in_piano_performance_assessment.pdf
Accepted Author Manuscript
License: Strathprints license 1.0
Download (1MB)| Preview

Abstract

Understanding and identifying musical shape plays an important role in music education and performance assessment. To simplify the otherwise time- and cost-intensive musical shape evaluation, in this paper we explore how artificial intelligence (AI) driven models can be applied. Considering musical shape evaluation as a classification problem, a light-weight Siamese residual neural network (S-ResNN) is proposed to automatically identify musical shapes. To assess the proposed approach in the context of piano musical shape evaluation, we have generated a new dataset, containing 4116 music pieces derived by 147 piano preparatory exercises and performed in 28 categories of musical shapes. The experimental results show that the S-ResNN significantly outperforms a number of benchmark methods in terms of the precision, recall and F1 score.

ORCID iDs

Li, Xiaoquan, Weiss, Stephan ORCID logoORCID: https://orcid.org/0000-0002-3486-7206, Yan, Yijun, Li, Yinhe, Ren, Jinchang, Soraghan, John ORCID logoORCID: https://orcid.org/0000-0003-4418-7391 and Gong, Ming;
CORE (COnnecting REpositories)