BERT-based transformers for early detection of mental health illnesses

Martínez-Castaño, Rodrigo and Htait, Amal and Azzopardi, Leif and Moshfeghi, Yashar; Candan, K. Selçuk and Ionescu, Bogdan and Goeuriot, Lorraine and Larsen, Birger and Müller, Henning and Joly, Alexis and Maistro, Maria and Piroi, Florina and Faggioli, Guglielmo and Ferro, Nicola, eds. (2021) BERT-based transformers for early detection of mental health illnesses. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) . Springer Science and Business Media Deutschland GmbH, Virtual, Online, pp. 189-200. ISBN 9783030852504 (https://doi.org/10.1007/978-3-030-85251-1_15)

[thumbnail of Martinez-Castano-Springer-2021-BERT-Based-transformers-for-early]
Preview
 Text. Filename: Martinez_Castano_Springer_2021_BERT_Based_transformers_for_early.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (373kB)| Preview

Abstract

This paper briefly describes our research groups' efforts in tackling Task 1 (Early Detection of Signs of Self-Harm), and Task 2 (Measuring the Severity of the Signs of Depression) from the CLEF eRisk Track. Core to how we approached these problems was the use of BERT-based classifiers which were trained specifically for each task. Our results on both tasks indicate that this approach delivers high performance across a series of measures, particularly for Task 1, where our submissions obtained the best performance for precision, F1, latency-weighted F1 and ERDE at 5 and 50. This work suggests that BERT-based classifiers, when trained appropriately, can accurately infer which social media users are at risk of self-harming, with precision up to 91.3% for Task 1. Given these promising results, it will be interesting to further refine the training regime, classifier and early detection scoring mechanism, as well as apply the same approach to other related tasks (e.g., anorexia, depression, suicide).

ORCID iDs

Martínez-Castaño, Rodrigo, Htait, Amal ORCID logoORCID: https://orcid.org/0000-0003-4647-9996, Azzopardi, Leif and Moshfeghi, Yashar ORCID logoORCID: https://orcid.org/0000-0003-4186-1088; Candan, K. Selçuk, Ionescu, Bogdan, Goeuriot, Lorraine, Larsen, Birger, Müller, Henning, Joly, Alexis, Maistro, Maria, Piroi, Florina, Faggioli, Guglielmo and Ferro, Nicola
CORE (COnnecting REpositories)