Continuous patient state attention model for addressing irregularity in electronic health records

Tools

Chauhan, Vinod Kumar and Thakur, Anshul and O’Donoghue, Odhran and Rohanian, Omid and Molaei, Soheila and Clifton, David A. (2024) Continuous patient state attention model for addressing irregularity in electronic health records. BMC Medical Informatics and Decision Making, 24 (1). 117. ISSN 1472-6947 (https://doi.org/10.1186/s12911-024-02514-2)

[thumbnail of Chauhan-etal-BMC-MIDM-2024-Continuous-patient-state-attention-model-for-addressing-irregularity-in]
Preview
 Text. Filename: Chauhan-etal-BMC-MIDM-2024-Continuous-patient-state-attention-model-for-addressing-irregularity-in.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

Background Irregular time series (ITS) are common in healthcare as patient data is recorded in an electronic health record (EHR) system as per clinical guidelines/requirements but not for research and depends on a patient’s health status. Due to irregularity, it is challenging to develop machine learning techniques to uncover vast intelligence hidden in EHR big data, without losing performance on downstream patient outcome prediction tasks. Methods In this paper, we propose Perceiver, a cross-attention-based transformer variant that is computationally efficient and can handle long sequences of time series in healthcare. We further develop continuous patient state attention models, using Perceiver and transformer to deal with ITS in EHR. The continuous patient state models utilise neural ordinary differential equations to learn patient health dynamics, i.e., patient health trajectory from observed irregular time steps, which enables them to sample patient state at any time. Results The proposed models’ performance on in-hospital mortality prediction task on PhysioNet-2012 challenge and MIMIC-III datasets is examined. Perceiver model either outperforms or performs at par with baselines, and reduces computations by about nine times when compared to the transformer model, with no significant loss of performance. Experiments to examine irregularity in healthcare reveal that continuous patient state models outperform baselines. Moreover, the predictive uncertainty of the model is used to refer extremely uncertain cases to clinicians, which enhances the model’s performance. Code is publicly available and verified at https://codeocean.com/capsule/4587224. Conclusions Perceiver presents a computationally efficient potential alternative for processing long sequences of time series in healthcare, and the continuous patient state attention models outperform the traditional and advanced techniques to handle irregularity in the time series. Moreover, the predictive uncertainty of the model helps in the development of transparent and trustworthy systems, which can be utilised as per the availability of clinicians.

ORCID iDs

Chauhan, Vinod Kumar ORCID logoORCID: https://orcid.org/0000-0001-8195-548X, Thakur, Anshul, O’Donoghue, Odhran, Rohanian, Omid, Molaei, Soheila and Clifton, David A.;
CORE (COnnecting REpositories)