Continual Learning with Deep Neural Networks in Physiological Signal Data: A Survey

Overview

Journal Healthcare (Basel)

Specialty Health Services

Date 2024 Jan 23

PMID 38255045

Authors

Ao Li

Huayu Li

Geng Yuan

Affiliations

Soon will be listed here.

Abstract

Deep-learning algorithms hold promise in processing physiological signal data, including electrocardiograms (ECGs) and electroencephalograms (EEGs). However, healthcare often requires long-term monitoring, posing a challenge to traditional deep-learning models. These models are generally trained once and then deployed, which limits their ability to adapt to the dynamic and evolving nature of healthcare scenarios. Continual learning-known for its adaptive learning capabilities over time-offers a promising solution to these challenges. However, there remains an absence of consolidated literature, which reviews the techniques, applications, and challenges of continual learning specific to physiological signal analysis, as well as its future directions. Bridging this gap, our review seeks to provide an overview of the prevailing techniques and their implications for smart healthcare. We delineate the evolution from traditional approaches to the paradigms of continual learning. We aim to offer insights into the challenges faced and outline potential paths forward. Our discussion emphasizes the need for benchmarks, adaptability, computational efficiency, and user-centric design in the development of future healthcare systems.

References

Alday E, Gu A, Shah A, Robichaux C, Wong A, Liu C . Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020. Physiol Meas. 2020; 41(12):124003. PMC: 8015789. DOI: 10.1088/1361-6579/abc960. View

Kemp B, Zwinderman A, Tuk B, Kamphuisen H, Oberye J . Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng. 2000; 47(9):1185-94. DOI: 10.1109/10.867928. View

Pollard T, Johnson A, Raffa J, Celi L, Mark R, Badawi O . The eICU Collaborative Research Database, a freely available multi-center database for critical care research. Sci Data. 2018; 5:180178. PMC: 6132188. DOI: 10.1038/sdata.2018.178. View

Rim B, Sung N, Min S, Hong M . Deep Learning in Physiological Signal Data: A Survey. Sensors (Basel). 2020; 20(4). PMC: 7071412. DOI: 10.3390/s20040969. View

Zheng J, Zhang J, Danioko S, Yao H, Guo H, Rakovski C . A 12-lead electrocardiogram database for arrhythmia research covering more than 10,000 patients. Sci Data. 2020; 7(1):48. PMC: 7016169. DOI: 10.1038/s41597-020-0386-x. View

Parisi G, Kemker R, Part J, Kanan C, Wermter S . Continual lifelong learning with neural networks: A review. Neural Netw. 2019; 113:54-71. DOI: 10.1016/j.neunet.2019.01.012. View

Hadsell R, Rao D, Rusu A, Pascanu R . Embracing Change: Continual Learning in Deep Neural Networks. Trends Cogn Sci. 2020; 24(12):1028-1040. DOI: 10.1016/j.tics.2020.09.004. View

De Lange M, Aljundi R, Masana M, Parisot S, Jia X, Leonardis A . A Continual Learning Survey: Defying Forgetting in Classification Tasks. IEEE Trans Pattern Anal Mach Intell. 2021; 44(7):3366-3385. DOI: 10.1109/TPAMI.2021.3057446. View

Wagner P, Strodthoff N, Bousseljot R, Kreiseler D, Lunze F, Samek W . PTB-XL, a large publicly available electrocardiography dataset. Sci Data. 2020; 7(1):154. PMC: 7248071. DOI: 10.1038/s41597-020-0495-6. View

10.

van de Ven G, Tuytelaars T, Tolias A . Three types of incremental learning. Nat Mach Intell. 2022; 4(12):1185-1197. PMC: 9771807. DOI: 10.1038/s42256-022-00568-3. View

11.

Sun L, Zhang M, Wang B, Tiwari P . Few-Shot Class-Incremental Learning for Medical Time Series Classification. IEEE J Biomed Health Inform. 2023; PP. DOI: 10.1109/JBHI.2023.3247861. View

12.

Ammour N, Alhichri H, Bazi Y, Alajlan N . LwF-ECG: Learning-without-forgetting approach for electrocardiogram heartbeat classification based on memory with task selector. Comput Biol Med. 2021; 137:104807. DOI: 10.1016/j.compbiomed.2021.104807. View

13.

Kirkpatrick J, Pascanu R, Rabinowitz N, Veness J, Desjardins G, Rusu A . Overcoming catastrophic forgetting in neural networks. Proc Natl Acad Sci U S A. 2017; 114(13):3521-3526. PMC: 5380101. DOI: 10.1073/pnas.1611835114. View

14.

Gao Q, Luo Z, Klabjan D, Zhang F . Efficient Architecture Search for Continual Learning. IEEE Trans Neural Netw Learn Syst. 2022; 34(11):8555-8565. DOI: 10.1109/TNNLS.2022.3151511. View

15.

Moody G, Mark R . The impact of the MIT-BIH arrhythmia database. IEEE Eng Med Biol Mag. 2001; 20(3):45-50. DOI: 10.1109/51.932724. View

16.

Kiyasseh D, Zhu T, Clifton D . A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. Nat Commun. 2021; 12(1):4221. PMC: 8270996. DOI: 10.1038/s41467-021-24483-0. View

17.

Goldberger A, Amaral L, Glass L, Hausdorff J, Ivanov P, Mark R . PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. 2000; 101(23):E215-20. DOI: 10.1161/01.cir.101.23.e215. View

18.

Sun L, Chen Q, Zheng M, Ning X, Gupta D, Tiwari P . Energy-efficient Online Continual Learning for Time Series Classification in Nanorobot-based Smart Health. IEEE J Biomed Health Inform. 2023; PP. DOI: 10.1109/JBHI.2023.3289992. View

19.

Faust O, Hagiwara Y, Hong T, Lih O, Rajendra Acharya U . Deep learning for healthcare applications based on physiological signals: A review. Comput Methods Programs Biomed. 2018; 161:1-13. DOI: 10.1016/j.cmpb.2018.04.005. View

20.

Lee C, Lee A . Clinical applications of continual learning machine learning. Lancet Digit Health. 2020; 2(6):e279-e281. PMC: 8259323. DOI: 10.1016/S2589-7500(20)30102-3. View