Entropy Measures, Entropy Estimators, and Their Performance in Quantifying Complex Dynamics: Effects of Artifacts, Nonstationarity, and Long-range Correlations

Overview

Journal Phys Rev E

Publisher American Physical Society

Specialty Biophysics

Date 2017 Jul 16

PMID 28709192

Citations 54

Authors

Wanting Xiong

Luca Faes

Plamen Ch Ivanov

Affiliations

Soon will be listed here.

Abstract

Entropy measures are widely applied to quantify the complexity of dynamical systems in diverse fields. However, the practical application of entropy methods is challenging, due to the variety of entropy measures and estimators and the complexity of real-world time series, including nonstationarities and long-range correlations (LRC). We conduct a systematic study on the performance, bias, and limitations of three basic measures (entropy, conditional entropy, information storage) and three traditionally used estimators (linear, kernel, nearest neighbor). We investigate the dependence of entropy measures on estimator- and process-specific parameters, and we show the effects of three types of nonstationarities due to artifacts (trends, spikes, local variance change) in simulations of stochastic autoregressive processes. We also analyze the impact of LRC on the theoretical and estimated values of entropy measures. Finally, we apply entropy methods on heart rate variability data from subjects in different physiological states and clinical conditions. We find that entropy measures can only differentiate changes of specific types in cardiac dynamics and that appropriate preprocessing is vital for correct estimation and interpretation. Demonstrating the limitations of entropy methods and shedding light on how to mitigate bias and provide correct interpretations of results, this work can serve as a comprehensive reference for the application of entropy methods and the evaluation of existing studies.

Citing Articles

Information dynamics of in silico EEG Brain Waves: Insights into oscillations and functions.

Menesse G, Torres J PLoS Comput Biol. 2024; 20(9):e1012369.

PMID: 39236071 PMC: 11407780. DOI: 10.1371/journal.pcbi.1012369.

Response inhibition in premotor cortex corresponds to a complex reshuffle of the mesoscopic information network.

Bardella G, Giuffrida V, Giarrocco F, Brunamonti E, Pani P, Ferraina S Netw Neurosci. 2024; 8(2):597-622.

PMID: 38952814 PMC: 11168728. DOI: 10.1162/netn_a_00365.

Wearable Ring-Shaped Biomedical Device for Physiological Monitoring through Finger-Based Acquisition of Electrocardiographic, Photoplethysmographic, and Galvanic Skin Response Signals: Design and Preliminary Measurements.

Volpes G, Valenti S, Genova G, Bara C, Parisi A, Faes L Biosensors (Basel). 2024; 14(4).

PMID: 38667198 PMC: 11048376. DOI: 10.3390/bios14040205.

Inferring connectivity of an oscillatory network via the phase dynamics reconstruction.

Rosenblum M, Pikovsky A Front Netw Physiol. 2023; 3:1298228.

PMID: 38073862 PMC: 10704096. DOI: 10.3389/fnetp.2023.1298228.

Nonadditive Entropy Application to Detrended Force Sensor Data to Indicate Balance Disorder of Patients with Vestibular System Dysfunction.

Kose H, Ikizoglu S Entropy (Basel). 2023; 25(10).

PMID: 37895507 PMC: 10606935. DOI: 10.3390/e25101385.

References

Barnett L, Seth A . The MVGC multivariate Granger causality toolbox: a new approach to Granger-causal inference. J Neurosci Methods. 2013; 223:50-68. DOI: 10.1016/j.jneumeth.2013.10.018. View

Gomez C, Poza J, Garcia M, Fernandez A, Hornero R . Regularity analysis of spontaneous MEG activity in Attention-Deficit/Hyperactivity Disorder. Annu Int Conf IEEE Eng Med Biol Soc. 2012; 2011:1765-8. DOI: 10.1109/IEMBS.2011.6090504. View

Faes L, Porta A, Rossato G, Adami A, Tonon D, Corica A . Investigating the mechanisms of cardiovascular and cerebrovascular regulation in orthostatic syncope through an information decomposition strategy. Auton Neurosci. 2013; 178(1-2):76-82. DOI: 10.1016/j.autneu.2013.02.013. View

Khandoker A, Palaniswami M, Begg R . A comparative study on approximate entropy measure and poincaré plot indexes of minimum foot clearance variability in the elderly during walking. J Neuroeng Rehabil. 2008; 5:4. PMC: 2268940. DOI: 10.1186/1743-0003-5-4. View

Barnett L, Barrett A, Seth A . Granger causality and transfer entropy are equivalent for Gaussian variables. Phys Rev Lett. 2010; 103(23):238701. DOI: 10.1103/PhysRevLett.103.238701. View

Vigo D, Dominguez J, Guinjoan S, Scaramal M, Ruffa E, Solerno J . Nonlinear analysis of heart rate variability within independent frequency components during the sleep-wake cycle. Auton Neurosci. 2009; 154(1-2):84-8. DOI: 10.1016/j.autneu.2009.10.007. View

Chicharro D, Ledberg A . Framework to study dynamic dependencies in networks of interacting processes. Phys Rev E Stat Nonlin Soft Matter Phys. 2012; 86(4 Pt 1):041901. DOI: 10.1103/PhysRevE.86.041901. View

Victor J . Binless strategies for estimation of information from neural data. Phys Rev E Stat Nonlin Soft Matter Phys. 2003; 66(5 Pt 1):051903. DOI: 10.1103/PhysRevE.66.051903. View

Kraskov A, Stogbauer H, Grassberger P . Estimating mutual information. Phys Rev E Stat Nonlin Soft Matter Phys. 2004; 69(6 Pt 2):066138. DOI: 10.1103/PhysRevE.69.066138. View

10.

Ferenets R, Vanluchene A, Lipping T, Heyse B, Struys M . Behavior of entropy/complexity measures of the electroencephalogram during propofol-induced sedation: dose-dependent effects of remifentanil. Anesthesiology. 2007; 106(4):696-706. DOI: 10.1097/01.anes.0000264790.07231.2d. View

11.

Akselrod S, Gordon D, Ubel F, Shannon D, Berger A, Cohen R . Power spectrum analysis of heart rate fluctuation: a quantitative probe of beat-to-beat cardiovascular control. Science. 1981; 213(4504):220-2. DOI: 10.1126/science.6166045. View

12.

Cohen M, Taylor J . Short-term cardiovascular oscillations in man: measuring and modelling the physiologies. J Physiol. 2002; 542(Pt 3):669-83. PMC: 2290446. DOI: 10.1113/jphysiol.2002.017483. View

13.

Sosnoff J, Goldman M, Motl R . Real-life walking impairment in multiple sclerosis: preliminary comparison of four methods for processing accelerometry data. Mult Scler. 2010; 16(7):868-77. DOI: 10.1177/1352458510373111. View

14.

Rhea C, Silver T, Hong S, Ryu J, Studenka B, Hughes C . Noise and complexity in human postural control: interpreting the different estimations of entropy. PLoS One. 2011; 6(3):e17696. PMC: 3060087. DOI: 10.1371/journal.pone.0017696. View

15.

Malliani A, Pagani M, Lombardi F, Cerutti S . Cardiovascular neural regulation explored in the frequency domain. Circulation. 1991; 84(2):482-92. DOI: 10.1161/01.cir.84.2.482. View

16.

Wessel N, Voss A, Kurths J, Schirdewan A, Hnatkova K, Malik M . Evaluation of renormalised entropy for risk stratification using heart rate variability data. Med Biol Eng Comput. 2001; 38(6):680-5. DOI: 10.1007/BF02344875. View

17.

Voss A, Schroeder R, Heitmann A, Peters A, Perz S . Short-term heart rate variability--influence of gender and age in healthy subjects. PLoS One. 2015; 10(3):e0118308. PMC: 4378923. DOI: 10.1371/journal.pone.0118308. View

18.

Ashkenazy Y, Ivanov P, Havlin S, Peng C, Goldberger A, Stanley H . Magnitude and sign correlations in heartbeat fluctuations. Phys Rev Lett. 2001; 86(9):1900-3. DOI: 10.1103/PhysRevLett.86.1900. View

19.

Kurths J, Voss A, Saparin P, Witt A, Kleiner H, Wessel N . Quantitative analysis of heart rate variability. Chaos. 1995; 5(1):88-94. DOI: 10.1063/1.166090. View

20.

Ponikowski P, Anker S, Chua T, Szelemej R, Piepoli M, Adamopoulos S . Depressed heart rate variability as an independent predictor of death in chronic congestive heart failure secondary to ischemic or idiopathic dilated cardiomyopathy. Am J Cardiol. 1997; 79(12):1645-50. DOI: 10.1016/s0002-9149(97)00215-4. View