» Articles » PMID: 35455101

A Quantitative Comparison Between Shannon and Tsallis-Havrda-Charvat Entropies Applied to Cancer Outcome Prediction

Abstract

In this paper, we propose to quantitatively compare loss functions based on parameterized Tsallis-Havrda-Charvat entropy and classical Shannon entropy for the training of a deep network in the case of small datasets which are usually encountered in medical applications. Shannon cross-entropy is widely used as a loss function for most neural networks applied to the segmentation, classification and detection of images. Shannon entropy is a particular case of Tsallis-Havrda-Charvat entropy. In this work, we compare these two entropies through a medical application for predicting recurrence in patients with head-neck and lung cancers after treatment. Based on both CT images and patient information, a multitask deep neural network is proposed to perform a recurrence prediction task using cross-entropy as a loss function and an image reconstruction task. Tsallis-Havrda-Charvat cross-entropy is a parameterized cross-entropy with the parameter α. Shannon entropy is a particular case of Tsallis-Havrda-Charvat entropy for α=1. The influence of this parameter on the final prediction results is studied. In this paper, the experiments are conducted on two datasets including in total 580 patients, of whom 434 suffered from head-neck cancers and 146 from lung cancers. The results show that Tsallis-Havrda-Charvat entropy can achieve better performance in terms of prediction accuracy with some values of α.

Citing Articles

Applications of Entropy in Data Analysis and Machine Learning: A Review.

Sepulveda-Fontaine S, Amigo J Entropy (Basel). 2025; 26(12).

PMID: 39766755 PMC: 11675792. DOI: 10.3390/e26121126.


Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review.

Kebaili A, Lapuyade-Lahorgue J, Ruan S J Imaging. 2023; 9(4).

PMID: 37103232 PMC: 10144738. DOI: 10.3390/jimaging9040081.


Tumor Diagnosis against Other Brain Diseases Using T2 MRI Brain Images and CNN Binary Classifier and DWT.

Papadomanolakis T, Sergaki E, Polydorou A, Krasoudakis A, Makris-Tsalikis G, Polydorou A Brain Sci. 2023; 13(2).

PMID: 36831891 PMC: 9954603. DOI: 10.3390/brainsci13020348.


An Entropy-Based Measure of Complexity: An Application in Lung-Damage.

Ortiz-Vilchis P, Ramirez-Arellano A Entropy (Basel). 2022; 24(8).

PMID: 36010783 PMC: 9407132. DOI: 10.3390/e24081119.


Catastrophe Theory Applied to Neuropsychological Data: Nonlinear Effects of Depression on Financial Capacity in Amnestic Mild Cognitive Impairment and Dementia.

Stamovlasis D, Giannouli V, Vaiopoulou J, Tsolaki M Entropy (Basel). 2022; 24(8).

PMID: 36010753 PMC: 9407425. DOI: 10.3390/e24081089.


References
1.
Amyar A, Modzelewski R, Li H, Ruan S . Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation. Comput Biol Med. 2020; 126:104037. PMC: 7543793. DOI: 10.1016/j.compbiomed.2020.104037. View

2.
Jin L, Shi F, Chun Q, Chen H, Ma Y, Wu S . Artificial intelligence neuropathologist for glioma classification using deep learning on hematoxylin and eosin stained slide images and molecular markers. Neuro Oncol. 2020; 23(1):44-52. PMC: 7850049. DOI: 10.1093/neuonc/noaa163. View

3.
Amigo J, Balogh S, Hernandez S . A Brief Review of Generalized Entropies. Entropy (Basel). 2020; 20(11). PMC: 7512376. DOI: 10.3390/e20110813. View

4.
Doppalapudi S, Qiu R, Badr Y . Lung cancer survival period prediction and understanding: Deep learning approaches. Int J Med Inform. 2021; 148:104371. DOI: 10.1016/j.ijmedinf.2020.104371. View

5.
Zhou T, Canu S, Vera P, Ruan S . Latent Correlation Representation Learning for Brain Tumor Segmentation With Missing MRI Modalities. IEEE Trans Image Process. 2021; 30:4263-4274. DOI: 10.1109/TIP.2021.3070752. View