A Deep Image Classification Model Based on Prior Feature Knowledge Embedding and Application in Medical Diagnosis

Overview

Journal Sci Rep

Specialty Science

Date 2024 Jun 9

PMID 38853158

Authors

Chen Xu

Jiangxing Wu

Fan Zhang

Jonathan Freer

Zhongqun Zhang

Yihua Cheng

Affiliations

Soon will be listed here.

Abstract

Aiming at the problem of image classification with insignificant morphological structural features, strong target correlation, and low signal-to-noise ratio, combined with prior feature knowledge embedding, a deep learning method based on ResNet and Radial Basis Probabilistic Neural Network (RBPNN) is proposed model. Taking ResNet50 as a visual modeling network, it uses feature pyramid and self-attention mechanism to extract appearance and semantic features of images at multiple scales, and associate and enhance local and global features. Taking into account the diversity of category features, channel cosine similarity attention and dynamic C-means clustering algorithms are used to select representative sample features in different category of sample subsets to implicitly express prior category feature knowledge, and use them as the kernel centers of radial basis probability neurons (RBPN) to realize the embedding of diverse prior feature knowledge. In the RBPNN pattern aggregation layer, the outputs of RBPN are selectively summed according to the category of the kernel center, that is, the subcategory features are combined into category features, and finally the image classification is implemented based on Softmax. The functional module of the proposed method is designed specifically for image characteristics, which can highlight the significance of local and structural features of the image, form a non-convex decision-making area, and reduce the requirements for the completeness of the sample set. Applying the proposed method to medical image classification, experiments were conducted based on the brain tumor MRI image classification public dataset and the actual cardiac ultrasound image dataset, and the accuracy rate reached 85.82% and 83.92% respectively. Compared with the three mainstream image classification models, the performance indicators of this method have been significantly improved.

References

Cheng J, Tian S, Yu L, Gao C, Kang X, Ma X . ResGANet: Residual group attention network for medical image classification and segmentation. Med Image Anal. 2021; 76:102313. DOI: 10.1016/j.media.2021.102313. View

Chlap P, Min H, Vandenberg N, Dowling J, Holloway L, Haworth A . A review of medical image data augmentation techniques for deep learning applications. J Med Imaging Radiat Oncol. 2021; 65(5):545-563. DOI: 10.1111/1754-9485.13261. View

Shelhamer E, Long J, Darrell T . Fully Convolutional Networks for Semantic Segmentation. IEEE Trans Pattern Anal Mach Intell. 2016; 39(4):640-651. DOI: 10.1109/TPAMI.2016.2572683. View

Cai L, Gao J, Zhao D . A review of the application of deep learning in medical image classification and segmentation. Ann Transl Med. 2020; 8(11):713. PMC: 7327346. DOI: 10.21037/atm.2020.02.44. View

Sarvamangala D, Kulkarni R . Convolutional neural networks in medical image understanding: a survey. Evol Intell. 2021; 15(1):1-22. PMC: 7778711. DOI: 10.1007/s12065-020-00540-3. View

Goyal M, Knackstedt T, Yan S, Hassanpour S . Artificial intelligence-based image classification methods for diagnosis of skin cancer: Challenges and opportunities. Comput Biol Med. 2020; 127:104065. PMC: 8290363. DOI: 10.1016/j.compbiomed.2020.104065. View

Zhu Y, Zhuang F, Wang J, Ke G, Chen J, Bian J . Deep Subdomain Adaptation Network for Image Classification. IEEE Trans Neural Netw Learn Syst. 2020; 32(4):1713-1722. DOI: 10.1109/TNNLS.2020.2988928. View

Xue Y, Xu T, Zhang H, Long L, Huang X . SegAN: Adversarial Network with Multi-scale L Loss for Medical Image Segmentation. Neuroinformatics. 2018; 16(3-4):383-392. DOI: 10.1007/s12021-018-9377-x. View

Remeseiro B, Bolon-Canedo V . A review of feature selection methods in medical applications. Comput Biol Med. 2019; 112:103375. DOI: 10.1016/j.compbiomed.2019.103375. View

10.

Gour M, Jain S . Uncertainty-aware convolutional neural network for COVID-19 X-ray images classification. Comput Biol Med. 2021; 140:105047. PMC: 8609674. DOI: 10.1016/j.compbiomed.2021.105047. View

11.

Zhang J, Xie Y, Wu Q, Xia Y . Medical image classification using synergic deep learning. Med Image Anal. 2019; 54:10-19. DOI: 10.1016/j.media.2019.02.010. View

12.

Shamshad F, Khan S, Zamir S, Khan M, Hayat M, Khan F . Transformers in medical imaging: A survey. Med Image Anal. 2023; 88:102802. DOI: 10.1016/j.media.2023.102802. View

13.

Abdar M, Samami M, Dehghani Mahmoodabad S, Doan T, Mazoure B, Hashemifesharaki R . Uncertainty quantification in skin cancer classification using three-way decision-based Bayesian deep learning. Comput Biol Med. 2021; 135:104418. DOI: 10.1016/j.compbiomed.2021.104418. View