Segmentation and Classification of Skin Lesions Using Hybrid Deep Learning Method in the Internet of Medical Things

Overview

Journal Skin Res Technol

Specialty Biomedical Engineering

Date 2023 Nov 27

PMID 38009016

Authors

Arslan Akram

Javed Rashid

Muhammad Arfan Jaffar

Muhammad Faheem

Riaz Ul Amin

Affiliations

Soon will be listed here.

Abstract

Introduction: Particularly within the Internet of Medical Things (IoMT) context, skin lesion analysis is critical for precise diagnosis. To improve the accuracy and efficiency of skin lesion analysis, CAD systems play a crucial role. To segment and classify skin lesions from dermoscopy images, this study focuses on using hybrid deep learning techniques.

Method: This research uses a hybrid deep learning model that combines two cutting-edge approaches: Mask Region-based Convolutional Neural Network (MRCNN) for semantic segmentation and ResNet50 for lesion detection. To pinpoint the precise location of a skin lesion, the MRCNN is used for border delineation. We amass a huge, annotated collection of dermoscopy images for thorough model training. The hybrid deep learning model to capture subtle representations of the images is trained from start to finish using this dataset.

Results: The experimental results using dermoscopy images show that the suggested hybrid method outperforms the current state-of-the-art methods. The model's capacity to segment lesions into distinct groups is demonstrated by a segmentation accuracy measurement of 95.49 percent. In addition, the classification of skin lesions shows great accuracy and dependability, which is a notable advancement over traditional methods. The model is put through its paces on the ISIC 2020 Challenge dataset, scoring a perfect 96.75% accuracy. Compared to current best practices in IoMT, segmentation and classification models perform exceptionally well.

Conclusion: In conclusion, this paper's hybrid deep learning strategy is highly effective in skin lesion segmentation and classification. The results show that the model has the potential to improve diagnostic accuracy in the setting of IoMT, and it outperforms the current gold standards. The excellent results obtained on the ISIC 2020 Challenge dataset further confirm the viability and superiority of the suggested methodology for skin lesion analysis.

Citing Articles

Enhanced Multi-Class Breast Cancer Classification from Whole-Slide Histopathology Images Using a Proposed Deep Learning Model.

Rafiq A, Jaffar A, Latif G, Masood S, Abdelhamid S Diagnostics (Basel). 2025; 15(5).

PMID: 40075829 PMC: 11899611. DOI: 10.3390/diagnostics15050582.

Skin Cancer Image Classification Using Artificial Intelligence Strategies: A Systematic Review.

Vardasca R, Mendes J, Magalhaes C J Imaging. 2024; 10(11).

PMID: 39590729 PMC: 11595075. DOI: 10.3390/jimaging10110265.

Classification of Alzheimer disease using DenseNet-201 based on deep transfer learning technique.

Zia-Ur-Rehman , Awang M, Rashid J, Ali G, Hamid M, Mahmoud S PLoS One. 2024; 19(9):e0304995.

PMID: 39240975 PMC: 11379170. DOI: 10.1371/journal.pone.0304995.

Intelligent skin lesion segmentation using deformable attention Transformer U-Net with bidirectional attention mechanism in skin cancer images.

Cai L, Hou K, Zhou S Skin Res Technol. 2024; 30(8):e13783.

PMID: 39113617 PMC: 11306920. DOI: 10.1111/srt.13783.

Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks.

Ahmad I, Rashid J, Faheem M, Akram A, Khan N, Amin R Healthc Technol Lett. 2024; 11(4):227-239.

PMID: 39100502 PMC: 11294932. DOI: 10.1049/htl2.12073.

References

Hosny K, Kassem M . Refined Residual Deep Convolutional Network for Skin Lesion Classification. J Digit Imaging. 2022; 35(2):258-280. PMC: 8921379. DOI: 10.1007/s10278-021-00552-0. View

Khatibi T, Rezaei N, Ataei Fashtami L, Totonchi M . Proposing a novel unsupervised stack ensemble of deep and conventional image segmentation (SEDCIS) method for localizing vitiligo lesions in skin images. Skin Res Technol. 2020; 27(2):126-137. DOI: 10.1111/srt.12920. View

Levin A, Klimov D, Nechunaev A, Prokhorenko L, Mishchenkov D, Nosova A . Assessment of experimental OpenCV tracking algorithms for ultrasound videos. Sci Rep. 2023; 13(1):6765. PMC: 10130022. DOI: 10.1038/s41598-023-30930-3. View

Maurya A, Stanley R, Lama N, Jagannathan S, Saeed D, Swinfard S . A deep learning approach to detect blood vessels in basal cell carcinoma. Skin Res Technol. 2022; 28(4):571-576. PMC: 9907638. DOI: 10.1111/srt.13150. View

Ullah K, Rehman F, Anwar M, Faheem M, Riaz N . Machine learning-based prediction of osteoporosis in postmenopausal women with clinical examined features: A quantitative clinical study. Health Sci Rep. 2023; 6(10):e1656. PMC: 10600334. DOI: 10.1002/hsr2.1656. View

Liu L, Tsui Y, Mandal M . Skin Lesion Segmentation Using Deep Learning with Auxiliary Task. J Imaging. 2021; 7(4). PMC: 8321325. DOI: 10.3390/jimaging7040067. View

Akram A, Rashid J, Jaffar M, Faheem M, Amin R . Segmentation and classification of skin lesions using hybrid deep learning method in the Internet of Medical Things. Skin Res Technol. 2023; 29(11):e13524. PMC: 10646956. DOI: 10.1111/srt.13524. View

Pan Y, Liu J, Cai Y, Yang X, Zhang Z, Long H . Fundus image classification using Inception V3 and ResNet-50 for the early diagnostics of fundus diseases. Front Physiol. 2023; 14:1126780. PMC: 9975334. DOI: 10.3389/fphys.2023.1126780. View

Faheem M, Butt R, Raza B, Alquhayz H, Abbas M, Ngadi M . A Multiobjective, Lion Mating Optimization Inspired Routing Protocol for Wireless Body Area Sensor Network Based Healthcare Applications. Sensors (Basel). 2019; 19(23). PMC: 6928723. DOI: 10.3390/s19235072. View

10.

Zhang L, Yang G, Ye X . Automatic skin lesion segmentation by coupling deep fully convolutional networks and shallow network with textons. J Med Imaging (Bellingham). 2019; 6(2):024001. PMC: 6462764. DOI: 10.1117/1.JMI.6.2.024001. View

11.

Tschandl P, Rosendahl C, Kittler H . The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci Data. 2018; 5:180161. PMC: 6091241. DOI: 10.1038/sdata.2018.161. View

12.

Binol H, Plotner A, Sopkovich J, Kaffenberger B, Niazi M, Gurcan M . Ros-NET: A deep convolutional neural network for automatic identification of rosacea lesions. Skin Res Technol. 2019; 26(3):413-421. DOI: 10.1111/srt.12817. View

13.

Celik G . Detection of Covid-19 and other pneumonia cases from CT and X-ray chest images using deep learning based on feature reuse residual block and depthwise dilated convolutions neural network. Appl Soft Comput. 2022; 133:109906. PMC: 9726212. DOI: 10.1016/j.asoc.2022.109906. View

14.

Mimura K, Nakamura K . Datasets for training and validating a deep learning-based system to detect microfossil fish teeth from slide images. Data Brief. 2023; 47:108940. PMC: 9945703. DOI: 10.1016/j.dib.2023.108940. View

15.

Kassem M, Hosny K, Damasevicius R, Eltoukhy M . Machine Learning and Deep Learning Methods for Skin Lesion Classification and Diagnosis: A Systematic Review. Diagnostics (Basel). 2021; 11(8). PMC: 8391467. DOI: 10.3390/diagnostics11081390. View

16.

Liu Q, Wang J, Zuo M, Cao W, Zheng J, Zhao H . NCRNet: Neighborhood Context Refinement Network for skin lesion segmentation. Comput Biol Med. 2022; 146:105545. DOI: 10.1016/j.compbiomed.2022.105545. View

17.

Ali Z, Naz S, Zaffar H, Choi J, Kim Y . An IoMT-Based Melanoma Lesion Segmentation Using Conditional Generative Adversarial Networks. Sensors (Basel). 2023; 23(7). PMC: 10098854. DOI: 10.3390/s23073548. View

18.

Khan M, Sharif M, Akram T, Damasevicius R, Maskeliunas R . Skin Lesion Segmentation and Multiclass Classification Using Deep Learning Features and Improved Moth Flame Optimization. Diagnostics (Basel). 2021; 11(5). PMC: 8145295. DOI: 10.3390/diagnostics11050811. View

19.

Ferlay J, Colombet M, Soerjomataram I, Parkin D, Pineros M, Znaor A . Cancer statistics for the year 2020: An overview. Int J Cancer. 2021; . DOI: 10.1002/ijc.33588. View

20.

Alarood A, Faheem M, Al-Khasawneh M, Alzahrani A, Alshdadi A . Secure medical image transmission using deep neural network in e-health applications. Healthc Technol Lett. 2023; 10(4):87-98. PMC: 10388229. DOI: 10.1049/htl2.12049. View