Melanoma segmentation: A framework of improved DenseNet77 and UNET convolutional neural network
Marriam Nawaz
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Department of Software Engineering, University of Enginering and Technology, Taxila, Pakistan
Search for more papers by this authorTahira Nazir
Department of Computing, Riphah International University, Islamabad, Pakistan
Search for more papers by this authorMomina Masood
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Search for more papers by this authorFarooq Ali
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Search for more papers by this authorCorresponding Author
Muhammad Attique Khan
Department of Computer Science, HITEC University Taxila, Taxila, Pakistan
Correspondence
Muhammad Attique Khan, Department of Computer Science, HITEC University Taxila, Taxila, 47080, Pakistan.
Email: [email protected]
Search for more papers by this authorUsman Tariq
College of Computer Engineering and Science, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
Search for more papers by this authorNaveera Sahar
Department of Computer Science, University of Wah, Wah Cantt, Pakistan
Search for more papers by this authorRobertas Damaševičius
Faculty of Applied Mathematics, Silesian University of Technology, Gliwice, Poland
Search for more papers by this authorMarriam Nawaz
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Department of Software Engineering, University of Enginering and Technology, Taxila, Pakistan
Search for more papers by this authorTahira Nazir
Department of Computing, Riphah International University, Islamabad, Pakistan
Search for more papers by this authorMomina Masood
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Search for more papers by this authorFarooq Ali
Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
Search for more papers by this authorCorresponding Author
Muhammad Attique Khan
Department of Computer Science, HITEC University Taxila, Taxila, Pakistan
Correspondence
Muhammad Attique Khan, Department of Computer Science, HITEC University Taxila, Taxila, 47080, Pakistan.
Email: [email protected]
Search for more papers by this authorUsman Tariq
College of Computer Engineering and Science, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
Search for more papers by this authorNaveera Sahar
Department of Computer Science, University of Wah, Wah Cantt, Pakistan
Search for more papers by this authorRobertas Damaševičius
Faculty of Applied Mathematics, Silesian University of Technology, Gliwice, Poland
Search for more papers by this authorAbstract
Melanoma is the most fatal type of skin cancer which can cause the death of victims at the advanced stage. Extensive work has been presented by the researcher on computer vision for skin lesion localization. However, correct and effective melanoma segmentation is still a tough job because of the extensive variations found in the shape, color, and sizes of skin moles. Moreover, the presence of light and brightness variations further complicates the segmentation task. We have presented improved deep learning (DL)-based approach, namely, the DenseNet77-based UNET model. More clearly, we have introduced the DenseNet77 network at the encoder unit of the UNET approach to computing the more representative set of image features. The calculated keypoints are later segmented by the decoder of the UNET model. We have used two standard datasets, namely, the ISIC-2017 and ISIC-2018 to evaluate the performance of the proposed approach and acquired the segmentation accuracies of 99.21% and 99.51% for the ISIC-2017 and ISIC-2018 datasets, respectively. We have confirmed through both the quantitative and qualitative results that the proposed improved UNET approach is robust to skin lesions segmentation and can accurately recognize the moles of varying colors and sizes.
CONFLICT OF INTEREST
The authors declare no conflicts of interest.
Open Research
DATA AVAILABILITY STATEMENT
The data that support the findings of this study are openly available in ISIC Dataset at https://challenge.isic-archive.com/landing/2017/?msclkid=a218ef74b43d11ec8a1769d50632f078.
REFERENCES
- 1Siegel RL, Miller KD, Fedewa SA, et al. Colorectal cancer statistics, 2017. CA Cancer J Clin. 2017; 67(3): 177-193.
- 2Rogers HW, Weinstock MA, Feldman SR, Coldiron BM. Incidence estimate of nonmelanoma skin cancer (keratinocyte carcinomas) in the US population, 2012. JAMA Dermatol. 2015; 151(10): 1081-1086.
- 3Ballerini L, Fisher RB, Aldridge B, Rees J. A color and texture based hierarchical K-NN approach to the classification of non-melanoma skin lesions. Color medical image analysis. Springer; 2013: 63-86.
10.1007/978-94-007-5389-1_4 Google Scholar
- 4Cheng Y, Swamisai R, Umbaugh SE, et al. Skin lesion classification using relative color features. Skin Res Technol. 2008; 14(1): 53-64.
- 5MASOOD M, NAZIR T, NAWAZ M, JAVED A, IQBAL M, MEHMOOD A. Brain tumor localization and segmentation using mask RCNN. Front Comput Sci. 2020; 15:156338.
- 6Nazir T, Nawaz M, Rashid J, et al. Detection of diabetic eye disease from retinal images using a deep learning based CenterNet model. Sensors. 2021; 21(16): 5283.
- 7Pellini B, Chaudhuri AA. Circulating tumor DNA minimal residual disease detection of non-small-cell lung cancer treated with curative intent. J Clin Oncol. 2022; 40(6): 567-575.
- 8Reis HC, Turk V, Khoshelham K, Kaya S. InSiNet: a deep convolutional approach to skin cancer detection and segmentation. Med Biol Eng Comput. 2022; 60: 1-20.
- 9Abdar M, Pourpanah F, Hussain S, et al. A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf Fusion. 2021; 76: 243-297.
- 10Nilsen GK, Munthe-Kaas AZ, Skaug HJ, Brun M. Epistemic uncertainty quantification in deep learning classification by the Delta method. Neural Netw. 2022; 145: 164-176.
- 11Abdar M, Samami M, Dehghani Mahmoodabad S, et al. Uncertainty quantification in skin cancer classification using three-way decision-based Bayesian deep learning. Comput Biol Med. 2021; 135:104418.
- 12Qin Y, Liu Z, Liu C, Li Y, Zeng X, Ye C. Super-resolved q-space deep learning with uncertainty quantification. Med Image Anal. 2021; 67:101885.
- 13Rahaman R. Uncertainty quantification and deep ensembles. Adv Neural Inf Process Syst. 2021; 34.
- 14Abdar M, Fahami MA, Chakrabarti S, et al. BARF: a new direct and cross-based binary residual feature fusion with uncertainty-aware module for medical image classification. Inform Sci. 2021; 577: 353-378.
- 15Senousy Z, Abdelsamea MM, Gaber MM, et al. Mcua: multi-level context and uncertainty aware dynamic deep ensemble for breast cancer histology image classification. IEEE Trans Biomed Eng. 2021; 69: 818-829.
- 16Abdar M, Salari S, Qahremani S, et al. UncertaintyFuseNet: robust uncertainty-aware hierarchical feature fusion model with ensemble Monte Carlo dropout for COVID-19 detection. Image Video Process. 2022;arXiv Preprint arXiv:2105.08590.
- 17Barata C, Celebi ME, Marques JS. Development of a clinically oriented system for melanoma diagnosis. Pattern Recognit. 2017; 69: 270-285.
- 18Badrinarayanan V, Handa A, Cipolla R. Segnet: a deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling. Comput Vision Pattern Recognit. 2015;arXiv Preprint arXiv:1505.07293.
- 19Bi L, Kim J, Ahn E, Feng D, Fulham M. Semi-automatic skin lesion segmentation via fully convolutional networks. Paper presented at: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017); 2017: 561-564. IEEE.
- 20Alquran H, Qasmieh IA, Alqudah AM, et al. The melanoma skin cancer detection and classification using support vector machine. Paper presented at 2017 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT); 2017: 1-5. IEEE.
- 21Khan MA, Khan MA, Ahmed F, et al. Gastrointestinal diseases segmentation and classification based on duo-deep architectures. Pattern Recognit Lett. 2020; 131: 193-204.
- 22Codella NC, Nguyen QB, Pankanti S, et al. Deep learning ensembles for melanoma recognition in dermoscopy images. IBM J Res Dev. 2017; 61(4/5): 5:1-5.
- 23Daghrir J, Tlig L, Bouchouicha M, Sayadi M. Melanoma skin cancer detection using deep learning and classical machine learning techniques: a hybrid approach. Paper presented at: 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP); 2020: 1-5. IEEE.
- 24Bama S, Velumani R, Prakash N, Hemalakshmi G, Mohanarathinam A. Automatic segmentation of melanoma using superpixel region growing technique. Mater Today Proc. 2021; 45: 1726-1732.
10.1016/j.matpr.2020.08.618 Google Scholar
- 25Hu K, Niu X, Liu S, et al. Classification of melanoma based on feature similarity measurement for codebook learning in the bag-of-features model. Biomed Signal Process Control. 2019; 51: 200-209.
- 26Ameri A. A deep learning approach to skin cancer detection in Dermoscopy images. J Biomed Phys Eng. 2020; 10(6): 801.
- 27Jojoa Acosta MF, Caballero Tovar LY, Garcia-Zapirain MB, Percybrooks WS. Melanoma diagnosis using deep learning techniques on dermatoscopic images. BMC Med Imaging. 2021; 21(1): 1-11.
- 28Zhang L, Yang G, Ye X. Automatic skin lesion segmentation by coupling deep fully convolutional networks and shallow network with textons. J Med Imaging. 2019; 6(2):024001.
- 29Shan P, Wang Y, Fu C, Song W, Chen J. Automatic skin lesion segmentation based on FC-DPN. Comput Biol Med. 2020; 123:103762.
- 30Bi L, Kim J, Ahn E, Kumar A, Feng D, Fulham M. Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recognit. 2019; 85: 78-89.
- 31Adegun AA, Viriri S. Deep learning-based system for automatic melanoma detection. IEEE Access. 2019; 8: 7160-7172.
- 32Nawaz M, Mehmood Z, Nazir T, et al. Skin cancer detection from dermoscopic images using deep learning and fuzzy k-means clustering. Microsc Res Tech. 2022; 85(1): 339-351.
- 33Nawaz M, Masood M, Javed A, et al. Melanoma localization and classification through faster region-based convolutional neural network and SVM. Multimedia Tools Appl. 2021; 80: 1-22.
- 34Banerjee S, Singh SK, Chakraborty A, Das A, Bag R. Melanoma diagnosis using deep learning and fuzzy logic. Diagnostics. 2020; 10(8): 577.
- 35Iqbal I, Younus M, Walayat K, Kakar MU, Ma J. Automated multi-class classification of skin lesions through deep convolutional neural network with dermoscopic images. Comput Med Imaging Graph. 2021; 88:101843.
- 36Khan MA, Akram T, Zhang Y-D, Sharif M. Attributes based skin lesion detection and recognition: a mask RCNN and transfer learning-based deep learning framework. Pattern Recognit Lett. 2021; 143: 58-66.
- 37Mohakud R, Dash R. Skin cancer image segmentation utilizing a novel EN-GWO based hyper-parameter optimized FCEDN. J King Saud Univ Comput Inf Sci. 2022.
- 38Abdar M, Samami M, Mahmoodabad SD, et al. Uncertainty quantification in skin cancer classification using three-way decision-based Bayesian deep learning. Comput Biol Med. 2021; 135:104418.
- 39Pacheco AG, Krohling RA. An attention-based mechanism to combine images and metadata in deep learning models applied to skin cancer classification. IEEE J Biomed Health Inform. 2021; 25(9): 3554-3563.
- 40Wang Y, Wang S. Skin lesion segmentation with attention-based SC-Conv U-net and feature map distortion. Signal Image Video Process. 2022; 1-9.
- 41Zhao C, Shuai R, Ma L, Liu W, Wu M. Segmentation of skin lesions image based on U-net++. Multimedia Tools Appl. 2022; 81(6): 8691-8717.
- 42Durgarao N, Sudhavani G. Diagnosing skin cancer via C-means segmentation with enhanced fuzzy optimization. IET Image Process. 2021; 15(10): 2266-2280.
- 43Haggenmüller S, Maron RC, Hekler A, et al. Skin cancer classification via convolutional neural networks: systematic review of studies involving human experts. Eur J Cancer. 2021; 156: 202-216.
- 44Ali MS, Miah MS, Haque J, Rahman MM, Islam MK. An enhanced technique of skin cancer classification using deep convolutional neural network with transfer learning models. Mach Learn Appl. 2021; 5:100036.
10.1016/j.mlwa.2021.100036 Google Scholar
- 45Polesel A, Ramponi G, Mathews VJ. Image enhancement via adaptive unsharp masking. IEEE Trans Image Process. 2000; 9(3): 505-510.
- 46Muthukrishnan R, Radha M. Edge detection techniques for image segmentation. Int J Comput Sci Inf Technol. 2011; 3(6): 259-267.
- 47Al-Amri SS, Kalyankar N, Khamitkar S. Image segmentation by using edge detection. Int J Comput Sci Eng. 2010; 2(3): 804-807.
- 48Raja SK, KHADIR ASABDUL, Ahamed SR. Moving toward region-based image segmentation techniques: a study. J Theor Appl Inf Technol. 2009; 5(1).
- 49Kumar MJ, Kumar DGR, Reddy RVK. Review on image segmentation techniques. Int J Sci Res Eng Technol. 2014; 2278-2882.
- 50Zaitoun NM, Aqel MJ. Survey on image segmentation techniques. Procedia Comput Sci. 2015; 65: 797-806.
10.1016/j.procs.2015.09.027 Google Scholar
- 51Albahli S, Nawaz M, Javed A, Irtaza A. An improved faster-RCNN model for handwritten character recognition. Arab J Sci Eng. 2021; 46: 1-15.
- 52Albahli S, Nazir T, Irtaza A, Javed A. Recognition and detection of diabetic retinopathy using Densenet-65 based faster-RCNN. Comput Mater Contin. 2021; 67: 1333-1351.
- 53Curiel-Lewandrowski C, Novoa RA, Berry E, et al. Artificial intelligence approach in melanoma. Melanoma. 2019; 1-31.
- 54Yuan Y. Automatic skin lesion segmentation with fully convolutional-deconvolutional networks. Comput Vision Pattern Recognit. 2017; arXiv Preprint arXiv:.05165.
- 55Berseth M. ISIC 2017-skin lesion analysis towards melanoma detection. Comput Vision Pattern Recognit. 2017; arXiv Preprint arXiv:.00523.
- 56Bi L, Kim J, Ahn E, Feng D. Automatic skin lesion analysis using large-scale dermoscopy images and deep residual networks. Comput Vision Pattern Recognit. 2017; arXiv Preprint arXiv:.04197.
- 57Menegola A, Tavares J, Fornaciali M, Li LT, Avila S, Valle E. RECOD titans at ISIC challenge 2017. Comput Vision Pattern Recognit. 2017; arXiv Preprint arXiv:.04819.
- 58Kawahara J, Hamarneh G. Fully convolutional neural networks to detect clinical dermoscopic features. IEEE J Biomed Health Inf. 2018; 23(2): 578-585.
- 59Chowdary GJ, Yathisha G. Exploring dual-attention mechanism with multi-scale feature extraction scheme for skin lesion segmentation. Image Video Process. 2021; arXiv Preprint arXiv:.08708.
- 60Pravitasari AA, Iriawan N, Almuhayar M, et al. UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation. Telkomnika. 2020; 18(3): 1310-1318.
10.12928/telkomnika.v18i3.14753 Google Scholar
- 61Chu Z, Tian T, Feng R, Wang L. Sea-land segmentation with Res-UNet and fully connected CRF. Paper presented at: IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium; 2019: 3840-3843: IEEE.
- 62Wibowo A, Purnama SR, Wirawan PW, Rasyidi H. Lightweight encoder-decoder model for automatic skin lesion segmentation. Inf Med Unlocked. 2021;100640.
10.1016/j.imu.2021.100640 Google Scholar
- 63Li X, Chen H, Qi X, Dou Q, Fu C-W, Heng P-A. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018; 37(12): 2663-2674.
- 64Nguyen DK, Tran TT, Nguyen CP, Pham VT. Skin lesion segmentation based on integrating EfficientNet and residual block into U-net neural network. Paper presented at: 2020 5th International Conference on Green Technology and Sustainable Development (GTSD); 2020: 366-371. IEEE.
- 65Gu R, Wang L, Zhang L. DE-net: a deep edge network with boundary information for automatic skin lesion segmentation. Neurocomputing. 2022; 468: 71-84.
- 66Wu H, Chen S, Chen G, Wang W, Lei B, Wen Z. FAT-net: feature adaptive transformers for automated skin lesion segmentation. Med Image Anal. 2022; 76:102327.
- 67Banerjee S, Singh SK, Chakraborty A, Basu S, Das A, Bag R. Diagnosis of melanoma lesion using neutrosophic and deep learning. Traitement du Signal. 2021; 38(5).
- 68Khouloud S, Ahlem M, Fadel T, Amel S. W-net and inception residual network for skin lesion segmentation and classification. Appl Intell. 2021; 52: 1-19.
- 69Hasan MK, Elahi MTE, Alam MA, Jawad MT, Martí R. DermoExpert: skin lesion classification using a hybrid convolutional neural network through segmentation, transfer learning, and augmentation. Inf Med Unlocked. 2022;100819.
10.1016/j.imu.2021.100819 Google Scholar
- 70Dai D, Dong C, Xu S, et al. Ms RED: a novel multi-scale residual encoding and decoding network for skin lesion segmentation. Med Image Anal. 2022; 75:102293.
- 71Kaur R, GholamHosseini H, Sinha R. Skin lesion segmentation using an improved framework of encoder-decoder based convolutional neural network. Int J Imaging Syst Technol. 2022.
- 72Ramadan R, Aly S. CU-net: a new improved multi-input color U-net model for skin lesion semantic segmentation. IEEE Access. 2022; 10: 15539-15564.
- 73Araújo RL, de Araújo FH, Silva RR. Automatic segmentation of melanoma skin cancer using transfer learning and fine-tuning. Multimedia Syst. 2021; 1-12.
- 74Dos Santos ES et al. Semi-automatic segmentation of skin lesions based on superpixels and hybrid texture information. Med Image Anal. 2022; 77:102363.
- 75Badshah N, Ahmad A. ResBCU-net: deep learning approach for segmentation of skin images. Biomed Signal Process Control. 2022; 71:103137.
