A deep learning approach for multi-stage classification of brain tumor through magnetic resonance images
Corresponding Author
Sahar Gull
Department of Computing, Riphah International University, Faisalabad, Pakistan
Correspondence
Sahar Gull, Department of Computing, Riphah International University, Faisalabad, Pakistan.
Email: [email protected]
Search for more papers by this authorShahzad Akbar
Department of Computing, Riphah International University, Faisalabad, Pakistan
Search for more papers by this authorSyed Muhammad Naqi
Department of Computer Sciences, Quaid-i-Azam University, Islamabad, Pakistan
Search for more papers by this authorCorresponding Author
Sahar Gull
Department of Computing, Riphah International University, Faisalabad, Pakistan
Correspondence
Sahar Gull, Department of Computing, Riphah International University, Faisalabad, Pakistan.
Email: [email protected]
Search for more papers by this authorShahzad Akbar
Department of Computing, Riphah International University, Faisalabad, Pakistan
Search for more papers by this authorSyed Muhammad Naqi
Department of Computer Sciences, Quaid-i-Azam University, Islamabad, Pakistan
Search for more papers by this authorAbstract
Brain tumor is the 10th major cause of death among humans. The detection of brain tumor is a significant process in the medical field. Therefore, the objective of this research work is to propose a fully automated deep learning framework for multistage classification. Besides, this study focuses on to develop an efficient and reliable system using a convolutional neural network (CNN). In this study, the fast bounding box technique is used for segmentation. Moreover, the CNN layers-based three models are developed for multistage classification through magnetic resonance images on three publicly available datasets. The first dataset is obtained from Kaggle Repository (Dataset-1), the second dataset is known as Figshare (Dataset-2), and the third dataset is called REMBRANDT (Dataset-3) to classify the MR images into different grades. Different augmentation techniques are applied to increase the data size of MR images. In pre-processing, the proposed models achieved higher Peak Signal-to-Noise ratio to remove noise. The first proposed deep CNN framework mentioned as Classification-1 has obtained 99.40% accuracy, which classified MR images into two classes, that is (i) normal and (ii) abnormal, while the second proposed CNN framework mentioned as Classification-2 has obtained 97.78% accuracy, which classified brain tumor into three types, which are meningioma, glioma, and pituitary. Similarly, the third developed CNN framework mentioned as Classification-3 has obtained 98.91% accuracy that further classified MR images of tumors into four different classes as: Grade I, Grade II, Grade III, and Grade IV. The results demonstrate that the proposed models achieved better performance on three large and diverse datasets. The comparison of obtained outcomes shows that the developed models are more efficient and effective than state-of-the-art methods.
CONFLICT OF INTEREST STATEMENT
The authors declare no conflicts of interest.
Open Research
DATA AVAILABILITY STATEMENT
The data that support the findings of this study are openly available in the repositories ([https://www.kaggle.com/sartajbhuvaji/brain-tumor-classification-mri], [https://figshare.com/articles/dataset/brain_tumor_dataset/1512427] and [https://wiki.cancerimagingarchive.net/display/Public/REMBRANDT]).
REFERENCES
- 1Mohan GS, Monica M. MRI based medical image analysis: survey on brain tumor grade classification. Biomed Signal Process Control. 2018; 39: 139-161.
- 2Kumar S, Dabas C, Godara S. Classification of brain MRI tumor images: a hybrid approach. Procedia Comput Sci. 2017; 122: 510-517.
10.1016/j.procs.2017.11.400 Google Scholar
- 3Young RJ, Knopp EA. Brain MRI: tumor evaluation. J Magn Reson Imaging. 2006; 24(4): 709-724.
- 4Hsieh KL-C, Tsai R-J, Teng Y-C, Lo C-M. Effect of a computer-aided diagnosis system on radiologists' performance in grading gliomas with MRI. PloS One. 2017; 12(2):e0171342.
- 5Yanase J, Triantaphyllou E. A systematic survey of computer-aided diagnosis in medicine: past and present developments. Expert Syst Appl. 2019; 138:112821.
- 6El-Dahshan E-SA, Mohsen HM, Revett K, Salem A-BM. Computer-aided diagnosis of human brain tumor through MRI: a survey and a new algorithm. Expert Syst Appl. 2014; 41(11): 5526-5545.
- 7Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019; 69(1): 7-34.
- 8Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2021. CA Cancer J Clin. 2021; 71(1): 7-33.
- 9Sharma N, Jain MK, Nirvikar, Agerwal AK. Brain tumor classification using CNN. Adv Appl Math Sci. 2021; 20(3): 397-407.
- 10Rao CS, Karunakara K. A comprehensive review on brain tumor segmentation and classification of MRI images. Multimed Tools Appl. 2021; 80: 17611-17643.
- 11Logeswari T, Karnan M. An improved implementation of brain tumor detection using segmentation based on soft computing. J Cancer Res Exp Oncol. 2009; 2(1): 6-14.
- 12Singh A, Shivesh B, Karanam S, Akash C, Thaluru R. Malignant brain tumor detection. Int J Comput Theory Eng. 2012; 4(6):1002.
10.7763/IJCTE.2012.V4.626 Google Scholar
- 13DeAngelis LM. Brain tumor. N Engl J Med. 2001; 344(2): 114-123.
- 14 Association of Neurological Surgeons (AANS). Brain Tumor: Types of Brain Tumor; 2021. https://www.aans.org/en/Patients/Neurosurgical-Conditions-and-Treatments/Brain-Tumors.
- 15Louis DN, Perry A, Reifenberger G, et al. The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol. 2016; 131(6): 803-820.
- 16Goodenberger ML, Jenkins RB. Genetics of adult glioma. Cancer Genet. 2012; 205(12): 613-621.
- 17Naceur MB, Akil M, Saouli R, Kachouri R. Fully automatic brain tumor segmentation with deep learning-based selective attention using overlapping patches and multi-class weighted cross-entropy. Med Image Anal. 2020; 63:101692.
- 18DeAngelis LM, Gutin PH, Leibel SA, Posner JB. Intracranial Tumors: Diagnosis and Treatment. CRC Press; 2001.
10.3109/9780203214213 Google Scholar
- 19Van Meir EG, Hadjipanayis CG, Norden AD, Shu HK, Wen PY, Olson JJ. Exciting new advances in neuro-oncology: the avenue to a cure for malignant glioma. CA Cancer J Clin. 2010; 60(3): 166-193.
- 20Smith MW. Types of Brain Cancer: Grades of Brain Tumor. 2020 https://www.webmd.com/cancer/brain-cancer/brain-tumor-types
- 21Philip-Ephraim E, Eyong K, Williams U, Ephraim R. The role of radiotherapy and chemotherapy in the treatment of primary adult high-grade gliomas: assessment of patients for these treatment approaches and the common immediate side effects. ISRN Oncol. 2012; 2012:902178.
- 22 SARTAJ. Brain Tumor Classification (MRI): Classify MRI Images into Four Classes; 2020. https://www.kaggle.com/sartajbhuvaji/brain-tumor-classification-mri
- 23Bauer S, Wiest R, Nolte L-P, Reyes M. A survey of MRI-based medical image analysis for brain tumor studies. Phys Med Biol. 2013; 58(13): R97-R129.
- 24Işın A, Direkoğlu C, Şah M. Review of MRI-based brain tumor image segmentation using deep learning methods. Procedia Comput Sci. 2016; 102: 317-324.
10.1016/j.procs.2016.09.407 Google Scholar
- 25Sanjeev K, Dabas C, Godara S. Classification of brain MRI tumor images: a hybrid approach. Inf Technol Quantit Manag (ITQM2017). 2017; 122: 510-517.
- 26Laukamp KR, Frank T, Shakirin G, et al. Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI. Eur Radiol. 2019; 29(1): 124-132.
- 27Roy S, Bandyopadhyay SK. Detection and quantification of brain tumor from MRI of brain and its symmetric analysis. Int J Inf Commun Technol Res. 2012; 2(6): 477-483.
- 28Gull S, Akbar S. Artificial intelligence in brain tumor detection through MRI scans: advancements and challenges. Artificial Intelligence and Internet of Things. Taylor & Francis; 2021: 241-276.
10.1201/9781003097204-10 Google Scholar
- 29Shoukat A, Akbar S. Artificial intelligence techniques for glaucoma detection through retinal images: state of the art. Artificial Intelligence and Internet of Things. 2021; 209-240.
10.1201/9781003097204-9 Google Scholar
- 30Hassan SA, Gull S, Akbar S, Hanif I, Iqbal S, Aziz MW. Artificial intelligence in coronavirus detection: recent findings and future perspectives. Intelligent Computing Applications for COVID-19. Taylor & Francis; 2021: 23-48.
10.1201/9781003141105-2 Google Scholar
- 31Akbar S, Akram MU, Sharif M, Tariq A, Yasin U. Arteriovenous ratio and papilledema based hybrid decision support system for detection and grading of hypertensive retinopathy. Comput Methods Programs Biomed. 2018; 154: 123-141.
- 32Akbar S, Akram MU, Sharif M, Tariq A, Khan SA. Decision support system for detection of hypertensive retinopathy using arteriovenous ratio. Artif Intell Med. 2018; 90: 15-24.
- 33Gull S, Akbar S, Khan HU. Automated detection of brain tumor through magnetic resonance images using convolutional neural network. Biomed Res Int. 2021; 2021: 1-14.
- 34Gull S, Akbar S, Safdar K. An interactive deep learning approach for brain tumor detection through 3D-magnetic resonance images. 2021 International Conference on Frontiers of Information Technology (FIT). IEEE 2021: 114-119.
- 35Gull S, Akbar S, Shoukat IA. A deep transfer learning approach for automated detection of brain tumor through magnetic resonance imaging. 2021 International Conference on Innovative Computing (ICIC). IEEE 2021: 1-6.
- 36Gull S, Akbar S, Hassan SA, Rehman A, Sadad T. Automated brain tumor segmentation and classification through MRI images. International Conference on Emerging Technology Trends in Internet of Things and Computing. Springer; 2022:182-194.
- 37Akbar S, Akram MU, Sharif M, Tariq A. Decision support system for detection of papilledema through fundus retinal images. J Med Syst. 2017; 41: 1-16.
- 38Saba T, Akbar S, Kolivand H, Ali Bahaj S. Automatic detection of papilledema through fundus retinal images using deep learning. Microsc Res Tech. 2021; 84: 3066-3077.
- 39Shoukat A, Akbar S, Hassan SAE, Rehman A, Ayesha N. An automated deep learning approach to diagnose glaucoma using retinal fundus images. 2021 International Conference on Frontiers of Information Technology (FIT). IEEE; 2021: 120-125.
- 40Shoukat A, Akbar S, Safdar K. A deep learning-based automatic method for early detection of the glaucoma using fundus images. 2021 International Conference on Innovative Computing (ICIC). IEEE; 2021: 1-6.
- 41Akbar S, Hassan SA, Shoukat A, Alyami J, Bahaj SA. Detection of microscopic glaucoma through fundus images using deep transfer learning approach. Microsc Res Tech. 2022; 85: 2259-2276.
- 42Safdar K, Akbar S, Gull S. An automated deep learning based ensemble approach for malignant melanoma detection using Dermoscopy images. 2021 International Conference on Frontiers of Information Technology (FIT). IEEE; 2021: 206-211.
- 43Safdar K, Akbar S, Shoukat A. A majority voting based ensemble approach of deep learning classifiers for automated melanoma detection," in 2021 International Conference on Innovative Computing (ICIC). IEEE; 2021: 1-6.
- 44Ahmad MF, Akbar S, Hassan SAE, Rehman A, Ayesha N. Deep learning approach to diagnose Alzheimer's disease through magnetic resonance images. 2021 International Conference on Innovative Computing (ICIC). IEEE; 2021: 1-6.
- 45Goenka N, Tiwari S. Volumetric convolutional neural network for Alzheimer detection. 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI). IEEE; 2021:1500-1505.
- 46Goenka N, Tiwari S. AlzVNet: a volumetric convolutional neural network for multiclass classification of Alzheimer's disease through multiple neuroimaging computational approaches. Biomed Signal Process Control. 2022; 74:103500.
- 47Goenka N, Tiwari S. Deep learning for Alzheimer prediction using brain biomarkers. Artif Intell Rev. 2021; 54(7): 4827-4871.
- 48Hassan SAE, Akbar S, Gull S, Rehman A, Alaska H. Deep learning-based automatic detection of central serous retinopathy using optical coherence tomographic images. 2021 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA). 2021:206-211.
- 49Hassan SA, Akbar S, Rehman A, Saba T, Kolivand H, Bahaj SA. Recent developments in detection of central serous retinopathy through imaging and artificial intelligence techniques—a review. IEEE Access. 2021; 9:168731-168748.
- 50Ain QU, Akbar S, Hassan SA, Naaqvi Z. Diagnosis of leukemia disease through deep learning using microscopic images. 2022 2nd International Conference on Digital Futures and Transformative Technologies (ICoDT2). 2022:1-6.
- 51Naaqvi Z, Akbar S, Hassan SA, Ain QU. Detection of liver cancer through computed tomography images using deep convolutional neural networks. 2022 2nd International Conference on Digital Futures and Transformative Technologies (ICoDT2). 2022:1-6.
- 52Wang S-H, Phillips P, Sui Y, Liu B, Yang M, Cheng H. Classification of Alzheimer's disease based on an eight-layer convolutional neural network with the leaky rectified linear unit and max pooling. J Med Syst. 2018; 42(5): 1-11.
- 53Naseer A, Kashif Z. Comparative analysis of raw images and meta feature-based Urdu OCR using CNN and LSTM. Int J Adv Comput Sci Appl. 2018; 9(1): 419-424.
- 54Naseer A, Kashif Z. Meta features-based scale-invariant OCR decision making using LSTM-RNN. Comput Math Organ Theory. 2019; 25(2): 165-183.
- 55Sultan HH, Salem NM, Al-Atabany W. Multi-classification of brain tumor images using deep neural network. IEEE Access. 2019; 7: 69215-69225.
- 56Amin J, Sharif M, Yasmin M, Fernandes SL. A distinctive approach in brain tumor detection and classification using MRI. Pattern Recognit Lett. 2020; 139: 118-127.
- 57Khalil HA, Darwish S, Ibrahim YM, Hassan OF. 3D-MRI brain tumor detection model using a modified version of level set segmentation based on dragonfly algorithm. Symmetry. 2020; 12(8): 1256.
- 58Rajinikanth V, Raj ANJ, Thanaraj KP, Naik GR. A customized VGG19 network with a concatenation of deep and handcrafted features for brain tumor detection. Appl Sci. 2020; 10(10):3429.
- 59Nagaraj P, Muneeswaran V, Reddy LV, Upendra P, Reddy MVV. Programmed multi-classification of brain tumor images using deep neural network. 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS). IEEE; 2020:865-870.
- 60Zhou Z, He Z, Jia Y. AFPNet: a 3D fully convolutional neural network with atrous-convolution feature pyramid for brain tumor segmentation via MRI images. Neurocomputing. 2020; 402: 235-244.
- 61Tandel GS, Balestrieri A, Jujaray T, Khanna NN, Saba L, Suri JS. Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm. Comput Biol Med. 2020; 122:103804.
- 62Irmak E. Multi-classification of brain tumor MRI images using deep convolutional neural network with fully optimized framework. Iran J Sci Technol Trans Electr Eng. 2021; 45: 1015-1036.
- 63Deb D, Roy S. Brain tumor detection based on hybrid deep neural network in MRI by adaptive squirrel search optimization. Multimed Tools Appl. 2021; 80(2): 2621-2645.
- 64Díaz-Pernas FJ, Martínez-Zarzuela M, Antón-Rodríguez M, González-Ortega D. A deep learning approach for brain tumor classification and segmentation using a multiscale convolutional neural network. Healthcare. 2021; 9(2): 153.
- 65Kumar DM, Satyanarayana D, Giri Prasad MN. MRI brain tumor detection using optimal possibilistic fuzzy C-means clustering algorithm and adaptive k-nearest neighbor classifier. J Ambient Intell Humaniz Comput. 2021; 12(2): 2867-2880.
- 66Ranjbarzadeh R, Kasgari AB, Ghoushchi SJ, Anari S, Naseri M, Bendechache M. Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images. Sci Rep. 2021; 11(1): 1-17.
- 67Rehman A, Khan MA, Saba T, Zahid M, Tariq U, Ayesha N. Microscopic brain tumor detection and classification using 3D CNN and feature selection architecture. Microsc Res Tech. 2021; 84(1): 133-149.
- 68Sadad T, Rehman A, Munir A, et al. Brain tumor detection and multi-classification using advanced deep learning techniques. Microsc Res Tech. 2021; 84(6): 1296-1308.
- 69Al-Saffar ZA, Yildirim T. A hybrid approach based on multiple eigenvalues selection (MES) for the automated grading of a brain tumor using MRI. Comput Methods Programs Biomed. 2021; 201:105945.
- 70Zhang Y, Lu Y, Chen W, Chang Y, Gu H, Yu B. MSMANet: a multi-scale mesh aggregation network for brain tumor segmentation. Appl Soft Comput. 2021; 110:107733.
- 71Naseer A, Yasit T, Azhar A, Shakeel T, Zafar K. Computer-aided brain tumor diagnosis: performance evaluation of deep learner CNN using augmented brain MRI. Int J Biomed Imaging. 2021; 2021: 1-11.
- 72Rasool M, Ismail NA, Boulila W, et al. A hybrid deep learning model for brain tumour classification. Entropy. 2022; 24(6): 799.
- 73Cheng J. Brain tumor dataset—Figshare. 2017 https://figshare.com/articles/dataset/brain_tumor_dataset/1512427
- 74Scarpace L, Flanders A, Jain R, Mikkelsen T, Andrews DW. Data from REMBRANDT. The cancer imaging archive. 2015.
- 75Chandra E, Kanagalakshmi K. Noise elimination in fingerprint image using median filter. Int J Adv Netw Appl. 2011; 2(6): 950-955.
- 76Cheng J, Huang W, Cao S, et al. Enhanced performance of brain tumor classification via tumor region augmentation and partition. PloS One. 2015; 10(10):e0140381.
- 77Wong SC, Gatt A, Stamatescu V, McDonnell MD. Understanding data augmentation for classification: when to warp? 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA). IEEE; 2016:1-6.
- 78Saha BN, Ray N, Greiner R, Murtha A, Zhang H. Quick detection of brain tumor and edemas: a bounding box method using symmetry. Comput Med Imaging Graph. 2012; 36(2): 95-107.
- 79Praveen G, Agrawal A. Multistage classification and segmentation of brain tumor. 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). IEEE; 2016:1628-1632.
- 80Sajja VR, Rani SR, Naik DB, Pratyusha K. Segmentation of brain tumor using a hybrid approach of the fast bounding box and thresholding in MRI. Int J Recent Technol Eng(IJRTE). 2019; 7:1-7.
- 81Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. International Conference on Machine Learning PMLR; 2015:448-456.
- 82Nair V, Hinton GE. Rectified Linear Units Improve Restricted Boltzmann Machines. Icml; 2010.
- 83Al-Rfou R, Alain G, Almahairi A, et al. Theano: a Python framework for fast computation of mathematical expressions. arXiv e-prints. arXiv: 1605.02688; 2016.
- 84Saladi S, Karuna Y, Koppu S, et al. Segmentation and analysis emphasizing neonatal MRI brain images using machine learning techniques. Mathematics. 2023; 11(2): 285.
- 85Sharma SR, Alshathri S, Singh B, Kaur M, Mostafa RR, El-Shafai W. Hybrid multilevel thresholding image segmentation approach for brain MRI. Diagnostics. 2023; 13(5): 925.