A deep learning framework for glaucoma detection based on robust optic disc segmentation and transfer learning
Corresponding Author
Deepa Natarajan
Department of Electronics and Communication Engineering, Coimbatore Institute of Technology, Coimbatore, Tamil Nadu, India
Correspondence
Deepa Natarajan, Department of Electronics and Communication Engineering, Coimbatore Institute of Technology, Coimbatore, Tamil Nadu, India.
Email: [email protected]
Search for more papers by this authorEsakkirajan Sankaralingam
Department of Instrumentation and Control Engineering, PSG College of Technology, Coimbatore, Tamil Nadu, India
Search for more papers by this authorKeerthiveena Balraj
Department of Instrumentation and Control Engineering, PSG College of Technology, Coimbatore, Tamil Nadu, India
Search for more papers by this authorSelvakumar Karuppusamy
School of Electrical Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
Search for more papers by this authorCorresponding Author
Deepa Natarajan
Department of Electronics and Communication Engineering, Coimbatore Institute of Technology, Coimbatore, Tamil Nadu, India
Correspondence
Deepa Natarajan, Department of Electronics and Communication Engineering, Coimbatore Institute of Technology, Coimbatore, Tamil Nadu, India.
Email: [email protected]
Search for more papers by this authorEsakkirajan Sankaralingam
Department of Instrumentation and Control Engineering, PSG College of Technology, Coimbatore, Tamil Nadu, India
Search for more papers by this authorKeerthiveena Balraj
Department of Instrumentation and Control Engineering, PSG College of Technology, Coimbatore, Tamil Nadu, India
Search for more papers by this authorSelvakumar Karuppusamy
School of Electrical Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
Search for more papers by this authorAbstract
Glaucoma is a common ocular disorder, inflicting blindness in millions of people, early detection of which can reduce adverse outcomes. This paper presents a two-stage deep learning framework UNet-SNet, for glaucoma detection. Initially, each fundus image is segmented into GMM super pixels and the Region of Interest (RoI) is separated by Cuckoo Search Optimization (CSO). In the first stage, a regularized UNet is trained with RoIs for OD segmentation. In the second stage, a SqueezeNet is fine-tuned with deep features of the ODs to discriminate fundus images into glaucomotousor Normal. The UNet is trained and tested with the RIGA and RIM-ONEv2 datasets, achieving 97.84% and 99.85% accuracies respectively. The classifier is trained with the ODs segmented from the RIM-ONEv2 dataset and tested with ACRIMA, Drishti-GS1 and RIM-ONEv1 datasets accomplishing 99.86%, 97.05% and 100% accuracies respectively. Performance evaluations and complexity analyses with state-of-the-art systems demonstrate the superiority of the proposed model.
CONFLICT OF INTEREST
The authors declare no conflict of interest.
Open Research
DATA AVAILABILITY STATEMENT
The data that support the findings of this study are openly available in RIGA at https://doi.org/10.1117/12.2293584, reference number 29, RIM-ONE at http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5999143&tag=1, reference number [30] and Drishti-gs at https://cvit.iiit.ac.in/projects/mip/drishti-gs/mip-dataset2/Home.php, reference number [31].
REFERENCES
- 1 World Health Organization. Global report on vision. World Health Organization; 2019. http://www.who.int/publications-detail/world-report-on-vision. Accessed July 24, 2020.
- 2Gupta N, Aung T, Congdon N, et al. International Council of Ophthalmology Guidelines for Glaucoma eye care. International Council of Ophthalmology; 2016.
- 3Fu H, Cheng J, Xu Y, et al. Disc-aware ensemble network for glaucoma screening from fundus image. IEEE Trans Med Imaging. 2018; 37(11): 2493-2501.
- 4Bock R, Meier J, Michelson G, Nyúl LG, Hornegger J. Classifying glaucoma with image-based features from fundus photographs. In: Joint Pattern Recognition Symposium, September 2007, Berlin, Heidelberg: Springer:355-364.
- 5Hatanaka Y, Noudo A, Muramatsu C, et al. Vertical cup-to-disc ratio measurement for diagnosis of glaucoma on fundus images. In: Medical Imaging 2010: Computer-Aided Diagnosis. Vol. 7624. International Society for Optics and Photonics; March 2010:76243C.
- 6Xu Y, Xu D, Lin S, et al. Sliding window and regression based cup detection in digital fundus images for glaucoma diagnosis. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Heidelberg: Springer; September 2011:1-8.
- 7Yin F, Liu J, Ong SH, et al. Model-based optic nerve head segmentation on retinal fundus images. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society; IEEE; August 2011:2626-2629.
- 8Chakravarty A, Sivaswamy J. Glaucoma classification with a fusion of segmentation and image-based features. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI); IEEE; April 2016:689-692.
- 9Cheng J, Yin F, Wong DWK, Tao D, Liu J. Sparse dissimilarity-constrained coding for glaucoma screening. IEEE Trans Biomed Eng. 2015; 62(5): 1395-1403.
- 10Mohamed NA, Zulkifley MA, Zaki WMDW, Hussain A. An automated glaucoma screening system using cup-to-disc ratio via simple linear iterative clustering superpixel approach. Biomed Signal Process Control. 2019; 53:101454.
- 11Maheshwari S, Pachori RB, Acharya UR. Automated diagnosis of glaucoma using empirical wavelet transform and correntropy features extracted from fundus images. IEEE J Biomed Health Inform. 2016; 21(3): 803-813.
- 12Thakur N, Juneja M. Classification of glaucoma using hybrid features with machine learning approaches. Biomed Signal Process Control. 2020; 62:102137.
- 13Thakur N, Juneja M. Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Syst Appl. 2019; 127: 308-322.
- 14Tabassum M, Khan TM, Arsalan M, et al. CDED-net: joint segmentation of optic disc and optic cup for glaucoma screening. IEEE Access. 2020; 8: 102733-102747.
- 15Gu Z, Cheng J, Fu H, et al. Ce-net: context encoder network for 2d medical image segmentation. IEEE Trans Med Imaging. 2019; 38(10): 2281-2292.
- 16Zhao X, Wang S, Zhao J, Wei H, Xiao M, Ta N. Application of an attention U-net incorporating transfer learning for optic disc and cup segmentation. Signal Image Video Process. 2020; 1-9. https://doi.org/10.1007/s11760-020-01815-z.
- 17Juneja M, Thakur N, Thakur S, Uniyal A, Wani A, Jindal P. GC-NET for classification of glaucoma in the retinal fundus image. Mach Vis Appl. 2020; 31(5): 1-18.
- 18Diaz-Pinto A, Morales S, Naranjo V, Köhler T, Mossi JM, Navea A. CNNs for automatic glaucoma assessment using fundus images: an extensive validation. Biomed Eng Online. 2019; 18(1): 29.
- 19Orlando JI, Prokofyeva E, del Fresno M, Blaschko MB. Convolutional neural network transfer for automated glaucoma identification. In: 12th International Symposium on Medical Information Processing and Analysis. Vol. 10160. International Society for Optics and Photonics; January 2017:101600U.
- 20Juneja M, Singh S, Agarwal N, et al. Automated detection of Glaucoma using deep learning convolution network (G-net). Multimed Tools Appl. 2020; 79: 15531-15553. https://doi.org/10.1007/s11042-019-7460-4.
- 21Gómez-Valverde JJ, Antón A, Fatti G, et al. Automatic glaucoma classification using color fundus images based on convolutional neural networks and transfer learning. Biomed Opt Express. 2019; 10(2): 892-913.
- 22Zhang L, Lim CP. Intelligent optic disc segmentation using improved particle swarm optimization and evolving ensemble models. Appl Soft Comput. 2020; 92:106328.
- 23Sreng S, Maneerat N, Hamamoto K, Win KY. Deep learning for optic disc segmentation and glaucoma diagnosis on retinal images. Appl Sci. 2020; 10(14): 4916.
- 24Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV); 2018:801-818.
- 25Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2018:4510-4520.
- 26Ronneberger O, Fischer P, Brox T U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, October, 2015:234-241. Cham, Switzerland: Springer.
- 27Yang XS, Deb S. Cuckoo search via Lévy flights. In: 2009 World Congress on nature & biologically inspired computing (NaBIC). IEEE; December 2009:210-214.
- 28Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360; 2016.
- 29Almazroa A, Alodhayb S, Osman E, et al. Retinal fundus images for glaucoma analysis: the RIGA dataset. Proc. SPIE 10579, Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications. Vol 10579B; March. https://doi.org/10.1117/12.2293584.
10.1117/12.2293584 Google Scholar
- 30Fumero F, Alayón S, Sanchez JL, Sigut J, Gonzalez-Hernandez M. RIM-ONE: an open retinal image database for optic nerve evaluation. 2011 24th International Symposium on Computer-Based Medical Systems (CBMS), June; 2011: 1-6. https://doi.org/10.1109/CBMS.2011.5999143.
10.1109/CBMS.2011.5999143 Google Scholar
- 31Sivaswamy J, Krishnadas SR, Joshi GD, Jain M, Tabish AUS. Drishti-gs: retinal image dataset for optic nerve head (onh) segmentation. 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), April; 2014: 53-56. https://doi.org/10.1109/ISBI.2014.6867807.
10.1109/ISBI.2014.6867807 Google Scholar
- 32Chen X, Xu Y, Wong DWK, Wong TY, Liu J. Glaucoma detection based on deep convolutional neural network. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), August; 2015: 715-718. https://doi.org/10.1109/EMBC.2015.7318462.
10.1109/EMBC.2015.7318462 Google Scholar
- 33Zhang Z, Yin FS, Liu J, et al. Origa-light: an online retinal fundus image database for glaucoma analysis and research. 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, August. IEEE; 2010: 3065-3068. https://doi.org/10.1109/IEMBS.2010.5626137.
10.1109/IEMBS.2010.5626137 Google Scholar
- 34Sng CC, Foo LL, Cheng CY, et al. Determinants of anterior chamber depth: the Singapore Chinese Eye Study. Ophthalmology. 2012; 119(6): 1143-1150.
- 35Chen X, Xu Y, Yan S, Wong DWK, Wong TY, Liu J. Automatic feature learning for glaucoma detection based on deep learning. International Conference on Medical Image Computing and Computer-Assisted Intervention, October. Cham: Springer; 2015: 669-677.
10.1007/978-3-319-24574-4_80 Google Scholar
- 36Pal A, Moorthy MR, Shahina A. G-eyenet: a convolutional autoencoding classifier framework for the detection of glaucoma from retinal fundus images. 2018 25th IEEE International Conference on Image Processing (ICIP), October; 2018: 2775-2779.
10.1109/ICIP.2018.8451029 Google Scholar
- 37Budai A, Bock R, Maier A, Hornegger J, Michelson G. Robust vessel segmentation in fundus images. Int J Biomed Imaging. 2013; 2013: 1-11. https://doi.org/10.1155/2013/154860.
10.1155/2013/154860 Google Scholar
- 38Feijoo JG, de la Casa JMM, Servet HM, Zamorano MR, Mayoral MB, Suárez EJC. DRIONS-DB: digital retinal images for optic nerve segmentation database; 2014.
- 39Christopher M, Belghith A, Bowd C, et al. Performance of deep learning architectures and transfer learning for detecting glaucomatous optic neuropathy in fundus photographs. Sci Rep. 2018; 8(1): 1-13.
- 40Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556; 2014.
- 41Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2015:1-9.
- 42He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016:770-778.
- 43Sermanet P, Eigen D, Zhang X, Mathieu M, Fergus R, LeCun Y. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229; 2013.
- 44Chatfield K, Simonyan K, Vedaldi A, Zisserman A. Return of the devil in the details: Delving deep into convolutional nets. arXiv preprint arXiv:1405.3531; 2014.
- 45Li A, Wang Y, Cheng J, Liu J. Combining multiple deep features for glaucoma classification. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); April 2018:985-989. IEEE.
- 46Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Commun. ACM; 2017: 60(6): 84-90. https://doi.org/10.1145/3065386.
- 47Cerentinia A, Welfera D, d'Ornellasa MC, Haygertb CJP, Dottob GN. Automatic identification of glaucoma using deep learning methods. In: MEDINFO 2017: Precision Healthcare through Informatics: Proceedings of the 16th World Congress on Medical and Health Informatics. Vol. 245. January 2018:318. IOS Press.
- 48Pan CW, Wong TY, Chang L, et al. Ocular biometry in an urban Indian population: the Singapore Indian Eye Study (SINDI). Invest Ophthalmol Vis Sci. 2011; 52(9): 6636-6642.
- 49Orlando JI, Fu H, Breda JB, et al. Refuge challenge: a unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med Image Anal. 2020; 59:101570.
- 50He K, Gkioxari G Dollár P, Girshick R. Maskrcnn. In: IEEE International Conference on Computer Vision; October 2017:2980-2988.
- 51Chollet F. Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2017:1251-1258.
- 52Ban Z, Liu J, Cao L. Superpixel segmentation using Gaussian mixture model. IEEE Trans Image Process. 2018; 27(8): 4105-4117.
- 53Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell. 2012; 34(11): 2274-2282.
- 54Suresh S, Lal S. An efficient cuckoo search algorithm based multilevel thresholding for segmentation of satellite images using different objective functions. Expert Syst Appl. 2016; 58: 184-209.
- 55Li X, Chang D, Tian T, Cao J. Large-margin regularized softmax cross-entropy loss. IEEE Access. 2019; 7: 19572-19578.
- 56Yu S, Xiao D, Frost S, Kanagasingam Y. Robust optic disc and cup segmentation with deep learning for glaucoma detection. Comput Med Imaging Graph. 2019; 74: 61-71.
- 57Zhou B., Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016:2921-2929.
- 58Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision; 2017:618-626.