Journal Home > Volume 16 , Issue 1

Human vision depends heavily on retinal tissue. The loss of eyesight may result from infections of the retinal tissues that are treated slowly or do not work at all. Additionally, the diagnosis is susceptible to inaccuracies when a large dataset is involved. Therefore, a fully automated transfer learning approach for diagnosing diabetic retinopathy (DR) is suggested to minimize human intervention while maintaining high classification accuracy. To address this issue, we proposed a transfer learning-based trilateral attention network (TaNet) for the classification. To boost the visual quality of the DR pictures, a contrast constrained adaptive histogram equalization approach is applied. The pre-processed pictures are then segmented using a bilateral segmentation network (BiSeNet). The BiSeNet segmented the optic disc and blood vessels individually. After the completion of segmentation, the features are extracted. Feature extraction is based on the wavelet scattering transformation approach. The results of many trials were evaluated against the Messidor-2, EYEPACS, and APTOS 2019 datasets. The proposed model was created using a refined pre-trained technique and transfer learning methodology. Finally, the suggested framework was tested using efficiency assessment methods, and the classification rate was recorded as having above 98% sensitivity, specificity, precision, and accuracy. The proposed approach yields greater performance and shows enhancement towards the existing approach.


menu
Abstract
Full text
Outline
About this article

An Enhancing Diabetic Retinopathy Classification and Segmentation based on TaNet

Show Author's information Koneru Suvarna Vani1( )Puppala Praneeth1Vivek Kommareddy1Parasa Rishi Kumar1Madala Sarath1Shaik Hussain1Potluri Ravikiran2
Department of Computer Science and Engineering, Velagapudi Ramakrishna Siddhartha Engineering College (Autonomous), Kanuru, Vijayawada, Andhra Pradesh 520007, India
Department of Ophthalmology, Dr Pinnamaneni Siddhartha Institute of Medical Sciences & Research Foundation, Vijayawada, India

Abstract

Human vision depends heavily on retinal tissue. The loss of eyesight may result from infections of the retinal tissues that are treated slowly or do not work at all. Additionally, the diagnosis is susceptible to inaccuracies when a large dataset is involved. Therefore, a fully automated transfer learning approach for diagnosing diabetic retinopathy (DR) is suggested to minimize human intervention while maintaining high classification accuracy. To address this issue, we proposed a transfer learning-based trilateral attention network (TaNet) for the classification. To boost the visual quality of the DR pictures, a contrast constrained adaptive histogram equalization approach is applied. The pre-processed pictures are then segmented using a bilateral segmentation network (BiSeNet). The BiSeNet segmented the optic disc and blood vessels individually. After the completion of segmentation, the features are extracted. Feature extraction is based on the wavelet scattering transformation approach. The results of many trials were evaluated against the Messidor-2, EYEPACS, and APTOS 2019 datasets. The proposed model was created using a refined pre-trained technique and transfer learning methodology. Finally, the suggested framework was tested using efficiency assessment methods, and the classification rate was recorded as having above 98% sensitivity, specificity, precision, and accuracy. The proposed approach yields greater performance and shows enhancement towards the existing approach.

Keywords: transfer learning, diabetic retinopathy (DR), trilateral attention network (TaNet), wavelet scattering transformation, bilateral segmentation network (BiSeNet)

References(34)

[1]

H. S. Sandhu, A. Eltanboly, A. Shalaby, et al. Automated diagnosis and grading of diabetic retinopathy using optical coherence tomography. Investigative Opthalmology &Visual Science, 2018, 59(7): 3155. https://doi.org/10.1167/iovs.17-23677

[2]

T. Selçuk, A. Alkan. Detection of microaneurysms using ant colony algorithm in the early diagnosis of diabetic retinopathy. Medical Hypotheses, 2019, 129: 109242. https://doi.org/10.1016/j.mehy.2019.109242

[3]

Y. Kaizu, S. Nakao, M. Arima, et al. Flow density in optical coherence tomography angiography is useful for retinopathy diagnosis in diabetic patients. Scientific Reports, 2019, 9: 8668. https://doi.org/10.1038/s41598-019-45194-z

[4]

L. B. Frazao, N. Theera-Umpon, S. Auephanwiriyakul. Diagnosis of diabetic retinopathy based on holistic texture and local retinal features. Information Sciences, 2019, 475: 44−66. https://doi.org/10.1016/j.ins.2018.09.064

[5]

Q. J. Li, S. S. Fan, C. S. Chen. An intelligent segmentation and diagnosis method for diabetic retinopathy based on improved U-NET network. Journal of Medical Systems, 2019, 43: 43. https://doi.org/10.1007/s10916-019-1432-0

[6]

S. Gayathri, V. P. Gopi, P. Palanisamy. Automated classification of diabetic retinopathy through reliable feature selection. Physical and Engineering Sciences in Medicine, 2020, 43: 927−945. https://doi.org/10.1007/s13246-020-00890-3

[7]

S. Vujosevic, S. J. Aldington, P. Silva, et al. Screening for diabetic retinopathy: New perspectives and challenges. The Lancet Diabetes &Endocrinology, 2020, 8(4): 337−347. https://doi.org/10.1016/S2213-8587(19)30411-5

[8]

M. A. Aslam, M. A. Munir, R. Ahmad, et al. Deep Neural Networks for Prediction of Cardiovascualr Diseases. Nano Biomed. Eng., 2022, 14(1): 81−89. https://doi.org/10.5101/nbe.v14i1.p81-89

[9]

S. H. Wan, Y. Liang, Y. Zhang. Deep convolutional neural networks for diabetic retinopathy detection by image classification. Computers &Electrical Engineering, 2018, 72: 274−282. https://doi.org/10.1016/j.compeleceng.2018.07.042

[10]

H. Riaz, J. Park, H. Choi, et al. Deep and densely connected networks for classification of diabetic retinopathy. Diagnostics, 2020, 10(1): 24. https://doi.org/10.3390/diagnostics10010024

[11]

T. A. Jumani, M. W. Mustafa, Z. Hussain, et al. Jaya optimization algorithm for transient response and stability enhancement of a fractional-order PID based automatic voltage regulator system. Alexandria Engineering Journal, 2020, 59(4): 2429−2440. https://doi.org/10.1016/j.aej.2020.03.005

[12]

I. Qureshi, J. Ma, Q. Abbas. Recent development on detection methods for the diagnosis of diabetic retinopathy. Symmetry, 2019, 11(6): 749. https://doi.org/10.3390/sym11060749

[13]

Z. T. Gao, J. Li, J. X. Guo, et al. Diagnosis of diabetic retinopathy using deep neural networks. IEEE Access, 2019, 7: 3360−3370. https://doi.org/10.1109/access.2018.2888639

[14]

R. F. Mansour. Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy. Biomedical Engineering Letters, 2018, 8(1): 41−57. https://doi.org/10.1007/s13534-017-0047-y

[15]
Ding, W. P., Sun, Y., Ren, L. J., Ju, H. R., Feng, Z. H., Li, M. Multiple lesions detection of fundus images based on convolution neural network algorithm with improved SFLA. IEEE Access, 2020, 8: 97618–97631.
DOI
[16]

K. Q. Li, X. Q. Qi, Y. W. Luo, et al. Accurate retinal vessel segmentation in color fundus images via fully attention-based networks. IEEE Journal of Biomedical and Health Informatics, 2021, 25(6): 2071−2081. https://doi.org/10.1109/JBHI.2020.3028180

[17]

H. Almubarak, Y. Bazi, N. Alajlan. Two-stage mask-RCNN approach for detecting and segmenting the optic nerve head, optic disc, and optic cup in fundus images. Applied Sciences, 2020, 10(11): 3833. https://doi.org/10.3390/app10113833

[18]

G. B. Kande, P. V. Subbaiah, T. S. Savithri. Unsupervised fuzzy based vessel segmentation in pathological digital fundus images. Journal of Medical Systems, 2010, 34(5): 849−858. https://doi.org/10.1007/s10916-009-9299-0

[19]

L. Wang, H. Liu, Y. L. Lu, et al. A coarse-to-fine deep learning framework for optic disc segmentation in fundus images. Biomedical Signal Processing and Control, 2019, 51: 82−89. https://doi.org/10.1016/j.bspc.2019.01.022

[20]

T. T. Che, Y. J. Zheng, J. Y. Cong, et al. Deep group-wise registration for multi-spectral images from fundus images. IEEE Access, 2019, 7: 27650−27661. https://doi.org/10.1109/ACCESS.2019.2901580

[21]

T. Shanthi, R. S. Sabeenian. Modified Alexnet architecture for classification of diabetic retinopathy images. Computers &Electrical Engineering, 2019, 76: 56−64. https://doi.org/10.1016/j.compeleceng.2019.03.004

[22]

K. Shankar, A. R. W. Sait, D. Gupta, et al. Automated detection and classification of fundus diabetic retinopathy images using synergic deep learning model. Pattern Recognition Letters, 2020, 133: 210−216. https://doi.org/10.1016/j.patrec.2020.02.026

[23]

D. J. Hemanth, O. Deperlioglu, U. Kose. An enhanced diabetic retinopathy detection and classification approach using deep convolutional neural network. Neural Computing and Applications, 2020, 32(3): 707−721. https://doi.org/10.1007/s00521-018-03974-0

[24]

J. Jayanthi, T. Jayasankar, N. Krishnaraj, et al. An intelligent particle swarm optimization with convolutional neural network for diabetic retinopathy classification model. Journal of Medical Imaging and Health Informatics, 2021, 11(3): 803−809. https://doi.org/10.1166/jmihi.2021.3362

[25]

S. Das, K. Kharbanda, S. M, et al. Deep learning architecture based on segmented fundus image features for classification of diabetic retinopathy. Biomedical Signal Processing and Control, 2021, 68: 102600. https://doi.org/10.1016/j.bspc.2021.102600

[26]

M. D. Alahmadi. Texture attention network for diabetic retinopathy classification. IEEE Access, 2022, 10: 55522−55532. https://doi.org/10.1109/ACCESS.2022.3177651

[27]

G. Kalyani, B. Janakiramaiah, A. Karuna, et al. Diabetic retinopathy detection and classification using capsule networks. Complex &Intelligent Systems, 2023, 9(3): 2651−2664. https://doi.org/10.1007/s40747-021-00318-9

[28]
Z. Y. Zhao, K. R. Zhang, X. J. Hao, et al. BiRA-net: Bilinear attention net for diabetic retinopathy grading. In: Proceedings of 2019 IEEE International Conference on Image Processing (ICIP), 2019: 1385–1389.
DOI
[29]
Z. Y. Zhao, K. Chopra, Z. Zeng, et al. Sea-net: Squeeze-and-excitation attention net for diabetic retinopathy grading. In: Proceedings of 2020 IEEE International Conference on Image Processing (ICIP), 2020: 2496–2500.
DOI
[30]
P. S. Qian, Z. Y. Zhao, C. Chen, et al. Two eyes are better than one: Exploiting binocular correlation for diabetic retinopathy severity grading. In: Proceedings of 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2021: 2115–2118.
DOI
[31]

N. Singh, L. Kaur, K. Singh. Histogram equalization techniques for enhancement of low radiance retinal images for early detection of diabetic retinopathy. Engineering Science and Technology,an International Journal, 2019, 22(3): 736−745. https://doi.org/10.1016/j.jestch.2019.01.014

[32]
C. Q. Yu, J. B. Wang, C. Peng, et al. BiSeNet: Bilateral segmentation network for real-time semantic segmentation. In: Proceedings of the European Conference on Computer Vision, 2018: 334–349.
DOI
[33]
E. Oyallon, S. Mallat, L. Sifre. Generic deep networks with wavelet scattering. arXiv preprint arXiv:1312.5940, 2013.
[34]
G. Zamzmi, V. Sachdev, S. Antani. Trilateral attention network for real-time medical image segmentation. arXiv preprint arXiv:2106.09201, 2021.
DOI
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 28 December 2022
Revised: 13 September 2023
Accepted: 26 September 2023
Published: 21 November 2023
Issue date: March 2024

Copyright

© The Author(s) 2024.

Acknowledgements

Acknowledgements

We declare that this manuscript is original, has not been published before and is not currently being considered for publication elsewhere.

Rights and permissions

This is an open-access article distributed under  the  terms  of  the  Creative  Commons  Attribution  4.0 International  License (CC BY) (http://creativecommons.org/licenses/by/4.0/), which  permits  unrestricted  use,  distribution,  and reproduction in any medium, provided the original author and source are credited.

Return