A deep learning-based framework for retinal fundus image enhancement. 2023

Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
Department of Electrical and Computer Engineering, ASRI, Seoul National University, Seoul, South Korea.

Low-quality fundus images with complex degredation can cause costly re-examinations of patients or inaccurate clinical diagnosis. This study aims to create an automatic fundus macular image enhancement framework to improve low-quality fundus images and remove complex image degradation. We propose a new deep learning-based model that automatically enhances low-quality retinal fundus images that suffer from complex degradation. We collected a dataset, comprising 1068 pairs of high-quality (HQ) and low-quality (LQ) fundus images from the Kangbuk Samsung Hospital's health screening program and ophthalmology department from 2017 to 2019. Then, we used these dataset to develop data augmentation methods to simulate major aspects of retinal image degradation and to propose a customized convolutional neural network (CNN) architecture to enhance LQ images, depending on the nature of the degradation. Peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), r-value (linear index of fuzziness), and proportion of ungradable fundus photographs before and after the enhancement process are calculated to assess the performance of proposed model. A comparative evaluation is conducted on an external database and four different open-source databases. The results of the evaluation on the external test dataset showed an significant increase in PSNR and SSIM compared with the original LQ images. Moreover, PSNR and SSIM increased by over 4 dB and 0.04, respectively compared with the previous state-of-the-art methods (P < 0.05). The proportion of ungradable fundus photographs decreased from 42.6% to 26.4% (P = 0.012). Our enhancement process improves LQ fundus images that suffer from complex degradation significantly. Moreover our customized CNN achieved improved performance over the existing state-of-the-art methods. Overall, our framework can have a clinical impact on reducing re-examinations and improving the accuracy of diagnosis.

UI MeSH Term Description Entries
D007089 Image Enhancement Improvement of the quality of a picture by various techniques, including computer processing, digital filtering, echocardiographic techniques, light and ultrastructural MICROSCOPY, fluorescence spectrometry and microscopy, scintigraphy, and in vitro image processing at the molecular level. Image Quality Enhancement,Enhancement, Image,Enhancement, Image Quality,Enhancements, Image,Enhancements, Image Quality,Image Enhancements,Image Quality Enhancements,Quality Enhancement, Image,Quality Enhancements, Image
D007091 Image Processing, Computer-Assisted A technique of inputting two-dimensional or three-dimensional images into a computer and then enhancing or analyzing the imagery into a form that is more useful to the human observer. Biomedical Image Processing,Computer-Assisted Image Processing,Digital Image Processing,Image Analysis, Computer-Assisted,Image Reconstruction,Medical Image Processing,Analysis, Computer-Assisted Image,Computer-Assisted Image Analysis,Computer Assisted Image Analysis,Computer Assisted Image Processing,Computer-Assisted Image Analyses,Image Analyses, Computer-Assisted,Image Analysis, Computer Assisted,Image Processing, Biomedical,Image Processing, Computer Assisted,Image Processing, Digital,Image Processing, Medical,Image Processings, Medical,Image Reconstructions,Medical Image Processings,Processing, Biomedical Image,Processing, Digital Image,Processing, Medical Image,Processings, Digital Image,Processings, Medical Image,Reconstruction, Image,Reconstructions, Image
D005654 Fundus Oculi The concave interior of the eye, consisting of the retina, the choroid, the sclera, the optic disk, and blood vessels, seen by means of the ophthalmoscope. (Cline et al., Dictionary of Visual Science, 4th ed) Fundus of the Eye,Ocular Fundus,Fundus, Ocular
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron
D059629 Signal-To-Noise Ratio The comparison of the quantity of meaningful data to the irrelevant or incorrect data. Ratio, Signal-To-Noise,Ratios, Signal-To-Noise,Signal To Noise Ratio,Signal-To-Noise Ratios

Related Publications

Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
April 2021, Journal of personalized medicine,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
August 2022, Bioengineering (Basel, Switzerland),
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
May 2024, Journal of endourology,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
July 2019, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
January 2023, Healthcare (Basel, Switzerland),
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
January 2023, Therapeutic advances in chronic disease,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
April 2024, Computer methods and programs in biomedicine,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
December 2018, Biomedical optics express,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
November 2022, Scientific reports,
Kang Geon Lee, and Su Jeong Song, and Soochahn Lee, and Hyeong Gon Yu, and Dong Ik Kim, and Kyoung Mu Lee
March 2023, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society,
Copied contents to your clipboard!