JKTBME
JKTBME
net/publication/316705880
CITATIONS READS
160 1,316
5 authors, including:
Dahong Qian
Shanghai Jiao Tong University
83 PUBLICATIONS 1,048 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Kai Jin on 29 May 2021.
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 2
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 3
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 4
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 5
TABLE I
AVERAGE AND STANDARD DEVIATION OF ASSESSED SCORES OF THE ORIGINAL
AND ENHANCED IMAGES IN THE L*A*B*, HSI, AND HSV COLOR SPACES.
Original
LAB HSI HSV
images
Average score 0.0404 0.4565 0.4372 0.2297
Standard deviation 0.0291 0.1000 0.0981 0.0907
Fig. 6. (a) Original retinal image; luminosity and contrast enhanced images
with contrast enhancement in the (b) L*a*b*, (c) HSI, and (d) HSV color space.
The selected regions in the black rectangle are zoomed in in the bottom row.
Fig. 7. Boxplot of the assessed scores of the original and luminosity and
contrast enhanced 961 images with contrast enhancement in the L*a*b*, HSI, Fig. 8. Enhancement of poor quality color retinal images by different
and HSV color space. enhancement methods. Original images are found in Fig. 2. (a) Image
enhancement was performed (a) by our proposed method based on luminosity
method for contrast enhancement by spreading the histogram of and contrast enhancement, (b) by using CLAHE only in the L channel of CIE
LAB color space, (c) using CLAHE in the R, G, and B channels, and (d) using
the processed image. The luminosity enhancement can improve
the method based on guided image filtering.
the contrast to some extent. The dynamic range of the
histograms in the R, G, and B channels of these processed space (Fig. 6c) has comparable luminance with the enhanced
images is further remarkably broadened by contrast image in the L*a*b* color space (Fig. 6b), it also has increased
enhancement, as indicated by the ROI histograms for the noise and inferior contrast in visual perception compared to the
contrast enhanced images (Fig. 5c), which demonstrates better image enhanced in the L*a*b* color space. Furthermore,
contrast compared to the luminosity enhanced images. The comparison of selected regions demonstrates that blood vessels
analysis result of histograms is consistent with our visual and other important details in the image enhanced in the
perception (Fig. 4). L*a*b* color space have better visibility and clarity than in
The resulting retinal images enhanced by our proposed images enhanced in the HSI and HSV color spaces. To
method display improved visualization of not only blood quantitatively compare the three color spaces, the original and
vessels but also other important anatomical structures of the enhanced images from our 961 image data subset were assessed
retina (i.e., optical disc and macula), and improves the by our proposed quality assessment method. This assessment
prominence of lesions. Moreover, our method preserves the indicated that the quality of images with contrast enhanced in
naturalness of the retinal images while at the same time the L*a*b* color space is superior to those enhanced in the
enhancing critical details, which can assist the HSV and HSI color space, as indicated by higher assessed
ophthalmologists in better retinal image analysis. scores for individual images and for the 961 image data
To verify the effectiveness of contrast enhancement of the subgroup as a whole (Fig. 7, Table I). This demonstrates that
luminosity enhanced image in the L*a*b* color space, we our proposed method is able to achieve the best overall assessed
carried out a comparison of our method with contrast score for enhanced images, and indicates that the L*a*b* color
enhancement of the I and V channels in the HSI and HSV color space has an advantage over the HSV and HSI color spaces for
spaces respectively by the CLAHE approach. The contrast improving image contrast and highlighting retinal vessel
enhancement in the L*a*b color space demonstrates superior characteristics.
luminance and contrast compared to enhancements in the HSI We further carried out a comparison with other related
and HSV color space (representative color retinal images enhancement methods, including a method using CLAHE only
shown in Fig. 6). Although the image enhanced in the HSI color
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 6
IV. CONCLUSIONS
Here we present an effective method for color retinal image
enhancement based on luminosity and contrast adjustment.
First, the luminosity of the color retinal image is enhanced by a
luminance gain matrix based on gamma correction, and then
image contrast is enhanced by CLAHE in the L*a*b* color
space. The performance of our proposed method was validated
on two large color retinal image datasets. The results show that,
compared with contrast enhancement in other color spaces and
other methods, our proposed method achieves superior
improvement of color retinal images, especially for those with
initially of poor quality. This method is not only able to
Fig. 9. Boxplot of assessed scores of the original and enhanced images in our enhance important anatomical structures of the retina, but it
proprietary dataset and the Messidor dataset respectively. also preserves the naturalness of the images. This effective
method of color retinal image enhancement will greatly assist
in the L channel of the L*a*b* color space, a method using ophthalmologists in disease diagnosis through retinal image
CLAHE in the R, G, and B channels, and a method based on analysis, and will be greatly beneficial to automated image
guided image filtering [25], in which the input image itself is analysis systems. The clinical evaluation of our method is
used as a guidance image (Fig. 8). In contrast to our proposed currently in progress.
enhancement method based on luminosity and contrast
enhancement (Fig. 8a), the method using CLAHE in only L ACKNOWLEDGMENT
channel of the L*a*b* color space improves contrast for the
The authors would like to acknowledge the Messidor
retinal images with normal illuminance, but it is unable to
database which were provided by the Messidor program
balance luminosity for retinal images with low illuminance (Fig. partners (see http://www.adcis.net/en/DownloadThirdParty/
8b). The image enhancement using CLAHE in the R, G, and B Messidor.html).
channels results in severe color distortion, which may lead to a
clinical misdiagnosis (Fig. 8c). Finally, although the REFERENCES
enhancement method based on guided image filtering can [1] M. D. Abramoff et al., “Retinal imaging and image analysis,” IEEE Rev.
effectively enhance the details of the whole image (Fig. 8d), Biomed. Eng., vol. 3, pp. 169-208, Dec. 2010.
this method results in unnatural looks due to the over [2] A. F. M. Hani and H. A. Nugroho, “Retinal vasculature enhancement
enhancement of details and edges. And the two methods are using independent component analysis,” J. Biomed. Sci. Eng., vol. 2, no. 7,
pp. 543-549, Nov. 2009.
also unable to improve luminosity. Therefore, luminosity [3] J. Paulus et al., “Automated quality assessment of retinal fundus photos,”
enhancement in our method is necessary, especially for poor Int. J. Comput. Assist. Radiol. Surg., vol. 5, no. 6, pp. 557-564, Nov.
quality color retinal images, and contrast enhancement in our 2010.
[4] U. Sevik et al., “Identification of suitable fundus images using automated
method is more effective. quality assessment methods,” J. Biomed. Opt., vol. 19, no. 4, p. 046006,
Moreover, the retinal images in the Messidor dataset were Apr. 2014.
processed by our enhancement method, and were also [5] M. R. K. Mookiah et al., “Computer-aided diagnosis of diabetic
retinopathy: a review,” Comput. Biol. Med., vol. 43, no. 12, pp.
evaluated by the same assessment method (Fig. 9). The 2136-2155, Dec. 2013.
averages of assessed scores of the original and enhanced [6] E. Daniel and J. Anitha, “Optimum green plane masking for the contrast
images are 0.1957 (standard deviation 0.0819) and 0.4610 enhancement of retinal images using enhanced genetic algorithm,” Optik,
vol. 126, no. 18, pp. 1726-1730, Sep. 2015.
(standard deviation 0.1152) respectively. The assessment result [7] M. Foracchia et al., “Luminosity and contrast normalization in retinal
demonstrates that our method can improve the normal retinal images,” Med. Image Anal., vol. 9, no. 3, pp. 179-190, Jun. 2005.
images, too. When the retinal image is collected, it can be [8] P. Feng et al., “Enhancing retinal image by the Contourlet transform,”
Pattern Recogn. Lett., vol. 28, no. 4, pp. 516-522, Mar. 2007.
directly processed by the proposed method without prior [9] E. D. Pisano et al., “Contrast limited adaptive histogram equalization
assessment. By comparing the assessed scores of the two image processing to improve the detection of simulated spiculations in
datasets, the average of the enhanced images in the Messidor dense mammograms,” J. Digit. Imaging, vol. 11, no. 4, pp. 193-200, Nov.
dataset is slightly better in general, but the average of the 1998.
[10] G. S. Ramlugun et al., “Small retinal vessels extraction towards
original images is significantly higher. Despite the good quality proliferative diabetic retinopathy screening,” Expert Syst. Appl., vol. 39,
achieved with enhanced images in both datasets, our method no. 1, pp. 1141-1146, Jan. 2012.
performs better on the poor quality retinal images in our [11] R. GeethaRamani and L. Balasubramanian, “Retinal blood vessel
segmentation employing image processing and data mining techniques
proprietary dataset. for computerized retinal image analysis,” Biocybern. Biomed. Eng., vol.
In summary, the above results demonstrate that our proposed 36, no. 1, pp. 102-118, Jan. 2016.
method works well on both the poor and normal retinal images [12] Y. Zhao et al., “Retinal vessel segmentation: an efficient graph cut
approach with retinex and local phase,” Plos One, vol. 10, no. 4, p.
to improve their luminosity and contrast, and provides e0122332, Apr. 2015.
qualitatively and quantitatively superior enhancement
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2700627, IEEE
Transactions on Biomedical Engineering
TBME-01821-2016.R1 7
[13] S. Wang et al., “Naturalness preserved enhancement algorithm for [19] E. Decenciere et al., “Feedback on a publicly distributed image database:
non-uniform illumination images,” IEEE T. Image Process., vol. 22, no. 9, the Messidor database,” Image Anal. Stereol., vol. 33, no. 3, pp. 231-234,
pp. 3538-3548, Sep. 2013. Aug. 2014.
[14] M. Liao et al., “Retinal vessel enhancement based on multi-scale top-hat [20] L. Cai et al., “A hue-preserving based algorithm for low-illumination
transformation and histogram fitting stretching,” Opt. Laser Technol., vol. colour image enhancement,” Comput. Appl. Softw., vol. 26, no. 3, pp.
58, pp. 56-62, Jun. 2014. 226-227, Mar. 2009.
[15] B. Chen et al., “Blood vessel enhancement via multi-dictionary and sparse [21] H. W. Guo et al., “Gamma correction for digital fringe projection
coding: application to retinal vessel enhancing,” Neurocomputing, vol. profilometry,” Appl. Optics, vol. 43, no. 14, pp. 2906-2914, May 2004.
200, pp. 110-117, Aug. 2016. [22] S. C. Huang et al., “Efficient contrast enhancement using adaptive gamma
[16] R. Kirifi et al., “CIEL*a*b* color space predictive models for colorimetry correction with weighting distribution,” IEEE T. Image Process., vol. 22,
devices - analysis of perfume quality,” Talanta, vol. 104, pp. 58-66, Jan. no. 3, pp. 1032-1041, Mar. 2013.
2013. [23] S. K. Naik and C. A. Murthy, “Hue-preserving color image enhancement
[17] H. Tang and Y. Zhao, “Edge detection in CIE L*a *b * based on without gamut problem,” IEEE T. Image Process., vol. 12, no. 12, pp.
fractional differential,” J. Image Graph., vol. 18, no. 6, pp. 628-636, Jun. 1591-1598, Dec. 2003.
2013. [24] L. Xu et al., “Moving object detecting using LAB color space,” J.
[18] S. Wang et al., “Human visual system-based fundus image quality Huazhong Univ. Sci. & Tech. (Natural Science Edition), vol. 41, no. I, pp.
assessment of portable fundus camera photographs,” IEEE T. Med. 219-222, Oct. 2013.
Imaging, vol. 35, no. 4, pp. 1046-1055, Apr. 2016. [25] K. M. He et al., “Guided image filtering,” IEEE T. Pattern Anal., vol. 35,
no. 6, pp. 1397-1409, Jun. 2013.
0018-9294 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
View publication stats