Abstract
As the COVID-19 pandemic threatens to overwhelm healthcare systems across the world, there is a need for reducing the burden on medical staff via automated systems for patient screening. Given the limited availability of testing kits with long turn-around test times and the exponentially increasing number of COVID-19 positive cases, X-rays offer an additional cheap and fast modality for screening COVID-19 positive patients, especially for patients exhibiting respiratory symptoms. In this paper, we propose a solution based on a combination of deep learning and radiomic features for assisting radiologists during the diagnosis of COVID-19. The proposed system of CovidDiagnosis takes a chest X-ray image and passes it through a pipeline comprising of a model for lung isolation, followed by classification of the lung regions into four disease classes, namely Healthy, Pneumonia, Tuberculosis and COVID-19. To assist our classification framework, we employ embeddings of disease symptoms produced by the CheXNet network by creating an ensemble. The proposed approach gives remarkable classification results on publicly available datasets of chest X-rays. Additionally, the system produces visualization maps which highlight the symptoms responsible for producing the classification decisions. This provides trustworthy and interpretable decisions to radiologists for the clinical deployment of CovidDiagnosis. Further, we calibrate our network using temperature scaling to give confidence scores which are representative of true correctness likelihood.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Lungs-Finder: https://github.com/xiaoyongzhu/lungs-finder.
References
Alom, M.Z., Yakopcic, C., Taha, T.M., Asari, V.K.: Nuclei segmentation with recurrent residual convolutional neural networks based u-net (r2u-net). In: NAECON 2018 - IEEE National Aerospace and Electronics Conference, pp. 228–233, July 2018. https://doi.org/10.1109/NAECON.2018.8556686
Asnaoui, K.E., Chawki, Y.: Using x-ray images and deep learning for automated detection of coronavirus disease. J. Biomolecular Structure Dyn. 1–12 (2020). https://doi.org/10.1080/07391102.2020.1767212
Basu, S., Mitra, S., Saha, N.: Deep learning for screening covid-19 using chest x-ray images. arXiv (2020), https://arxiv.org/abs/2004.10507
Bernheim, A., et al.: Chest ct findings in coronavirus disease-19 (covid-19): relationship to duration of infection. Radiology (2020). https://pubs.rsna.org/doi/10.1148/radiol.2020200463
Chen, S., Ma, K., Zheng, Y.: Med3d: Transfer learning for 3d medical image analysis. ArXiv abs/1904.00625 (2019)
Cohen, J.P., Morrison, P., Dao, L., Roth, K., Duong, T.Q., Ghassemi, M.: Covid-19 image data collection: Prospective predictions are the future. arXiv 2006.11988 (2020). https://github.com/ieee8023/covid-chestxray-dataset
Emery, S.L., et al.: Real-time reverse transcription-polymerase chain reaction assay for sars-associated coronavirus. Emerging Infectious Diseases (2004). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3322901/
Gozes, O., et al.: Rapid AI development cycle for the coronavirus (covid-19) pandemic: initial results for automated detection & patient monitoring using deep learning ct image analysis (2020)
Guo, C., Pleiss, G., Sun, Y., Weinberger, K.Q.: On calibration of modern neural networks. In: Proceedings of the 34th International Conference on Machine Learning, vol. 70. pp. 1321–1330. ICML 2017, JMLR.org (2017)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261–2269 (2017)
Irvin, J., et al.: Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. CoRR abs/1901.07031 (2019). http://arxiv.org/abs/1901.07031
Jaeger, S., Candemir, S., Antani, S., Wáng, Y.X.J., Lu, P.X., Thoma, G.: Two public chest x-ray datasets for computer-aided screening of pulmonary diseases. Quantitative Imag. Med. Surgery 4(6), 475 (2014)
Kong, W., Agarwal, P.P.: Chest imaging appearance of covid-19 infection. Radiology (2020). https://pubs.rsna.org/doi/10.1148/ryct.2020200028
Kumar, P., Grewal, M., Srivastava, M.M.: Boosted cascaded convnets for multilabel classification of thoracic diseases in chest radiographs. In: Campilho, A., Karray, F., ter Haar Romeny, B. (eds.) Image Analysis and Recognition, pp. 546–552. Springer, Cham (2018)
Lan, L., Xu, D., Ye, G., Xia, C., Wang, S., Li, Y., Xu, H.: Positive RT-PCR test results in patients recovered from COVID-19. JAMA 323(15), 1502–1503 (2020). https://doi.org/10.1001/jama.2020.2783
Lee, E.Y.P., Ng, M.Y., Khong, P.L.: COVID-19 pneumonia: what has CT taught us? The Lancet Infectious Diseases 20(4), 384–385 (2020). http://www.sciencedirect.com/science/article/pii/S1473309920301341
Long, C., et al.: Diagnosis of the coronavirus disease (covid-19): RRT-PCR or CT? Euro. J. Radiol. 126, 108961 (2020). http://www.sciencedirect.com/science/article/pii/S0720048X20301509
Mangal, A., Kalia, S., Rajgopal, H., Rangarajan, K., Namboodiri, V., Banerjee, S., Arora, C.: Covidaid: COVID-19 detection using chest x-ray (2020)
Oktay, O., et al.: Attention u-net: learning where to look for the pancreas. CoRR abs/1804.03999 (2018). http://arxiv.org/abs/1804.03999
Eng Pan, Ye, T., et al.: Time course of lung changes at chest ct during recovery from coronavirus disease 2019 (COVID-19). Radiology (2020). https://doi.org/10.1148/radiol.2020200370
Rajpurkar, P., et al.: Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning. CoRR abs/1711.05225 (2017). http://arxiv.org/abs/1711.05225
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626 (2017)
Ozturk, T., et al.: Automated detection of COVID-19 cases using deep neural networks with x-ray images. Comput. Biol. Med. (2020). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7187882/
Tang, Y., Tang, Y., Xiao, J., Summers, R.M.: Xlsor: A robust and accurate lung segmentor on chest x-rays using criss-cross attention and customized radiorealistic abnormalities generation. In: MIDL (2019)
Toğaçar, M., Ergen, B., Cömert, Z.: Covid-19 detection using deep learning models to exploit social mimic optimization and structured chest x-ray images using fuzzy color and stacking approaches. Comput. Biol. Med. 121, 103805 (2020). http://www.sciencedirect.com/science/article/pii/S0010482520301736
Wang, L., Wong, A.: Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images (2020)
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M.: Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2097–2106 (2017)
Xie, X., Zhong, Z., Zhao, W., Zheng, C., Wang, F., Liu, J.: Chest ct for typical 2019-ncov pneumonia: relationship to negative rt-pcr testing. Radiology (2020). https://pubs.rsna.org/doi/10.1148/radiol.2020200343
Yi, X., Walia, E., Babyn, P.: Generative adversarial network in medical imaging: a review. Med. Image Anal. 58, 101552 (2019). http://www.sciencedirect.com/science/article/pii/S1361841518308430
Zu, Z.Y., Jiang, M.D., Xu, P.P., Chen, W., Ni, Q.Q., Lu, G.M., Zhang, L.J.: Coronavirus disease 2019 (covid-19): a perspective from china. Radiology (2020). https://pubs.rsna.org/doi/10.1148/radiol.2020200490
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Mahajan, K. et al. (2020). CovidDiagnosis: Deep Diagnosis of COVID-19 Patients Using Chest X-Rays. In: Petersen, J., et al. Thoracic Image Analysis. TIA 2020. Lecture Notes in Computer Science(), vol 12502. Springer, Cham. https://doi.org/10.1007/978-3-030-62469-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-62469-9_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62468-2
Online ISBN: 978-3-030-62469-9
eBook Packages: Computer ScienceComputer Science (R0)
