Abstract
The medical field has come a long way in recent years. This fact is directly related to the application of computer science, particularly artificial intelligence. Computer vision is one of its applications with the most significant knowledge transfer to private companies or organizations. Due to the large number of tests based on images, it has multiple benefits in medical diagnosis. These benefits go from health to economics, passing through time savings. Most people know X-rays or scanners, but others have not been applied too much like thermographies. Although they are inexpensive, non-invasive, painless, and easy to implement in remote areas, their scientific evidence is not very extended. In this paper, we evaluate different approaches based on four use cases depending on which treatment we applied to the images. This step leads to various scenarios that could benefit from using advanced hybrid Artificial Intelligence models. Evaluating the solutions will not only provide us with an accurate model. Still, it will also allow us to understand further how the different thermograph information influences the diagnosis. Results show that by separating the thermography by three ranges of temperatures and using a hybrid model of convolutional neural networks and evolutive algorithms, we can achieve accuracy near 94%.



Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Data is openly available in a public repository that does not issue DOIs.
References
Abdalla HEM, Esmail MY (2018) Brain tumor detection by using artificial neural network. 2018 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE), pp 1–6
Abdallah YMY, Alqahtani T (2019) Research in medical imaging using image processing techniques. In Medical Imaging-Principles and Applications. IntechOpen
Afantenos S, Karkaletsis V, Stamatopoulos P (2005) Summarization from medical documents: a survey. Artif Intell Med 33(2):157–177
Ahuja AS (2019) The impact of artificial intelligence in medicine on the future role of the physician. PeerJ 7:e7702
Al Husaini MAS, HadiHabaebi M, Gunawan TS, Islam MR (2021) Self-detection of early breast cancer application with infrared camera and deep learning. Electronics 10(20):2538
Alshehri A, AlSaeed D (2023) Breast cancer diagnosis in thermography using pre-trained vgg16 with deep attention mechanisms. Symmetry 15(3):582
Bayomi N, Nagpal S, Rakha T, Fernandez JE (2021) Building envelope modeling calibration using aerial thermography. Energy Build 233:110648
Belkin M, Hsu D, Ma S, Mandal S (2019) Reconciling modern machine-learning practice and the classical bias–variance trade-off. Proc Natl Acad Sci 116(32):15849–15854
Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(2)
Chebbah NK, Ouslim M, Benabid S (2023) New computer aided diagnostic system using deep neural network and SVM to detect breast cancer in thermography. Quant InfraRed Thermogr J 20(2):62–77
Daoud H, Bayoumi MA (2019) Efficient epileptic seizure prediction based on deep learning. IEEE Trans Biomed Circuits Syst 13(5):804–813
Domino M, Borowska M, Kozłowska N, Zdrojkowski Ł, Jasiński T, Smyth G, Maśko M (2021) Advances in thermal image analysis for the detection of pregnancy in horses using infrared thermography. Sensors 22(1):191
Egwom OJ, Hassan M, Tanimu JJ, Hamada M, Ogar OM (2022) An LDA–SVM machine learning model for breast cancer classification. BioMedInformatics 2(3):345–358
Ensafi M, Keyvanpour MR, Shojaedini SV (2022) A New method for promote the performance of deep learning paradigm in diagnosing breast cancer: improving role of fusing multiple views of thermography images. Heal Technol 12(6):1097–1107
Farooq S, Del-Valle M, Dos Santos MO, Dos Santos SN, Bernardes ES, Zezell DM (2023) Rapid identification of breast cancer subtypes using micro-FTIR and machine learning methods. Appl Opt 62(8):C80–C87
Fusco R, Piccirillo A, Sansone M, Granata V, Rubulotta MR, Petrosino T, Barretta ML, Vallone P, Di Giacomo R, Esposito E et al (2021) Radiomics and artificial intelligence analysis with textural metrics extracted by contrast-enhanced mammography in the breast lesions classification. Diagnostics 11(5):815
Ghafarpour A, Zare I, Zadeh HG, Haddadnia J, Zadeh FJS, Zadeh ZE, Kianersi S, Masoumzadeh S, Nour S (2016) A review of the dedicated studies to breast cancer diagnosis by thermal imaging in the fields of medical and artificial intelligence sciences. Biomed Res 27(2):543–552
Gogoi UR, Majumdar G, Bhowmik MK, Ghosh AK (2019) Evaluating the efficiency of infrared breast thermography for early breast cancer risk prediction in asymptomatic population. Infrared Phys Techn 99:201–211
Hawkes PW (2004) Advances in imaging and electron physics. Elsevier
Hofvind S, Ponti A, Patnick J, Ascunce N, Njor S, Broeders M, Giordano L, Frigerio A, Törnberg S (2012) False-positive results in mammographic screening for breast cancer in Europe: a literature review and survey of service screening programmes. J Med Screen 19(1_suppl):57–66
Houssein EH, Emam MM, Ali AA (2021) An efficient multilevel thresholding segmentation method for thermography breast cancer imaging based on improved chimp optimization algorithm. Expert Syst Appl 185:115651
Huang TS et al (1996) Computer vision: Evolution and promise. cern european organization for nuclear Research-reports-CERN, pp 21–26
Jasti N, Bista S, Bhargav H, Sinha S, Gupta S, Chaturvedi SK, Gangadhar BN (2019) Medical applications of Infrared thermography: A narrative review. J Stem Cells 14(1):35–53
Ji Y, Li H, Edwards AV, Papaioannou J, Ma W, Liu P, Giger ML (2019) Independent validation of machine learning in diagnosing breast Cancer on magnetic resonance imaging within a single institution. Cancer Imaging 19(1):1–11
Jiang Y, Edwards AV, Newstead GM (2021) Artificial intelligence applied to breast MRI for improved diagnosis. Radiology 298(1):38–46
Kadhim RR, Kamil MY (2023) Comparison of machine learning models for breast cancer diagnosis. IAES Int J Artif Intell 12(1):415
Kakileti ST, Madhu HJ, Krishnan L, Manjunath G, Sampangi S, Ramprakash HV (2020) Observational study to evaluate the clinical efficacy of Thermalytix for detecting breast cancer in symptomatic and asymptomatic women. JCO Glob Oncol 6:1472–1480
Keyserlingk JR, Ahlgren PD, Yu E, Belliveau N, Yassa M (2000) Functional infrared imaging of the breast. IEEE Eng Med Biol Mag 19(3):30–41
Khan AA, Arora AS (2021) Thermography as an economical alternative modality to mammography for early detection of breast cancer. J Healthc Eng 2021
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105
Lahane SR, Chavan N, Madankar M (2021) Classification of thermographic images for breast cancer detection based on deep learning. Ann Rom Soc Cell Biol 25(6):3459–3466
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444
LeCun Y, Boser B, Denker J, Henderson D, Howard R, Hubbard W, Jackel L (1989) Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems, 2
Lee Y, Kwon J, Lee Y, Park H, Cho H, Park J (2018) Deep learning in the medical domain: predicting cardiac arrest using deep learning. Acute and Critical Care 33(3):117
Ma J, Shang P, Lu C, Meraghni S, Benaggoune K, Zuluaga J, Zerhouni N, Devalland C, Al Masry Z (2019) A portable breast cancer detection system based on smartphone with infrared camera. Vibroengineering PROCEDIA 26:57–63
Morales-Cervantes A, Kolosovas-Machuca ES, Guevara E, Reducindo MM, Hernández ABB, Garc\’\ia MR, González FJ (2018) An automated method for the evaluation of breast cancer using infrared thermography. EXCLI J 17:989
Nogales A, Pérez-Lara F, Morales J, García-Tejedor ÁJ (2023) How Do Thermography Colors Influence Breast Cancer Diagnosis? A Hybrid Model of Convolutional Networks with a Weighted Average Evolutionary Algorithm. In: Arai K (ed) Intelligent Systems and Applications. IntelliSys 2022. Lecture Notes in Networks and Systems, vol 543. Springer, Cham. https://doi.org/10.1007/978-3-031-16078-3_17
Park HJ, Kim SM, La Yun B, Jang M, Kim B, Jang JY, Lee JY, Lee SH (2019) A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of breast masses on ultrasound: added value for the inexperienced breast radiologist. Medicine 98(3)
Pavithra PR, Ravichandran KS, Sekar KR, Manikandan R (2018) The effect of thermography on breast cancer detection. Syst Rev Pharm 9(1):10–16
Petrillo A, Fusco R, Di Bernardo E, Petrosino T, Barretta ML, Porto A, Granata V, Di Bonito M, Fanizzi A, Massafra R et al (2022) Prediction of breast cancer histological outcome by radiomics and artificial intelligence analysis in contrast-enhanced mammography. Cancers 14(9):2132
Raghupathi W, Raghupathi V (2014) Big data analytics in healthcare: promise and potential. Health Inform Sci Syst 2(1):1–10
Rim B, Sung N-J, Min S, Hong M (2020) Deep learning in physiological signal data: A survey. Sensors 20(4):969
Roslidar R, Rahman A, Muharar R, Syahputra MR, Arnia F, Syukri M, Pradhan B, Munadi K (2020) A review on recent progress in thermal imaging and deep learning approaches for breast cancer detection. IEEE Access 8:116176–116194
Russell SJ, Norvig P (2016) Artificial intelligence: a modern approach. Pearson Education Limited London, UK, Malaysia
Sánchez-Cauce R, Pérez-Mart\’\in J, Luque M (2021) Multi-input convolutional neural network for breast cancer detection using thermal images and clinical data. Comput Methods Prog Biomed 204:106045
de Santana MA, Pereira JMS, da Silva FL, de Lima NM, de Sousa FN, de Arruda GMS, de CF de Lima R, da Silva WWA, do Santos WP (2018) Breast cancer diagnosis based on mammary thermography and extreme learning machines. Res Biomed Eng 34:45–53
Sathish D, Kamath S, Prasad K, Kadavigere R (2019) Role of normalization of breast thermogram images and automatic classification of breast cancer. Vis Comput 35(1):57–70
Saurkar AV, Pathare KG, Gode SA (2018) An overview on web scraping techniques and tools. Int J Future Revolut Comp Sci Commun Eng 4(4):363–367
Seo H (2021) Infrared thermography for detecting cracks in pillar models with different reinforcing systems. Tunn Undergr Space Technol 116:104118
Silva LF, Saade DCM, Sequeiros GO, Silva AC, Paiva AC, Bravo RS, Conci A (2014) A new database for breast research with infrared image. J Med Imaging Health Inform 4(1):92–100
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, ..., Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9)
Kakileti ST, Manjunath G, Madhu H, Lakshmi Krishnan HVR (2022) A Systematic Study to Evaluate the Benefit of using a Visualization Tool for Breast Thermography. Thermol Int 31(2):53–61
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Tello-Mijares S, Woo F, Flores F (2019) Breast cancer identification via thermography image segmentation with a gradient vector flow and a convolutional neural network. J Healthc Eng, 2019
Wiley V, Lucas T (2018) Computer vision and image processing: a paper review. Int J Artif Intell Res 2(1):29–36
Wu T, Sultan LR, Tian J, Cary TW, Sehgal CM (2019) Machine learning for diagnostic ultrasound of triple-negative breast cancer. Breast Cancer Res Treat 173(2):365–373
Zuluaga-Gomez J, Al Masry Z, Benaggoune K, Meraghni S, Zerhouni N (2021) A CNN-based methodology for breast cancer diagnosis using thermal images. Comput Methods Biomech Biomed Eng: Imaging Vis 9(2):131–145
Acknowledgements
The work leading to these results has received funding from the “Programa estatal de generación de conocimiento y fortalecimiento científico y tecnológico del sistema de I+D+i”, in the context of the project “Cribado coste-efectivo de cáncer de mama mediante mamografía, ecografía y termografía” (PID2019-110686RB-I00).
We also want to thank Avanade Ibérica for providing a scholarship under the Avanade-UFV Artificial Intelligence Chair agreement.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Nogales, A., Pérez-Lara, F. & García-Tejedor, Á.J. Enhancing breast cancer diagnosis with deep learning and evolutionary algorithms: A comparison of approaches using different thermographic imaging treatments. Multimed Tools Appl 83, 42955–42971 (2024). https://doi.org/10.1007/s11042-023-17281-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17281-x