Abstract
High resolution of supersonic flow fields is very relevant to advancement of supersonic and even hypersonic technology. Deep learning-based flow field super-resolution is a unique and efficient technique of reproducing high resolution of supersonic flow fields of free jet obtained from schlieren visualization. Enhanced super-resolution generative adversarial network (ESRGAN) and real enhanced super-resolution generative adversarial network (RealESRGAN) pretrained based on convolutional neural networks have been applied to enhance the spatial resolution of experimental supersonic flow field imaging by × 4 and × 8 without corresponding high-resolution ground truth images. The training dataset consists of high spatial resolution images acquired from bubble image shadowgraphy experimentation, while the test dataset was low spatial resolution schlieren images of supersonic free jet flow obtained from experiment at different nozzle pressure ratio (NPR) of 3–20. The pretrained networks were then applied to enhance low-resolution schlieren imaging of supersonic jet flow by increasing its spatial resolution via transfer learning with the network pretrained with bubble images and fine-tuned with patches of selected low-resolution schlieren images. The Natural Image Quality Evaluator (NIQE) score (no reference quality) was used to compute the perceptual quality of the super-resolved images without ground truth high-resolution images. The results showed impressive and improved flow field super-resolution with an average NIQE scores of 0.025–0.048 for ESRGAN × 4 and RealESRGAN × 4 and 0.026–0.053 for ESRGAN × 8 and RealESRGAN × 8, respectively.
Graphical abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability statement
The data that support the findings of this study are available upon request from the corresponding author. And the codes are freely available on GitHub: https://github.com/mcekwonu/Blind-Super-Resolution-of-Schlieren-Supersonic-Flows.
References
Beneddine S, Mettot C, Sipp D (2015) Global stability analysis of underexpanded screeching jets. Eur J Mech B Fluids 49:392–399. https://doi.org/10.1016/j.euromechflu.2014.05.006
Castelain T, Gojon R, Mercier B, Bogey C (2016). Estimation of convection speed in underexpanded jets from schlieren pictures. In: 22nd AIAA/CEAS Aeroacoustics Conference, Aeroacoustics Conferences. American Institute of Aeronautics and Astronautics. doi:https://doi.org/10.2514/6.2016-2984
Chin C, Li M, Harkin C, Rochwerger T, Chan L, Ooi A, Risborg A, Soria J (2013) Investigation of the flow structures in supersonic free and impinging jet flows. J Fluids Eng. https://doi.org/10.1115/1.4023190
Deng Z, He C, Liu Y, Kim KC (2019) Super-resolution reconstruction of turbulent velocity fields using a generative adversarial network-based artificial intelligence framework. Phys Fluids 31:125111. https://doi.org/10.1063/1.5127031
Ekwonu MC, Kim KC (2021) Visualization of foam formation from vertically free-falling impinging water jet. J vis 24:9–17. https://doi.org/10.1007/s12650-020-00693-4
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger KQ (Eds.), Advances in Neural Information Processing Systems. Curran Associates, Inc.
Kong C, Chang J, Wang Z, Li Y, Bao W (2021) Data-driven super-resolution reconstruction of supersonic flow field by convolutional neural networks. AIP Adv 11:065321. https://doi.org/10.1063/5.0056569
Mitchell DM, Honnery DR, Soria J (2012) The visualization of the acoustic feedback loop in impinging underexpanded supersonic jet flows using ultra-high frame rate schlieren. J vis 15:333–341. https://doi.org/10.1007/s12650-012-0139-9
Mittal A, Soundararajan R, Bovik AC (2013) Making a “Completely Blind” image quality analyzer. IEEE Signal Process Lett 20:209–212. https://doi.org/10.1109/LSP.2012.2227726
Panda J, Seasholtz RG (1999) Measurement of shock structure and shock–vortex interaction in underexpanded jets using Rayleigh scattering. Phys Fluids 11:3761–3777. https://doi.org/10.1063/1.870247
Samsam-Khayani H, Chen B, Kim M, Kim KC (2022) Visualization of supersonic free jet flow structures subjected to various temperature and pressure ratio conditions. Optics Lasers Eng 158:107144. https://doi.org/10.1016/j.optlaseng.2022.107144
Samsam-Khayani H (2021) Numerical and Experimental Study on Low-Temperature Supersonic Ejectors for Boil Off Gas Removal (PhD Thesis). Pusan National University, Busan
Schardin H (1970) Schlieren methods and their applications (Technical report No. 197015). National Technical Reports Library, Berlin
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. doi:https://doi.org/10.48550/ARXIV.1409.1556. arXiv preprint arXiv:1409.1556.
Taylor HG, Waldram JM (1933) Improvements in the Schlieren method. J Sci Instrum 10:378–389. https://doi.org/10.1088/0950-7671/10/12/304
Vasu S, Madam NT, NRA (2018) Analyzing perception-distortion tradeoff using enhanced perceptual super-resolution network. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops 2018. doi:https://doi.org/10.48550/ARXIV.1811.00344
Wang Z, Li X, Liu L, Wu X, Hao P, Zhang X, He F (2022) Deep-learning-based super-resolution reconstruction of high-speed imaging in fluids. Phys Fluids 34:037107. https://doi.org/10.1063/5.0078644
Wang X, Yu K, Wu S, Gu, J, Liu Y, Dong C, Loy CC, Qiao Y, Tang X (2018) ESRGAN: enhanced super-resolution generative adversarial networks. arXiv:1809.00219 [cs]
Wang X, Xie L, Dong C, Shan Y (2021) Real-ESRGAN: training real-world blind super-resolution with pure synthetic data. arXiv:2107.10833 [cs, eess]
Willert CE, Mitchell DM, Soria J (2012) An assessment of high-power light-emitting diodes for high frame rate schlieren imaging. Exp Fluids 53:413–421. https://doi.org/10.1007/s00348-012-1297-1
Acknowledgements
This work was partly supported by Korea Institute of Energy Technology Evaluation and Planning (KETEP) grant funded by the Korea government (MOTIE) (20224000000440) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (2021R1C1C2011538).
Funding
Korea Institute of Energy Technology Evaluation and Planning, 20224000000440, Dong Kim; National Research Foundation of Korea, 2021R1C1C2011538, Dong Kim.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ekwonu, M.C., Zhang, S., Chen, B. et al. Super-resolution reconstruction of schlieren images of supersonic free jets based on machine learning with bubble shadowgraphy data. J Vis 26, 1085–1099 (2023). https://doi.org/10.1007/s12650-023-00926-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-023-00926-2