Abstract
The previous illumination invariant measure performs unsatisfactorily under severe illumination variations, since severe illumination variations cause large differences of illumination intensities in the face local region, especially for the edge of cast shadows. In this paper, we conduct orthogonal triangular with column pivoting (QRCP) decomposition in the \(N\times N\) local block which generates N QRCP coefficients. QRCP unit is defined as the quotient of the largest QRCP coefficient and the sum of all QRCP coefficients in the local block. To further control the illumination effect, we obtain corrected QRCP unit by calculating the \(\gamma \) power of QRCP coefficients. We define QRCP Image as the combination of corrected QRCP units. Finally, QRCP Image is employed as a preprocessing method of illumination invariant measures (LNN-face/BGIR-face/EGIR-face). The experimental results on the illumination-varying face databases (Extended Yale B and CMU PIE) indicate that the proposed method is efficient to tackle severe illumination variations.
Similar content being viewed by others
Data availability
We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work.
References
Akbari, A., Awais, M., Feng, Z.-H., Farooq, A., Kittler, J.: Distribution cognisant loss for cross-database facial age estimation with sensitivity analysis. IEEE Trans. Pattern Anal. Mach. Intell. 44(4), 1869–1887 (2022)
Al-Obaydy, W.N.I., Suandi, S.A.: Automatic pose normalization for open-set single-sample face recognition in video surveillance. Multimed. Tools Appl. 79(3), 2897–2915 (2020)
Lin, J., Xiao, L., Wu, T., Bian, W.: Image set-based face recognition using pose estimation with facial landmarks. Multimed. Tools Appl. 79(27), 19493–19507 (2020)
Maheswari, V.U., Varaprasad, G., Raju, S.V.: Local directional maximum edge patterns for facial expression recognition. J. Ambient. Intell. Humaniz. Comput. 12(5), 4775–4783 (2021)
Sanodiya, R.K., Kumar, P., Tiwari, M., Yao, L., Mathew, J.: A modified joint geometrical and statistical alignment approach for low-resolution face recognition. In: International Conference on Neural Information Processing, pp. 88–100. Springer (2020)
Khalid, S.S., Awais, M., Feng, Z.-H., Chan, C.-H., Farooq, A., Akbari, A., Kittler, J.: Resolution invariant face recognition using a distillation approach. IEEE Trans. Biometr. Behav. Identity Sci. 2(4), 410–420 (2020)
Xie, X., Lam, K.-M.: Face recognition under varying illumination based on a 2d face shape model. Pattern Recognit. 38(2), 221–230 (2005)
Choudhary, P., Mannar, S., Kumar, A., Son, M.: Real-time face relighting via adaptive normal mapping. In: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, pp. 1–6 (2017)
Choi, S.-I., Lee, Y., Lee, M.: Face recognition in SSPP problem using face relighting based on coupled bilinear model. Sensors 19(1), 43 (2019)
Nestmeyer, T., Lalonde, J.-F., Matthews, I., Lehrmann, A.: Learning physics-guided face relighting under directional light. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5124–5133 (2020)
Chen, T., Yin, W., Zhou, X.S., Comaniciu, D., Huang, T.S.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1519–1524 (2006)
Hu, C., Lu, X., Ye, M., Zeng, W.: Singular value decomposition and local near neighbors for face recognition under varying illumination. Pattern Recognit. 64, 60–83 (2017)
Hu, C.-H., Lu, X.-B., Liu, P., Jing, X.-Y., Yue, D.: Single sample face recognition under varying illumination via GRCP decomposition. IEEE Trans. Image Process. 28(5), 2624–2638 (2018)
Vishwakarma, V.P., Dalal, S.: A novel non-linear modifier for adaptive illumination normalization for robust face recognition. Multimed. Tools Appl. 79(17), 11503–11529 (2020)
Zhang, T., Tang, Y.Y., Fang, B., Shang, Z., Liu, X.: Face recognition under varying illumination using gradient faces. IEEE Trans. Image Process. 18(11), 2599–2606 (2009)
Wang, B., Li, W., Yang, W., Liao, Q.: Illumination normalization based on weber’s law with application to face recognition. IEEE Signal Process. Lett. 18(8), 462–465 (2011)
Yang, W., Zhang, X., Li, J.: A local multiple patterns feature descriptor for face recognition. Neurocomputing 373, 109–122 (2020)
Hu, C.-H., Zhang, Y., Wu, F., Lu, X.-B., Liu, P., Jing, X.-Y.: Toward driver face recognition in the intelligent traffic monitoring systems. IEEE Trans. Intell. Transp. Syst. 21(12), 4958–4971 (2019)
Hu, C., Wu, F., Yu, J., Jing, X., Lu, X., Liu, P.: Diagonal symmetric pattern-based illumination invariant measure for severe illumination variation face recognition. IEEE Access 8, 63202–63213 (2020)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition (2015)
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., Liu, W.: Cosface: Large margin cosine loss for deep face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5265–5274 (2018)
Deng, J., Guo, J., Xue, N., Zafeiriou, S.: Arcface: Additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4690–4699 (2019)
Oren, M., Nayar, S.K.: Generalization of the lambertian model and implications for machine vision. Int. J. Comput. Vis. 14(3), 227–251 (1995)
Stander, J., Mech, R., Ostermann, J.: Detection of moving cast shadows for object segmentation. IEEE Trans. Multimed. 1(1), 65–76 (1999)
Zhang, W., Fang, X.Z., Xu, Y.: Detection of moving cast shadows using image orthogonal transform. In: 18th International Conference on Pattern Recognition (ICPR’06), vol. 1, pp. 626–629. IEEE (2006)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)
Sim, T., Baker, S., Bsat, M.: The cmu pose, illumination, and expression (PIE) database. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp. 53–58. IEEE (2002)
Gonzalez, R.C., Woods, R.E.: Digital image processing. IEEE Trans. Acoust. Speech Signal Process. 28(4), 484–486 (1980)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 61802203, in part by the China Postdoctoral Science Foundation under Grant 2019M651653, in part by the Postdoctoral Research Funding Program of Jiangsu Province under Grant 2019K124, and in part by the Natural Science Foundation of Nanjing University of Posts and Telecommunications under Grant NY221081.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Feng-Yao, L., Chang-Hui, H. & Yu, L. QRCP-based preprocessing for illumination invariant measure under severe illumination variations. SIViP 17, 753–760 (2023). https://doi.org/10.1007/s11760-022-02283-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02283-3