Abstract
The industrial robot eye-in-hand calibration has been a hot research topic for a long time. When the RGB-D camera is mounted on the end-effector of the robot, the pose of object can be obtained by the camera, then the pose transformation from camera coordinate system to robot coordinate system is realized by the hand-eye transformation matrix. Traditional marker-based calibration methods are so complex to operate and time-costing that are not suitable for actual application in industrial field. In this paper, with the aim of reducing the calibration complexity and time, a novel eye-in-hand calibration method based on scene feature is proposed. At First, the image sequence obtained by small motion of camera is processed by ORB feature extraction and Bundle Adjustment (BA), and the camera intrinsic parameters are solved. Then, ORB feature and Perspective-n-Point (PnP) is used to solve pose transformation between multi-view images, followed by BA optimization. Finally, the hand-eye transformation matrix is obtained by solving the corresponding relations between pose transformations of multi-view images and pose transformations of the robot. Since our method needs no man-made marker, it is thought as an auto calibration method and can be done many times during the operation process. Experiments show that compared with existing calibration methods, our method is simple, fast with high accuracy and more suitable for industrial application.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11), 1330–1334.
Mendonca, Paulo, R. S., & Cipolla, R. (1999). A simple technique for self-calibration. In IEEE Computer Society Conference on Computer Vision & Pattern Recognition. IEEE (pp. 500–505).
Anthony, W., & Gerhard, R. (2004). Estimating intrinsic camera parameters from the fundamental matrix using an evolutionary approach. Eurasip Journal on Advances in Signal Processing, 2004(8), 1–12.
Tsai, R. Y., & Lenz, R. K. (2002). A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation, 5(3), 345–358.
Triggs B. (1999). Bundle adjustment—A modern synthesis. In Proceedings of the International Workshop on Vision Algorithms: Theory and Practice. Springer (pp. 298–372).
Ha, H., Im, S., Park, J., et al. (2016). High-quality depth from uncalibrated small motion clip. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (pp. 5413–5421).
Yu, F., & Gallup, D. (2014). 3D reconstruction from accidental motion. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (pp. 3986–3993).
Rublee, E., Rabaud, V., Konolige, K., et al. (2012). ORB: An efficient alternative to SIFT or SURF. In 2011 International Conference on Computer Vision. IEEE (pp. 2564–2571).
Jakubović, A., & Velagić, J. (2018). Image feature matching and object detection using Brute-force matchers. In 2018 International Symposium ELMAR (pp. 83–86).
Agarwal, S., Mierle, K., et al. (2014). Ceres solver. http://ceres-solver.org.
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015). ORB-SLAM: A versatile and accurate monocular SLAM system. IEEE Transactions on Robotics, 31(5), 1147–1163.
Mur-Artal, R., Tardos, J. D. (2017). ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Transactions on Robotics, 1–8.
Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 6(6), 381–395.
Jiang, Z., & Wu, W. (2010). An essential matrix-based camera self-calibration method. Journal of Image and Graphics, 15(4), 565–569.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Xu, G., Yan, Y. (2021). A Scene Feature Based Eye-in-Hand Calibration Method for Industrial Robot. In: Billingsley, J., Brett, P. (eds) Mechatronics and Machine Vision in Practice 4. Springer, Cham. https://doi.org/10.1007/978-3-030-43703-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-43703-9_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-43702-2
Online ISBN: 978-3-030-43703-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)