Abstract
Spine surgery is nowadays performed for a great number of spine pathologies; it is estimated that 4.83 million surgeries are carried out globally each year. This prevalence led to an evolution of spine surgery into an extremely specialized field, so that traditional open interventions to the spine were integrated and often replaced by minimally invasive approaches. Despite the several benefits associated to robotic minimally invasive surgeries (RMIS), loss of depth perception, reduced field of view and consequent difficulty in intraoperative identification of relevant anatomical structures are still unsolved issues. For these reasons, Augmented Reality (AR) was introduced to support the surgeon in surgical applications. However, even though the irruption of AR has promised breakthrough changes in surgery, its adoption was slower than expected as there are still usability hurdles. The objective of this work is to introduce a client software with marker-based optical tracking capabilities, included into a client-server architecture that uses protocols to enable real-time streaming over the network, providing desktop rendering power to the head mounted display (HMD). Results relative to the tracking are promising (Specificity = 0.98 ± 0.03; Precision = 0.94 ± 0.04; Dice = 0.80 ± 0.07) as well as real-time communication, which was successfully set.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
References
Bernhardt, S., Nicolau, S.A., Soler, L., Doignon, C.: The status of augmented reality in laparoscopic surgery as of 2016. Med. Image Anal. 37, 66–90 (2017)
Bertelsen, Á., et al.: Collaborative robots for surgical applications. In: Ollero, A., Sanfeliu, A., Montano, L., Lau, N., Cardeira, C. (eds.) ROBOT 2017. AISC, vol. 694, pp. 524–535. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-70836-2_43
Bradski, G., Kaehler, A.: Camera models and calibration, Chapter 11, pp. 370–403. O’REILLY Media (2008)
Christiansen, M.: Adobe After Effects CC Visual Effects and Compositing Studio Techniques. Adobe Press, San Francisco (2013)
De Paolis, L.T., Aloisio, G.: Augmented reality in minimally invasive surgery. In: Mukhopadhyay, S.C., Lay-Ekuakille, A. (eds.) Advances in Biomedical Sensing, Measurements, Instrumentation and Systems. LNEE, vol. 55, pp. 305–320. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-05167-8_17
Fiani, B., et al.: Impact of robot-assisted spine surgery on health care quality and neurosurgical economics: a systemic review. Neurosurg. Rev. 43(1), 17–25 (2018)
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Marín-Jiménez, M.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Medina-Carnicer, R.: Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recogn. 51, 481–491 (2016)
Kunz, C., Genten, V., Meissner, P., Hein, B.: Metric-based evaluation of fiducial markers for medical procedures. In: Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling (2019)
Kwoh, Y., Hou, J., Jonckheere, E., Hayati, S.: A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery. IEEE Trans. Biomed. Eng. 35(2), 153–160 (1988)
Lau, D., Han, S.J., Lee, J.G., Lu, D.C., Chou, D.: Minimally invasive compared to open microdiscectomy for lumbar disc herniation. J. Clin. Neurosci. 18(1), 81–84 (2011)
Moccia, S., et al.: Toward improving safety in neurosurgery with an active handheld instrument. Ann. Biomed. Eng. 46(10), 1450–1464 (2018)
Romero-Ramirez, F.J., Muñoz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38–47 (2018)
Sagitov, A., Shabalina, K., Lavrenov, R., Magid, E.: Comparing fiducial marker systems in the presence of occlusion. In: 2017 International Conference on Mechanical, System and Control Engineering (ICMSC) (2017)
Salzmann, S.N., et al.: Cervical spinal fusion: 16-year trends in epidemiology, indications, and in-hospital outcomes by surgical approach. World Neurosurg. 113, e280–e295 (2018)
Schwender, J., Holly, L., Transfeldt, E.: Minimally Invasive Posterior Surgical Approaches to the Lumbar Spine, 5th edn. Saunders/Elsevier, London (2006)
Syed, O.N., Foley, K.T.: History and Evolution of Minimally Invasive Spine Surgery. In: Phillips, F.M., Lieberman, I.H., Polly, D.W. (eds.) Minimally Invasive Spine Surgery. AISC, pp. 3–13. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-5674-2_1
Taha, A.A., Hanbury, A.: Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med. Imaging 15(1), 29 (2015)
Tandon, M.: Spinal surgery, Chapter 24, pp. 399–439. Hemanshu Prabhakar (2017)
Topcu, O., Karakayali, F., Kuzu, M., Aras, N.: Comparison of long-term quality of life after laparoscopic and open cholecystectomy. Surg. Endosc. 17(2), 291–295 (2003)
Vadalà, G., De Salvatore, S., Ambrosio, L., Russo, F., Papalia, R., Denaro, V.: Robotic spine surgery and augmented reality systems: a state of the art. Neurospine 17(1), 88–100 (2020)
Vávra, P., et al.: Recent development of augmented reality in surgery: a review. J. Healthcare Eng. 2017, 1–9 (2017). https://doi.org/10.1155/2017/4574172. Article ID 4574172
Yoo, J.S., Patel, D.S., Hrynewycz, N.M., Brundage, T.S., Singh, K.: The utility of virtual reality and augmented reality in spine surgery. Ann. Transl. Med. 7(S5), S171 (2019)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Zou, K.H., et al.: Statistical validation of image segmentation quality based on a spatial overlap index. Acad. Radiol. 11(2), 178–189 (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Villani, F.P., Di Cosmo, M., Simonetti, Á., Frontoni, E., Moccia, S. (2021). Development of an Augmented Reality System Based on Marker Tracking for Robotic Assisted Minimally Invasive Spine Surgery. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12661. Springer, Cham. https://doi.org/10.1007/978-3-030-68763-2_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-68763-2_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68762-5
Online ISBN: 978-3-030-68763-2
eBook Packages: Computer ScienceComputer Science (R0)
