Abstract
Background
Motion analysis parameters (MAPs) have been extensively validated for assessment of minimally invasive surgical skills. However, there are discrepancies on how specific MAPs, tasks, and skills match with each other, reflecting that motion analysis cannot be generalized independently of the learning outcomes of a task. Additionally, there is a lack of knowledge on the meaning of motion analysis in terms of surgical skills, making difficult the provision of meaningful, didactic feedback. In this study, new higher significance MAPs (HSMAPs) are proposed, validated, and discussed for the assessment of technical skills in box trainers, based on principal component analysis (PCA).
Methods
Motion analysis data were collected from 25 volunteers performing three box trainer tasks (peg grasping/PG, pattern cutting/PC, knot suturing/KS) using the EVA tracking system. PCA was applied on 10 MAPs for each task and hand. Principal components were trimmed to those accounting for an explained variance > 80% to define the HSMAPs. Individual contributions of MAPs to HSMAPs were obtained by loading analysis and varimax rotation. Construct validity of the new HSMAPs was carried out at two levels of experience based on number of surgeries.
Results
Three new HSMAPs per hand were defined for PG and PC tasks, and two per hand for KS task. PG presented validity for HSMAPs related to insecurity and economy of space. PC showed validity for HSMAPs related to cutting efficacy, peripheral unawareness, and confidence. Finally, KS presented validity for HSMAPs related with economy of space and knotting security.
Conclusions
PCA-defined HSMAPs can be used for technical skills’ assessment. Construct validation and expert knowledge can be combined to infer how competences are acquired in box trainer tasks. These findings can be exploited to provide residents with meaningful feedback on performance. Future works will compare the new HSMAPs with valid scoring systems such as GOALS.


Similar content being viewed by others
References
Sánchez-Margallo JA, Sánchez-Margallo FM, Oropesa I, Enciso S, Gómez EJ (2017) Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing. Int J Comput Assist Radiol Surg 12:307–314. https://doi.org/10.1007/s11548-016-1459-3
van Hove PD, Tuijthof GJM, Verdaasdonk EGG, Stassen LPS, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987. https://doi.org/10.1002/bjs.7115
Partridge RW, Brown FS, Brennan PM, Hennessey IAM, Hughes MA (2016) The LEAPTM gesture interface device and take-home laparoscopic simulators. Surg Innov 23:70–77. https://doi.org/10.1177/1553350615594734
Oropesa I, Sánchez-González P, Chmarra MK, Lamata P, Fernández Á, Sánchez-Margallo JA, Jansen FW, Dankelman J, Sánchez-Margallo FM, Gómez EJ (2013) EVA: laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment. Surg Endosc 27:1029–1039. https://doi.org/10.1007/s00464-012-2513-z
Escamirosa FP, Flores RMO, Oropesa I, Vidal CRZ, Martínez AM (2015) Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons. Surg Endosc 29:3392–3403. https://doi.org/10.1007/s00464-014-4032-6
Hofstad EF, Våpenstad C, Chmarra MK, Langø T, Kuhry E, Mårvik R (2013) A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance. Surg Endosc 27:854–863. https://doi.org/10.1007/s00464-012-2524-9
Oropesa I, Sánchez-González P, Lamata P, Chmarra MK, Pagador JB, Sánchez-Margallo JA, Sánchez-Margallo FM, Gómez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171:e81–e95. https://doi.org/10.1016/j.jss.2011.06.034
Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: ready for widespread use? Surgery 135:28–42. https://doi.org/10.1016/S0039-6060(03)00155-7
Fried GM, Feldman LS (2008) Objective assessment of technical performance. World J Surg 32:156–160. https://doi.org/10.1007/s00268-007-9143-y
Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondré K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113. https://doi.org/10.1016/j.amjsurg.2005.04.004
Chang J, Banaszek DC, Gambrel J, Bardana D (2016) Global rating scales and motion analysis are valid proficiency metrics in virtual and benchtop knee arthroscopy simulators. Clin Orthop Relat Res 474:956–964. https://doi.org/10.1007/s11999-015-4510-8
Cristancho SM, Hodgson AJ, Panton ONM, Meneghetti A, Warnock G, Qayumi K (2009) Intraoperative monitoring of laparoscopic skill development based on quantitative measures. Surg Endosc 23:2181–2190. https://doi.org/10.1007/s00464-008-0246-9
Chmarra MK, Klein S, De Winter JCF, Jansen FW, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24:1031–1039. https://doi.org/10.1007/s00464-009-0721-y
Oropesa I, Sánchez-González P, Chmarra MK, Lamata P, Pérez-Rodríguez R, Jansen FW, Dankelman J, Gómez EJ (2013) Supervised classification of psychomotor competence in minimally invasive surgery based on instruments motion analysis. Surg Endosc 28:657–670. https://doi.org/10.1007/s00464-013-3226-7
Horeman T, Dankelman J, Jansen FW, van den Dobbelsteen JJ (2014) Assessment of laparoscopic skills based on force and motion parameters. IEEE Trans Biomed Eng 61:805–813. https://doi.org/10.1109/TBME.2013.2290052
Enciso Sanz S, Sánchez Margallo FM, Díaz-Güemes Martín-Portugués I, Usón Gargallo J (2012) Preliminary validation of the Simulap(®) physical simulator and its assessment system for laparoscopic surgery. Cir Esp 90:38–44. https://doi.org/10.1016/j.ciresp.2011.07.013
Abdi HE, Williams LJ (2010) Principal component analysis. WIREs Comp Stat 2:433–459. https://doi.org/10.1002/wics.101
Acknowledgements
The authors would like to acknowledge all staff of the Jesús Usón Minimally Invasive Surgery Centre involved in setting up and performing the experiments described in this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosures
Drs. I. Oropesa, F. Pérez Escamirosa, J.A. Sánchez Margallo, S. Enciso, B. Rodríguez-Vila, A. Minor Martínez, F.M Sánchez-Margallo, P. Sánchez-González, and E.J. Gómez have no conflict of interests or financial ties to disclose.
Rights and permissions
About this article
Cite this article
Oropesa, I., Escamirosa, F.P., Sánchez-Margallo, J.A. et al. Interpretation of motion analysis of laparoscopic instruments based on principal component analysis in box trainer settings. Surg Endosc 32, 3096–3107 (2018). https://doi.org/10.1007/s00464-018-6022-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-018-6022-6