Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/63939, first published .
Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

Review

Department of Surgery, Hamad Medical Corporation, Doha, Qatar

Corresponding Author:

Nikhil V Navkar, PhD

Department of Surgery

Hamad Medical Corporation

PO Box 3050

Doha, 3050

Qatar

Phone: 974 77606674

Email: nnavkar@hamad.qa


Background: Remote surgeons use telementoring technologies to provide real-time guidance during minimally invasive surgeries (MIS). Such technologies are continuously improving with the integration of dynamic augmented reality (AR) cues. This includes virtual overlays of hand gestures, pointers, and surgical tools onto the operating surgeon’s view. The operating surgeon comprehends this augmented information to operate on the patient. Thus, understanding these dynamic AR cues (either during surgical training or live surgery) is crucial.

Objective: In this paper, we aimed to review the existing telementoring technologies that use dynamic AR cues during MIS. This review describes the MIS (including surgery type, specialty, procedure, and clinical trial), the telementoring system, the dynamic AR cues generated by these systems, and evaluation of the technology in terms of technical aspects, user perceptions, skills gained, and patient outcomes.

Methods: A scoping review was conducted using PubMed, Web of Science, Scopus, IEEE Xplore, and ACM Digital Library databases. The search terms included “telementoring,” “minimally invasive surgery,” and “augmented reality” without restrictions imposed on the publication year. Articles covering telementoring using dynamic AR cues during MIS, including laparoscopic and robot-assisted, were identified.

Results: A total of 21 articles were included and categorized based on type of surgery, the telementoring technology used, and evaluation of the technology. Most of the articles reported on laparoscopic suturing performed using synthetic phantoms. Hand gestures and surgical tools were the most frequently used dynamic AR cues (10 articles on each cue), while the mentors and mentees primarily consisted of experienced surgeons and medical students. The studies assessing the telementoring technologies were either descriptive (7 articles) or analytical (14 articles) where it was compared against no cue, prerecorded visual cue, in-person guidance, audio cue, or static AR cue. Outcomes were measured mostly using skills gained (13 articles) and user perception about the telementoring system.

Conclusions: In general, telementoring using dynamic AR cues resulted in positive outcomes during MIS. In some cases, they were considered on par with conventional methods such as audio cues and in-person guidance. Further randomized controlled trials are required to objectively assess its clinical benefits.

J Med Internet Res 2025;27:e63939

doi:10.2196/63939

Keywords



One of the telemedicine technologies that is gaining considerable interest is telementoring, during which an expert medical professional (mentor) can provide real-time instructions to a novice (mentee) even if they are remotely located [Fernandes RD, Ghasroddashti A, Sorefan-Mangou F, Williams E, Choi K, Fasola L, et al. Educational effectiveness of telementoring as a continuing professional development intervention for surgeons in practice: a systematic review. Ann Surg Open. 2023;4(4):e341. [FREE Full text] [CrossRef] [Medline]1]. A growing application of telementoring technologies is seen in the field of surgery as a result of rising demands for specialized surgical expertise coupled with limited training opportunities [Netzer I, Kirkpatrick AW, Nissan M, McKee JL, McBeth P, Dobron A, et al. Rubrum coelis: the contribution of real-time telementoring in acute trauma scenarios-a randomized controlled trial. Telemed J E Health. 2019;25(11):1108-1114. [CrossRef] [Medline]2]. Minimally invasive surgery (MIS) is one such specialized surgical field, which has emerged as the standard practice [Sparn MB, Teixeira H, Chatziisaak D, Schmied B, Hahnloser D, Bischofberger S. Virtual reality simulation training in laparoscopic surgery - does it really matter, what simulator to use? Results of a cross-sectional study. BMC Med Educ. 2024;24(1):589. [FREE Full text] [CrossRef] [Medline]3]. During MIS, which includes laparoscopic and robot-assisted procedures, surgeons use long, thin surgical instruments inserted through small incisions on the body. The operative view is captured through a camera scope and displayed on a screen. MIS is increasingly adopted due to the benefits it provides to patients, in terms of significant reduction in pain, surgical site infection, scarring, and recovery time as compared with the highly invasive open approach [Wagenaar S, Nederhoed JH, Hoksbergen AW, Bonjer HJ, Wisselink W, van Ramshorst GH. Minimally invasive, laparoscopic, and robotic-assisted techniques versus open techniques for kidney transplant recipients: a systematic review. Eur Urol. 2017;72(2):205-217. [CrossRef] [Medline]4]. Despite these pronounced advantages, its widespread implementation is hindered due to the challenges in adequate skills acquisition. Surgeons performing MIS have an indirect view of the operative view through the screen projecting the live camera scope feed and experience a longer learning curve as compared with open surgery [Chang SY, Chan KS, Oo AM. Can computerized simulation be used to assess surgical proficiency in laparoscopic colorectal surgeries? A systematic review. Surg Innov. 2024;31(2):195-211. [CrossRef] [Medline]5]. Hence, specialized training is needed to develop sufficient expertise. While basic MIS skills are learned outside the operating room, intraoperative training is vital for attaining proficiency [Chang SY, Chan KS, Oo AM. Can computerized simulation be used to assess surgical proficiency in laparoscopic colorectal surgeries? A systematic review. Surg Innov. 2024;31(2):195-211. [CrossRef] [Medline]5]. Unlike open surgeries where the expert surgeon can easily point at critical structures with their hands over the operative view, mentors must rely on verbal instructions during MIS, which are prone to communication errors [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6]. In some cases, the mentor must take complete control of the instruments from the mentee to show the required surgical technique. While the dual surgeon console in robot-assisted surgeries facilitates such takeovers by the mentor, the cost can be prohibitively high. Furthermore, many countries experience challenges in implementing MIS due to inadequate training programs and high costs associated with bringing in expert surgeons [Rollan L, Gigena C, Diaz Saubidet I, Valverde S, Bellia-Munzon G, Millán C. Innovation and challenges: minimally invasive surgery training in Latin America. Cir Pediatr. 2024;37(4):147-151. [FREE Full text] [CrossRef] [Medline]7]. Telementoring technologies that allow an expert surgeon to efficiently guide the operating surgeon play a major role in addressing this gap [SAGES Digital Surgery Working Group, Ali JT, Yang G, Green CA, Reed BL, Madani A, et al. Defining digital surgery: a SAGES white paper. Surg Endosc. 2024;38(2):475-487. [CrossRef] [Medline]8].

Implementing telementoring technologies during MIS is relatively easier, as compared with open surgeries, since a live view of the operating field is already captured through the camera scopes [Rafiq A, Moore JA, Zhao X, Doarn CR, Merrell RC. Digital video capture and synchronous consultation in open surgery. Ann Surg. 2004;239(4):567-573. [CrossRef] [Medline]9,Eadie LH, Seifalian AM, Davidson BR. Telemedicine in surgery. Br J Surg. 2003;90(6):647-658. [CrossRef] [Medline]10]. During conventional telementoring, video captured from the operating room is transmitted in real time to an expert mentor at the remote location. Verbal instructions (audio cues) from the mentor are transferred to the mentee [Erridge S, Yeung DKT, Patel HRH, Purkayastha S. Telementoring of surgeons: a systematic review. Surg Innov. 2019;26(1):95-111. [FREE Full text] [CrossRef] [Medline]11]. The mentor can also play surgical videos (prerecorded visual cues) to guide the mentee on a particular step [Gasques D, Johnson JG, Sharkey T, Feng Y, Wang R, Xu ZR, et al. ARTEMIS: a collaborative mixed-reality system for immersive surgical telementoring. Association for Computing Machinery; 2021. Presented at: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems; 8 - 13 May 2021:1-14; Yokohama, Japan. [CrossRef]12]. However, such cues may not be sufficient for intraoperative instructions [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6]. To overcome the communication challenges posed by verbal instructions, expert surgeons need a way to point at anatomical structures on the screen displaying the operative view to the mentee [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13]. For this purpose, the mentor may use augmented reality (AR), which involves the use of computer-generated virtual objects that are superimposed on the mentee’s view of the operative field [Lin Z, Xu Z, Liu H, Wang X, Ai X, Zhou C, et al. Robotic manipulator‐assisted omnidirectional augmented reality for endoluminal intervention telepresence. Advanced Intelligent Systems. 2024;6(1). [CrossRef]14]. The AR cues may be rendered to the mentee on a visualization screen, or the surgeon’s console with stereoscopic vision during robot-assisted surgery. In some cases, external AR devices such as Microsoft HoloLens head-mounted display (HMD) or iPad tablets may also be used [Dinh A, Yin AL, Estrin D, Greenwald P, Fortenko A. Augmented reality in real-time telemedicine and telementoring: scoping review. JMIR Mhealth Uhealth. 2023;11:e45464. [FREE Full text] [CrossRef] [Medline]15]. The cues could be in the form of 2-dimensional (2D) annotations (static AR cues) demonstrating an incision line or highlighting a specific anatomy [Collins JW, Chen J, Hung A. Telementoring for minimally invasive surgery. Robotic Surgery. 2021:361-378. [CrossRef]16,Budrionis A, Augestad KM, Patel HR, Bellika JG. An evaluation framework for defining the contributions of telestration in surgical telementoring. Interact J Med Res. 2013;2(2):e14. [FREE Full text] [CrossRef] [Medline]17]. Such forms of telementoring have been applied extensively for MIS demonstrating improved communication and performance [Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18]. Nonetheless, static AR cues are limited while compared with in-person guidance as complex tool-tissue interactions may not be accurately depicted [Bilgic E, Turkdogan S, Watanabe Y, Madani A, Landry T, Lavigne D, et al. Effectiveness of telementoring in surgery compared with on-site mentoring: a systematic review. Surg Innov. 2017;24(4):379-385. [CrossRef] [Medline]19,Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20].

Telementoring can be enhanced with the use of dynamic AR cues to effectively communicate surgical steps. As opposed to static AR cues, which remain stationary on the mentee’s field of view, dynamic AR cues move in real time under the mentor’s control [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21]. These virtual cues can be in the form of hand gestures, pointers, or surgical tools. They are often 3-dimensional (3D) in nature, providing depth perception as the mentor guides the mentee through surgical sub steps. In cases where the mentor and mentee have similar macro skills, such as proficiency in critical anatomy and movement of surgical tools, these dynamic cues can aid the mentee’s development of micro skills related to a particular unfamiliar surgical technique [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22]. Dynamic AR cues are not only useful for telementoring when the mentor is situated in a remote location, but can also be used to enhance in-person guidance during MIS where the mentor and mentee are in the same operating room [Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170. [CrossRef] [Medline]23].

Several reviews related to telementoring in health care have been previously published; however, they did not focus on applications for surgery in specific [Dinh A, Yin AL, Estrin D, Greenwald P, Fortenko A. Augmented reality in real-time telemedicine and telementoring: scoping review. JMIR Mhealth Uhealth. 2023;11:e45464. [FREE Full text] [CrossRef] [Medline]15,Bui DT, Barnett T, Hoang H, Chinthammit W. Tele-mentoring using augmented reality technology in healthcare: a systematic review. AJET. 2021;37(4):68-88. [CrossRef]24]. Other reviews covering surgical applications of telemedicine and telementoring have been presented [Fernandes RD, Ghasroddashti A, Sorefan-Mangou F, Williams E, Choi K, Fasola L, et al. Educational effectiveness of telementoring as a continuing professional development intervention for surgeons in practice: a systematic review. Ann Surg Open. 2023;4(4):e341. [FREE Full text] [CrossRef] [Medline]1,Erridge S, Yeung DKT, Patel HRH, Purkayastha S. Telementoring of surgeons: a systematic review. Surg Innov. 2019;26(1):95-111. [FREE Full text] [CrossRef] [Medline]11,Huang EY, Knight S, Guetter CR, Davis CH, Moller M, Slama E, et al. Telemedicine and telementoring in the surgical specialties: a narrative review. Am J Surg. 2019;218(4):760-766. [CrossRef] [Medline]25-Hamza H, Al-Ansari A, Navkar NV. Technologies used for telementoring in open surgery: a scoping review. Telemed J E Health. 2024;30(7):1810-1824. [CrossRef] [Medline]30]. These articles largely covered implementations of telementoring systems where video feed from the mentee is sent for audio feedback from the remote mentor. Some of them did not focus on MIS and explored applications in open surgery as well [Erridge S, Yeung DKT, Patel HRH, Purkayastha S. Telementoring of surgeons: a systematic review. Surg Innov. 2019;26(1):95-111. [FREE Full text] [CrossRef] [Medline]11,Pfennig M, Lee A, Mi M. How does telementoring impact medical education within the surgical field? A scoping review. Am J Surg. 2022;224(3):869-880. [FREE Full text] [CrossRef] [Medline]29,Hamza H, Al-Ansari A, Navkar NV. Technologies used for telementoring in open surgery: a scoping review. Telemed J E Health. 2024;30(7):1810-1824. [CrossRef] [Medline]30]. Additional review articles focused on specific use of telementoring for certain specialties such as head and neck [Yang A, Kim D, Hwang PH, Lechner M. Telemedicine and telementoring in rhinology, otology, and laryngology: a scoping review. OTO Open. 2022;6(1):2473974X211072791. [FREE Full text] [CrossRef] [Medline]31], robotic [Seeliger B, Collins JW, Porpiglia F, Marescaux J. The role of virtual reality, telesurgery, and teleproctoring in robotic surgery. In: Robotic Urologic Surgery. Heidelberger Platz. Springer International Publishing; 2022:61-77.32], and urology [Ayoub CH, El-Asmar JM, Abdulfattah S, El-Hajj A. Telemedicine and telementoring in urology: a glimpse of the past and a leap into the future. Front Surg. 2022;9:811749. [FREE Full text] [CrossRef] [Medline]33]. With respect to MIS, Nickel et al [Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170. [CrossRef] [Medline]23] provided a concise clinical summary, whereas others reported on the use of audio and static AR cues [Collins JW, Chen J, Hung A. Telementoring for minimally invasive surgery. Robotic Surgery. 2021:361-378. [CrossRef]16,Budrionis A, Augestad KM, Patel HR, Bellika JG. An evaluation framework for defining the contributions of telestration in surgical telementoring. Interact J Med Res. 2013;2(2):e14. [FREE Full text] [CrossRef] [Medline]17,Bilgic E, Turkdogan S, Watanabe Y, Madani A, Landry T, Lavigne D, et al. Effectiveness of telementoring in surgery compared with on-site mentoring: a systematic review. Surg Innov. 2017;24(4):379-385. [CrossRef] [Medline]19,Augestad KM, Han H, Paige J, Ponsky T, Schlachta CM, Dunkin B, et al. Educational implications for surgical telementoring: a current review with recommendations for future practice, policy, and research. Surg Endosc. 2017;31(10):3836-3846. [CrossRef] [Medline]34,Hung AJ, Chen J, Shah A, Gill IS. Telementoring and telesurgery for minimally invasive procedures. J Urol. 2018;199(2):355-369. [CrossRef] [Medline]35]. While these reviews offer a comprehensive understanding of telementoring during MIS, they do not highlight the developments in the use of dynamic AR cues. To the best of our knowledge, there has not yet been a systematic examination specifically on the use of dynamic AR cues used by remote mentors during telementoring in MIS. Such a synthesis providing an overview of the different types of dynamic AR cues as well as the surgical procedures, clinical settings, and factors used for testing is needed. This will help guide future research and developments on telementoring in MIS and ensure that they are relevant and practical.

Through this scoping review we aim to provide a comprehensive summary of dynamic AR cues used for telementoring during MIS. A survey of the various types of surgeries, participants, dynamic AR cues, and evaluation of the telementoring technology is presented to guide future developments on telementoring during MIS. We aim to address the following research questions (RQs), which are yet to be answered by review articles published in the field:

  • RQ1: What are the MIS specialties and procedures where dynamic AR cues have been used for telementoring? What are the clinical trials or settings they were tested on?
  • RQ2: What are the different types of dynamic AR cues used for MIS telementoring? What information does the mentor convey to the mentee using these cues?
  • RQ3: What factors are used to evaluate the use of dynamic AR cues during MIS telementoring? What are the common outcomes reported?

Overview

The review was conducted based on the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) guidelines [Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. [FREE Full text] [CrossRef] [Medline]36].

Eligibility Criteria

To be considered eligible for the review, articles must satisfy the following criteria (Textbox 1).

Textbox 1. Eligibility criteria for scoping review.

Inclusion criteria

  • Original article.
  • Reporting telementoring technologies using dynamic augmented reality cue.
  • Reporting telementoring technologies during minimally invasive surgeries (including, endoscopic, laparoscopic, and robot-assisted).
  • Published in English.

Exclusion criteria

  • Articles on nonsurgical applications.
  • Open surgery (ie, not minimally invasive surgeries).
  • Microsurgery.
  • Studies without telementoring technologies.
  • Reports of telementoring without the use of augmented reality.
  • Telementoring using static augmented reality cues (annotations) only.
  • Articles without enough information (such as editorials and comments).
  • Review articles.

Search

A thorough search of scientific databases including PubMed, Web of Science, and Scopus was conducted. Other databases such as “IEEE Xplore” and “ACM Digital Library” covering technical fields were also included. The search terms comprised of, but were not restricted to, “telementoring,” “teleproctoring,” “augmented reality,” “overlay,” and “minimally invasive surgery.” There were no restrictions imposed on the year of publication. The latest search was conducted on March 11, 2024. The strategy used for searching in PubMed is provided in

Multimedia Appendix 1

Search strategy used for PubMed and other databases.

DOCX File , 17 KBMultimedia Appendix 1. Additional records were found through citation searches and scanning review articles.

Study Selection

Through the searches, a total of 460 scientific records were identified. Duplicate removal, title and abstract and full-text screening were done using the Rayyan web app [Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. [FREE Full text] [CrossRef] [Medline]37]. Two reviewers [HH] and [NN] were independently responsible for title and abstract and full-text screening process. Resolution of disagreements on eligibility of an article was done through consensus and discussion with a third reviewer [OA] when necessary.

Data Extraction

Data items extracted from the articles included year of publication, type of surgery, surgical specialty and procedure, phase of clinical trial, number of participants and their experience level, telementoring technology, type of dynamic AR cue, comparator (if applicable), factor measured, and outcome of the study. The data extraction form with the variables to be extracted from each eligible article were jointly developed by 2 reviewers [HH] and [NN] for this scoping review. The reviewers were independently responsible for extracting the data from each study. Resolution of disagreements on results of the data extraction was achieved through discussion with a third reviewer [OA] when necessary.

Quality Assessment

Methodological quality assessment of the included studies was conducted based on the Medical Education Research Study Quality Instrument (MERSQI) [Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. Association between funding and quality of published medical education research. JAMA. 2007;298(9):1002-1009. [CrossRef] [Medline]38]. The tool is designed to appraise the quality of medical education research, which was found to be appropriate for the topic addressed by this scoping review. The quality assessment tool was not used as an exclusion criterion, but instead, it was used after the screening process to gauge the quality and reliability of the articles reporting the use of dynamic AR cues during minimally invasive surgical telementoring [Glossop SC, Bhachoo H, Murray TM, Cherif RA, Helo JY, Morgan E, et al. Undergraduate teaching of surgical skills in the UK: systematic review. BJS Open. 2023;7(5):zrad083. [FREE Full text] [CrossRef] [Medline]39]. Each article was assessed according to study design, type of data obtained, evaluation instrument used, analysis of the data, and outcomes measured to give a score out of 18. A higher score given to an article indicates a superior study design. Similar to the study selection and data extraction process, 2 reviewers [HH] and [NN] were responsible for quality assessment of the included studies, while disagreements were resolved through discussions with a third reviewer [OA] when necessary.

Data Synthesis

The data extracted from the articles were presented using a descriptive table with information on surgery, participants (performing the procedure), dynamic AR cues, comparator, outcomes measured, and primary findings of the study. Study characteristics such as surgical procedure, clinical trial, type of dynamic AR cue, and publication year were visually summarized as counts. A meta-analysis was not conducted since a wide variety of outcomes measured, clinical setting, and type of participants was observed.


Overview

A total of 21 articles reporting on the use of dynamic AR cues during telementoring in MIS were included in the review (Figure 1). An average MERSQI score of 12.9 was observed in the included articles. Table 1 presents a summary of the included articles. The table elements are described in detail in the following sections. They include details about the MIS procedures, the various dynamic AR cues used for telementoring, and evaluation of the technologies and their outcomes.

Figure 1. Flowchart depicting identification, screening, and inclusion of articles on the use of dynamic augmented reality cues during minimally invasive surgical telementoring.
Table 1. Studies reporting dynamic augmented reality cues during minimally invasive surgery telementoring.
StudyMERSQIa scoreMinimally invasive surgeryMentor and menteeInterventionEvaluation


TypebProcedureClinical trial
TechnologyDynamic ARc cueComparatorOutcome
Cizmic et al [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6]15.5LCholecystectomyAnimal (cadaver)Doctor trained by surgeon (n=1); medical students (n=40)iSurgeonHand gestureAudio cueSkills: improved GOALSd, OSATSe scores and fewer complications, no difference in operating time
Felinska et al [Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18]14.5LCholecystectomy; basic tasksAnimal (cadaver), virtual simulator, synthetic phantomMentor (n=1); medical students (n=40)iSurgeonHand gestureAudio cueSkills: improved participant gaze behavior, lower number of errors, higher OSATS score in iSurgeon group
Huettl et al [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40]16LCholecystectomyHuman (live)Mentors (n=13); surgical trainees (n=15)HoloPointerPointerAudio cuePerceptions, skills: reduced corrections, improved subjective performance, favorable user ratings; no difference in GOALS score, CVSf, and operating time
Long et al [Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41]10RProstatectomy; suturing, basic taskHuman (live), synthetic phantomExpert surgeon (n=1); trainee (n=1)In-house developed systemHand gesture, surgical toolgTechnical: latency within standard acceptable latency (330 ms)
Shabir et al [Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42]12.5LSuturingSynthetic phantomMentors (n=2); mentees (n=12)In-house developed systemSurgical toolIn-person guidanceSkills: longer operating time observed, but comparable performance
Shabir et al [Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20]11.5LSalpingectomyVirtual simulatorMentor (n=1); mentees (n=12)In-house developed systemSurgical toolIn-person guidanceSkills: lower complication percentage during learning stage; lowered operating time during testing stage
Shabir et al [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43]12.5LSuturingSynthetic phantomMentor (n=1); mentees (n=18)In-house developed systemSurgical toolPrerecorded visual cue, in-person guidanceSkills: lower error count, no difference in operating time
Lowry et al [Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44]15.5LSuturing, basic taskSynthetic phantomMentor (n=1); premedical, medical students (n=30)MVRh HelpLightning platformSurgical toolNo cue, in-person guidanceSkills: improvement compared to group who received no cue, similar FLSi skills among telementored and in-person guided groups
Shabir et al [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22]10LBasic taskSynthetic phantomMentor (n=1); mentee (n=6)In-house developed systemSurgical toolTechnical: latency of 260 ms observed to send information from mentee to mentor and 132 ms vice versa
Wild et al [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13]15.5LCholecystectomyAnimal (cadaver)Expert surgeon (n=1); medical students (n=60)iSurgeonHand gestureAudio cuePerceptions, skills: faster operating time, lower error rate, improved GOALS and OSATS scores, lower complications, and reduced workload (NASA-TLXj)
Youssef et al [Youssef SC, Sabbubeh B, Haram K, Noël J, Aydın A, Challacombe B, et al. Augmented reality robot-assisted radical prostatectomy with PROXIMIE: preliminary clinical experience. Urology Video Journal. 2022;16:100187. [CrossRef]45]9RProstatectomyHuman (live)Expert urology mentors (n=2); senior urology fellows (n=2)ProximieHand gesturePerceptions: favorable ratings provided by mentors and mentees
El-Asmar et al [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46]16RAquablation for benign prostatic obstructionHuman (live)Mentors (n=3); surgeons (n=not specified)ProximieHand gestureIn-person guidancePatient outcome: no difference in operating time, drop in hemoglobin, urinary retention, and complications; increased anesthesia use and cauterization under telementor guidance
Heinrich et al [Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47]14.5LCholecystectomyVirtual simulatorExpert surgeon (n=1); surgical trainees (n=10)

HoloPointerPointerAudio cueSkills: improvement in economy of movement, error rate, and performance
Shabir et al [Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48]11L, RSuturingSynthetic phantomMentor (n=1); mentee (n=1)In-house developed systemSurgical toolTechnical: latency of 1.56 s to transfer information from operating room to remote area and 0.089 s vice versa
Feng et al [Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49]13.5LCholecystectomySynthetic phantomFellow trained by surgeon (n=1); residents (n=6)Virtual pointerPointerAudio cueSkills: improvement in turn frequency (number of turns per second)
Feng et al [Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50]14.5LCholecystectomySynthetic phantomFellow trained by surgeon (n=1); surgical trainees (n=7)Virtual pointerPointerAudio cueSkills: improvement in economy of movement and subjective performance, no difference in errors and operating time
Jarc et al [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21]11RSuturing, basic taskAnimal (live)Expert surgeons (n=6); medical students, residents (n=7)In-house developed systemHand gesture, pointer, surgical toolPerceptions: tool rated favorably by mentors and mentees
Kowalewski et al [Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51]12.5LSuturing, basic taskSynthetic phantomSurgeons, mentors (n=4); novice, intermediate, expert mentees (n=30)iSurgeonHand gestureSkills: positive correlation observed between iSurgeon parameters and OSATS score
Davis et al [Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52]10LVentriculostomyHuman (live)Expert surgeon (n=1); expert surgeon (n=1)VIPARkHand gesture, pointerTechnical: latency of 237 ms in visual cue; successful implementation of VIPAR

Jarc et al [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53]11RBasic taskAnimal (live)Surgeons (n=26); surgical, nonsurgical trainees (n=26)In-house developed systemHand gesture, pointer, surgical toolStatic AR cue (2D telestration)Perceptions: participants preferred 3D tools over 2D telestration
Vera et al [Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]14.5LSuturingSynthetic phantomMentor (n=1); premedical, medical students (n=19)ARTlSurgical toolIn-person guidanceSkills: steeper learning curve, faster operating time, fewer failed attempts in ART group

aMERSQI: Medical Education Research Study Quality Instrument.

btypes: L: laparoscopic; R: robot-assisted.

cAR: Augmented Reality.

dGOALS: Global Operative Assessment of Laparoscopic Skills.

eOSATS: Objective Structured Assessments of Technical Skills.

fCVS: Critical view of safety.

gNot applicable.

hMVR: merged virtual reality.

iFLS: fundamentals of laparoscopic surgery.

jNASA-TLX: NASA (National Aeronautics and Space Administration) Task Load Index.

kVIPAR: virtual interactive presence and augmented reality.

lART: augmented reality telementoring.

MIS (Research Question 1)

Article on MIS included 2 categories, namely, manual or conventional laparoscopic (n=16 articles) and robot-assisted (n=6). These were subdivided based on surgical specialties, which consisted of general, gynecology, neurosurgery, urology, and nonspecific specialties. Figure 2 depicts the surgical procedures and the corresponding clinical settings under which the telementoring technologies were tested. Each vertical block represents an article using dynamic augmented reality cues. Articles using multiple dynamic cues are represented as segmented vertical blocks. The surgical procedures identified included cholecystectomy [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50], salpingectomy [Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20], ventriculostomy [Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52], aquablation [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46], and prostatectomy [Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41,Youssef SC, Sabbubeh B, Haram K, Noël J, Aydın A, Challacombe B, et al. Augmented reality robot-assisted radical prostatectomy with PROXIMIE: preliminary clinical experience. Urology Video Journal. 2022;16:100187. [CrossRef]45]. Nonspecific procedures consisted of basic tasks (such as cutting, knot tying, ligation, peg transfer, and tool motion) [Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41,Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] as well as suturing [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41-Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. The procedures were conducted under four different clinical settings: virtual simulator, synthetic phantom, animal (cadaver or live), or human (live). Virtual simulators present highly realistic computer-generated surgical procedures. However, they often have limited haptic feedback providing tactile sensation [Syamlan A, Fathurachman, Denis K, Vander Poorten E, Pramujati B, Tjahjowidodo T. Haptic/virtual reality orthopedic surgical simulators: a literature review. Virtual Reality. 2022;26(4):1795-1825. [CrossRef]55]. Synthetic phantoms consist of low or high-fidelity tissue models. Depending on the material it is made of, it may even provide realistic tissue interaction [Higgins M, Leung S, Radacsi N. 3D printing surgical phantoms and their role in the visualization of medical procedures. Annals of 3D Printed Medicine. 2022;6:100057. [CrossRef]56]. Animal models include euthanized cadavers or anesthetized live animals, while surgeries on real patients were categorized as human (live). All the 4 clinical settings were used for telementoring during cholecystectomy procedures. Maximum number of articles covered laparoscopic suturing on synthetic phantoms (n=6). A range of dynamic AR cues were used in articles covering robot-assisted basic tasks performed on animal models.

Figure 2. Depiction of surgical procedures and the corresponding clinical settings under which the telementoring technologies were tested.

Telementoring Technology (Research Question 2)

The mentors used various forms of dynamic AR cues that were overlaid on the mentee’s view of the operating field (Figure 3). These visual cues were divided into 3 types, hand gesture (displaying mentor’s hand position and orientation), pointer (in the form of dynamic annotations), and surgical tool (showing the type of tool, position, or required motion). As depicted in Figure 4 [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20-Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41-El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46,Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51-Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54], most of the articles covered hand gestures and surgical tools (n=10 articles on each cue). The telementoring system developed by Jarc et al [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] used all the 3 types of dynamic AR cues. Some of the pros and cons of each cue are summarized in Table 2. The following paragraphs provide a detailed description of the three dynamic AR cues.

Figure 3. Various dynamic augmented reality cues overlayed on the mentee’s operative field.
Figure 4. Number of articles reporting telementoring systems using dynamic augmented reality cues, specifically, hand gestures, pointers, and surgical tools [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20-Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40-Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51-Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. ART: augmented reality telementoring; MVR: merged virtual reality; VIPAR: virtual interactive presence and augmented reality.
Table 2. Summary of common pros and cons of each dynamic augmented reality cue.
Dynamic augmented reality cueProsCons
Hand gesture
  • Natural and intuitive mode of communication [Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18].
  • Orientation and position can be conveyed [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21].
  • Grasping tool actions can be mimicked using open and close gestures with fingers [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53].
  • Mentee’s view of the operative field may get obstructed [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43].
  • Complex tool tip movements may not be conveyed [Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48].
Pointer
  • Critical anatomical structures and dissection plane can be indicated [Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52].
  • Mentors can use hands-free interaction when pointing is enabled through head tracking [Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47].
  • Tool tip orientation may not be conveyed [Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48].
  • Complex instructions such as grasping and other tool movements may not be replicated [Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48].
  • Verbal clarification of the instruction may be required [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53].
Surgical tool
  • Exact tool to be used, tool tip orientation, and position can be conveyed [Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54].
  • Required motion and open and close gestures of the tool can be conveyed [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53].
  • Decreases the need for takeover of the surgery by the mentor [Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54].
  • Mentee’s view of the operative field may get obstructed [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43].
  • Implementation of the technology may be challenging [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22].
Hand Gesture

Hand gesture was one of the most used dynamic AR cues among the included articles. It enhances the mentoring experience with the ability to point at critical anatomical structures, demonstration of grasping gestures by opening and closing fingers, and depiction of orientation through hand rotation movements [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53]. In the iSurgeon system, the mentor’s hand gestures were captured using an overhead depth video camera, which was then projected on to the mentee’s view of the operative field [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51]. In this way, the mentor was able to support the mentee by communicating the dissection plain, target anatomy, and indicating the next steps of the procedures [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6]. Similarly, the hand gesture overlays were also used in telementoring systems such as Proximie and Virtual Interactive Presence and Augmented Reality (VIPAR) [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46,Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52]. In the VIPAR system, the video camera on iPad tablet devices were used to capture the mentee’s operative view as well as the mentor’s hand gestures. Both the video feeds were then combined allowing a transparent overlay of the mentor’s hand to appear in the mentee’s view [Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52]. The telementoring system developed by Jarc et al [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] integrated custom wireless input devices and commercial game controllers allowing the mentor to manipulate the orientation and position of a virtual hand appearing in the mentee’s operative view. The mentor was also able to indicate grasping gestures (open and close) using the input device. In this way, the mentee was able to understand and translate the hand gestures to orient, position, and manipulate the surgical tool accordingly. Consequently, the use of virtual hands for telementoring was rated as highly effective by both the mentors and mentees [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53]. As reflected by its frequent usage observed in the included articles, hand gestures provide a natural and intuitive mode of communication for the mentor making it easier for the mentee to interpret and follow the instructions.

Pointer

The virtual pointer was used to indicate critical anatomy or a specific region in the mentee’s operative view. Frequency of its use as dynamic AR cue during telementoring was relatively lower compared with hand gestures and surgical tools among the included articles. Nevertheless, the use of pointers showed significant improvement in quality of instructions compared with verbal feedback alone [Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50]. The HoloPointer system used an AR HMD device (Microsoft HoloLens) to track head movements [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40]. In doing so, the mentor was able to point at various regions of the operating field view in a hands-free manner [Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47]. In other studies, the mentors used hand movements, which were captured by a motion sensing device (Microsoft Kinect) to control the virtual pointer as described by Feng et al [Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50]. The VIPAR system, similar to its implementation for hand gestures, used an iPad tablet device to capture the pointing device used by the mentor and combine it with the mentee’s operative view [Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52]. The 3D pointers appearing on the mentee’s view were manipulated by the mentor using game controllers in the system presented by Jarc et al [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53]. However, the use of 3D pointers received low ratings from the mentors. Overall, virtual pointers allowed the mentors to clarify verbal instructions by directing the mentee’s attention to a particular region of interest. However, it was not used as frequently, since the mentor is not able to convey precise instructions, such as tool tip orientation and motion.

Surgical Tool

Virtual surgical tools provided a close-to-reality visual cue during telementoring. It enhances the realism of the mentee’s training environment as the mentor can accurately convey the precise tool to be used, orientation and position of the tool tip, as well as the necessary movements (such as open and close gestures). Hence, the surgical tool as a dynamic AR cue was frequently used among the included studies. This was primarily done in 2 ways, by superimposing live video feed with real surgical tool from the mentor’s side on to the mentee’s view or by displaying 3D models of the surgical tool, which the mentor manipulates using various input devices. One of the earliest implementations, the augmented reality telementoring (ART) system, used a laparoscopic box simulator with an embedded camera at the remote mentor’s side. As the mentor maneuvered the real surgical tool, the live video feed was superimposed on the mentee’s view of the operative field. This resulted in improved understanding of instructions and quicker skills acquisition. The mentees also reported that the cue did not obstruct the operative view [Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. With respect to the use of 3D surgical tool models, Shabir et al [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43,Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48] reported a telementoring system where the mentor did not use real tools and instead controlled the virtual tools appearing on the mentee’s view using a haptic device (Touch, 3D Systems). Similarly, Long et al [Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41] used an AR HMD device that tracked the mentor’s hand movements. These movements were then translated to manipulate the virtual tool instructing the mentee. Following the approaches for hand gestures and virtual pointers, Jarc et al [Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] enabled the mentors to manipulate the ghost tools using custom input devices and game controllers. The virtual surgical tool models enabled the mentor to convey intricate tool wrist orientation information. Overall, surgical tools enhance the instructional experience by replicating complex motions during different surgery phases and overcoming communication barriers between the remote mentor and mentee. Despite the considerable benefits, the use of surgical tools as dynamic AR cues for telementoring in MIS is still in the early stages of clinical trial.

Evaluation of Technology (Research Question 3)

The telementoring technologies using dynamic AR cues were evaluated with participants having varying expertise in MIS. Majority of the studies had experienced surgeons as mentors [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41,Youssef SC, Sabbubeh B, Haram K, Noël J, Aydın A, Challacombe B, et al. Augmented reality robot-assisted radical prostatectomy with PROXIMIE: preliminary clinical experience. Urology Video Journal. 2022;16:100187. [CrossRef]45,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51-Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53], whereas medical students [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54] and surgical trainees [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] frequently formed the mentee group. The evaluation studies were identified as having either descriptive or analytical study designs. The descriptive studies (n=7 articles) presented the usability or feasibility of the proposed dynamic AR cue, whereas analytical studies (n=15 articles) used comparators to measure effectiveness. Such analytical studies compared outcomes of telementoring using dynamic AR cue against performance with no cue (independent performance without mentoring), prerecorded visual cue (video guidance), in-person guidance, audio cue, or static AR cue (2D telestration). Audio cue [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50] and in-person guidance [Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20,Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42-Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54] were the most frequently used comparators.

The telementoring studies assessed the effectiveness of dynamic AR cues using a range of outcome measures. These were categorized broadly into factors based on technical evaluation and some of the items specified under the MERSQI outcomes domain [Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. Association between funding and quality of published medical education research. JAMA. 2007;298(9):1002-1009. [CrossRef] [Medline]38]. Accordingly, the factors measured included technical, perceptions, skills, and patient outcomes. Technical factors (n=4 articles) included assessment of information latency between mentor and mentee locations [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41,Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48,Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]52]. Perceptions (n=5 articles) consisted of preferences, subjective performance assessment, user ratings, and workload measured using NASA (National Aeronautics and Space Administration) Task Load Index (NASA-TLX) [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]21,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Youssef SC, Sabbubeh B, Haram K, Noël J, Aydın A, Challacombe B, et al. Augmented reality robot-assisted radical prostatectomy with PROXIMIE: preliminary clinical experience. Urology Video Journal. 2022;16:100187. [CrossRef]45,Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53]. Skills (n=13 articles) encompassed Critical View of Safety (CVS), economy of movement, fundamentals of laparoscopic surgery (FLS), gaze behavior, Global Operative Assessment of Laparoscopic Skills (GOALS), number of errors, operating time, Objective Structured Assessment of Technical Skills (OSATS), and turn frequency measuring communication skills [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42-Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49-Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]51,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. Patient outcomes (n=1 article) included hemoglobin level, urinary retention, complications, and anesthesia use in a real surgery setting [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46].


One of the aims of the scoping review was to present a comprehensive summary of the use of dynamic AR cues for telementoring during MIS. Through systematic searches of the scientific literature, it was observed that dynamic AR cues for telementoring were more frequently implemented for laparoscopic surgeries (as compared with robot-assisted surgeries). It was mainly used for teaching suturing skills on synthetic phantoms and remote mentoring during simulated cholecystectomy procedures. The mentors primarily consisted of expert surgeons, while medical students and surgical trainees dominated the mentee group. The use of hand gestures and surgical tools as dynamic AR cues were more frequent as compared with virtual pointers. Hand gestures and surgical tools allowed the mentor to convey information such as position, orientation, and tool tip motions to the mentee. To display the dynamic AR cues to the mentee, a small proportion of the studies used iPad tablets (n=1, 5%) Microsoft HoloLens (n=3, 14%), and the surgeon’s console with stereoscopic vision for robot-assisted surgery (n=4, 19%). However, most of the articles used a standard visualization screen (n=13, 62%) through which the mentee was able to see the AR cues. Among the included articles, at least 14 (67%) of them had a study design where the use of dynamic AR cue was compared with different modes of instruction with the most common comparators being audio cues and in-person guidance. The key factor used for evaluation was skills. The most frequently reported outcome measures were time taken for task completion and number of errors.

In general, the results of the included papers suggest that participants subjected to telementoring with dynamic AR cues experienced considerable beneficial effects when compared with groups receiving no cue, prerecorded visual cue, in-person guidance, audio cue, or static AR cue. More specifically, dynamic AR cues resulted in significant improvement of FLS score when compared with no cue [Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44] and lowered error count (P<.05) when compared with prerecorded visual cues [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43]. While comparing against in-person guidance, some studies reported longer operating time [Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42], increased anesthesia use, and cauterization [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46] with the use of dynamic AR cues. At the same time, few others noted a reduced complication percentage [Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.20], lower operating time (P=.01), steeper learning curve, and fewer failed attempts [Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. Furthermore, several other studies found no significant difference in performance [Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42,Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44], number of errors [Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54], operating time [Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]43,El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46], and clinical outcomes [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46]. This indicates that telementoring using dynamic AR cues was similar to in-person guidance. While comparing with audio cues, some studies reported no significant difference in CVS, GOALS score [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40], number of errors [Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50], and operating time [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50]. However, the majority of studies demonstrated significant advantages of dynamic AR cues over audio cues. These were in terms of subjective performance [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50], user ratings [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40], NASA-TLX score (P<.022) [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13], economy of movement [Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47,Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]50], error rates [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18,Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]47], gaze behavior (P<.01) [Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18], GOALS score [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13], operating time (P<.001) [Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13], OSATS score (P<.01) [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13,Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]18], turn frequency (P<.0001) [Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]49], and complications [Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]6,Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]13]. These results show that dynamic AR cues were comparable, and significantly superior to telementoring with audio cues alone. In addition, a study by Jarc et al [Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]53] noted that users preferred dynamic AR cues over static 2D telestrations. Overall, dynamic AR cues resulted in superior outcomes, and in some cases, they were considered on par with conventional methods such as in-person guidance and audio cues.

The extent to which the above-mentioned findings may be used to determine the benefits of the technology is limited. This is because majority of the analytical studies with a comparator were conducted on synthetic phantoms, mostly assessing suturing [Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.42-Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]44,Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]54]. Only 2 of the analytical studies were conducted in real patient settings comparing dynamic AR cue with audio during cholecystectomy [Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]40] and in-person guidance during aquablation [El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]46]. In addition, the outcome measures used to assess the different dynamic AR cues were not consistently used across the studies. The effectiveness of hand gestures was primarily assessed through OSATS, pointers through subjective performance, and surgical tools through latency and operating time. As a result, it is difficult to objectively compare between the different dynamic AR cues and determine the optimal one. Nevertheless, the articles published in the past few years reveal an upward trend in the use of hand gestures and surgical tools (Figure 5). This strongly indicates a rising interest in the use of dynamic AR cues for telementoring in MIS as well as the relevance of using hand gestures and surgical tools.

The implementation of telementoring using dynamic AR cues requires consideration of several technical factors. The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) issued a set of guidelines that telementoring systems are recommended to comply with. SAGES recommends that a minimum bandwidth of 40 megabits per second must be maintained. In addition, the latency (delay in sending mentee’s operative view to the remote mentor) must fall below 450 milliseconds [Bogen EM, Schlachta CM, Ponsky T. White paper: technology for surgical telementoring-SAGES project 6 technology working group. Surg Endosc. 2019;33(3):684-690. [CrossRef] [Medline]57]. One of the methods used to reduce latency is by encoding the video frames at the mentee’s location and decoding it at the mentor’s side. However, during this process, there is a risk of lowered video quality experienced by the mentor. To measure the extent of visual degradation experienced by the mentor, metrics such as structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR), and mean square error (MSE) are often used [Shabir D, Anbatawi M, Abdurahiman N, Trinh M, Padhan J, Al-Ansari A, et al. Benchmarking network performance of augmented reality based surgical telementoring systems. IEEE; 2022. Presented at: 2022 IEEE 22nd International Conference on Bioinformatics and Bioengineering (BIBE); 2022 November 07-09; Taichung, Taiwan. [CrossRef]58,Hassan A, Ghafoor M, Tariq SA, Zia T, Ahmad W. High efficiency video coding (HEVC)-based surgical telementoring system using shallow convolutional neural network. J Digit Imaging. 2019;32(6):1027-1043. [FREE Full text] [CrossRef] [Medline]59]. SSIM is considered more effective since it is more closely related to the visual quality perceived by the human eye, as compared with PSNR and MSE [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22]. The delay experienced by the mentee in receiving mentor’s instructions can be reduced when point cloud data (depicting hand gestures or surgical tool) is used instead of video data. Harnessing 5G and future 6G capabilities that provide extremely low latencies can ensure little to no disruption [Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170. [CrossRef] [Medline]23]. While several studies included in the review reported information latency between mentor and mentee, they were mostly conducted on synthetic phantoms [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22,Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]41,Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]48]. Further research presenting technical results during actual live MIS is imperative.

Figure 5. Number of articles using dynamic augmented reality cues in minimally invasive surgical telementoring.

Ethical, safety, and legal concerns must be addressed while implementing telementoring systems. Informed patient consent must be ensured [Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170. [CrossRef] [Medline]23]. Every effort should be made to minimize cybersecurity risks and ensure compliance with guidelines on telemedicine issued by HIPAA (Health Insurance Portability and Accountability Act) [Yang A, Kim D, Hwang PH, Lechner M. Telemedicine and telementoring in rhinology, otology, and laryngology: a scoping review. OTO Open. 2022;6(1):2473974X211072791. [FREE Full text] [CrossRef] [Medline]31]. The computer systems at both the mentor and mentee locations must be secure with monitoring schemes in place to detect and prevent potential breaches of sensitive patient data. To protect the data while being transferred between the mentor and mentee, appropriate data encryption and virtual private networks must be used [Bogen EM, Schlachta CM, Ponsky T. White paper: technology for surgical telementoring-SAGES project 6 technology working group. Surg Endosc. 2019;33(3):684-690. [CrossRef] [Medline]57]. In addition, a clearly outlined process for licensure and credentialing of surgeons is also required for remotely located mentors [SAGES Digital Surgery Working Group, Ali JT, Yang G, Green CA, Reed BL, Madani A, et al. Defining digital surgery: a SAGES white paper. Surg Endosc. 2024;38(2):475-487. [CrossRef] [Medline]8]. Generally, the mentee (who will be a competent operating surgeon) holds primary medical responsibility and is legally liable. Nonetheless, the SAGES states that during telementoring, the remote mentor retains shared responsibility for the patient [Schlachta CM, Nguyen NT, Ponsky T, Dunkin B. Project 6 summit: SAGES telementoring initiative. Surg Endosc. 2016;30(9):3665-3672. [CrossRef] [Medline]60]. Consequently, the mentor must hold the necessary medical license and surgical privileges in the region where the surgery is taking place. This becomes a barrier to adopting telementoring nationally in places like the United States and Canada as licensing is usually at the state or provincial level. However, this would not be a problem in the European Union (EU) where surgeons licensed under one EU member state can practice in other EU states as well [Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]22]. Furthermore, licensing requirements would not be an issue when dynamic AR cues are used to enhance in-person guidance.

Telementoring using dynamic AR cues addresses the need for efficient ways to remotely guide an operating surgeon. This can be potentially replaced with telesurgery where the remote surgeon performs the surgery through robot-assisted surgical systems. While successful telesurgery cases were reported since the early 2000s, significant progress was made only in the recent years owing to the advances in surgical robot systems as well as telecommunication technologies [Dohler M, Saikali S, Gamal A, Moschovas MC, Patel V. The crucial role of 5G, 6G, and fiber in robotic telesurgery. J Robot Surg. 2024;19(1):4. [CrossRef] [Medline]61]. However, several factors prevent widespread adoption of telesurgery. Although 5G networks are available, 3G or 4G is the standard in most countries leading to major concerns about latency. In addition, more research is needed to assess the cost-effectiveness of telesurgical services. A long-term sustainable approach must be explored for implementation and maintenance. Nonetheless, several cases of telesurgery for surgical specialties such as general, urology, and neurosurgery have been reported [Reddy SK, Saikali S, Gamal A, Moschovas MC, Rogers T, Dohler M, et al. Telesurgery a systematic literature review and future directions. Ann Surg. 2024. [CrossRef] [Medline]62]. This provides hope for using remote technologies to reduce the global burden of death and disease that can be prevented or treated through surgical care.

This review is limited by the inclusion of articles published in English only, making it less comprehensive. A risk of bias assessment of the included studies was not carried out. A comparative analysis between the different dynamic AR cues was not conducted due to the variety in outcome measures reported. Instead, overall summary potentially guiding future research on dynamic AR cues used for MIS telementoring is presented.

Although further research is needed to establish its benefits over conventional mentoring, the use of dynamic AR cues in MIS telementoring proves to be promising. Future developments may focus on evaluating the technology through multi-institutional randomized controlled trials. In addition to measures of perceptions and skills, objective clinical outcomes that reliably assess the effectiveness of telementoring should also be evaluated.

Acknowledgments

We would like to thank the Clinical Academic Department for their support and guidance. Research reported in this publication was supported by the Qatar Research, Development and Innovation (QRDI) Council Academic Research Grant (ARG) award (ARG01-0430-230047). All opinions, findings, conclusions, or recommendations expressed in this work are those of the authors and do not necessarily reflect the views of our sponsors.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Search strategy used for PubMed and other databases.

DOCX File , 17 KB

Multimedia Appendix 2

Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist.

DOCX File , 85 KB

  1. Fernandes RD, Ghasroddashti A, Sorefan-Mangou F, Williams E, Choi K, Fasola L, et al. Educational effectiveness of telementoring as a continuing professional development intervention for surgeons in practice: a systematic review. Ann Surg Open. 2023;4(4):e341. [FREE Full text] [CrossRef] [Medline]
  2. Netzer I, Kirkpatrick AW, Nissan M, McKee JL, McBeth P, Dobron A, et al. Rubrum coelis: the contribution of real-time telementoring in acute trauma scenarios-a randomized controlled trial. Telemed J E Health. 2019;25(11):1108-1114. [CrossRef] [Medline]
  3. Sparn MB, Teixeira H, Chatziisaak D, Schmied B, Hahnloser D, Bischofberger S. Virtual reality simulation training in laparoscopic surgery - does it really matter, what simulator to use? Results of a cross-sectional study. BMC Med Educ. 2024;24(1):589. [FREE Full text] [CrossRef] [Medline]
  4. Wagenaar S, Nederhoed JH, Hoksbergen AW, Bonjer HJ, Wisselink W, van Ramshorst GH. Minimally invasive, laparoscopic, and robotic-assisted techniques versus open techniques for kidney transplant recipients: a systematic review. Eur Urol. 2017;72(2):205-217. [CrossRef] [Medline]
  5. Chang SY, Chan KS, Oo AM. Can computerized simulation be used to assess surgical proficiency in laparoscopic colorectal surgeries? A systematic review. Surg Innov. 2024;31(2):195-211. [CrossRef] [Medline]
  6. Cizmic A, Müller F, Wise PA, Häberle F, Gabel F, Kowalewski KF, et al. Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study. Surg Endosc. 2023;37(10):7839-7848. [FREE Full text] [CrossRef] [Medline]
  7. Rollan L, Gigena C, Diaz Saubidet I, Valverde S, Bellia-Munzon G, Millán C. Innovation and challenges: minimally invasive surgery training in Latin America. Cir Pediatr. 2024;37(4):147-151. [FREE Full text] [CrossRef] [Medline]
  8. SAGES Digital Surgery Working Group, Ali JT, Yang G, Green CA, Reed BL, Madani A, et al. Defining digital surgery: a SAGES white paper. Surg Endosc. 2024;38(2):475-487. [CrossRef] [Medline]
  9. Rafiq A, Moore JA, Zhao X, Doarn CR, Merrell RC. Digital video capture and synchronous consultation in open surgery. Ann Surg. 2004;239(4):567-573. [CrossRef] [Medline]
  10. Eadie LH, Seifalian AM, Davidson BR. Telemedicine in surgery. Br J Surg. 2003;90(6):647-658. [CrossRef] [Medline]
  11. Erridge S, Yeung DKT, Patel HRH, Purkayastha S. Telementoring of surgeons: a systematic review. Surg Innov. 2019;26(1):95-111. [FREE Full text] [CrossRef] [Medline]
  12. Gasques D, Johnson JG, Sharkey T, Feng Y, Wang R, Xu ZR, et al. ARTEMIS: a collaborative mixed-reality system for immersive surgical telementoring. Association for Computing Machinery; 2021. Presented at: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems; 8 - 13 May 2021:1-14; Yokohama, Japan. [CrossRef]
  13. Wild C, Lang F, Gerhäuser AS, Schmidt MW, Kowalewski KF, Petersen J, et al. Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study. Surg Endosc. 2022;36(10):7453-7461. [FREE Full text] [CrossRef] [Medline]
  14. Lin Z, Xu Z, Liu H, Wang X, Ai X, Zhou C, et al. Robotic manipulator‐assisted omnidirectional augmented reality for endoluminal intervention telepresence. Advanced Intelligent Systems. 2024;6(1). [CrossRef]
  15. Dinh A, Yin AL, Estrin D, Greenwald P, Fortenko A. Augmented reality in real-time telemedicine and telementoring: scoping review. JMIR Mhealth Uhealth. 2023;11:e45464. [FREE Full text] [CrossRef] [Medline]
  16. Collins JW, Chen J, Hung A. Telementoring for minimally invasive surgery. Robotic Surgery. 2021:361-378. [CrossRef]
  17. Budrionis A, Augestad KM, Patel HR, Bellika JG. An evaluation framework for defining the contributions of telestration in surgical telementoring. Interact J Med Res. 2013;2(2):e14. [FREE Full text] [CrossRef] [Medline]
  18. Felinska EA, Fuchs TE, Kogkas A, Chen ZW, Otto B, Kowalewski KF, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557-3566. [FREE Full text] [CrossRef] [Medline]
  19. Bilgic E, Turkdogan S, Watanabe Y, Madani A, Landry T, Lavigne D, et al. Effectiveness of telementoring in surgery compared with on-site mentoring: a systematic review. Surg Innov. 2017;24(4):379-385. [CrossRef] [Medline]
  20. Shabir D, Padhan J, Mohammed A, Al-Ansari A, Tsiamyrtzis P, Navkar NV, et al. Telementoring system assessment integrated with laparoscopic surgical simulators. IEEE; 2023. Presented at: 2023 IEEE 5th Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS); 2023 June 02-04; Tainan, Taiwan.
  21. Jarc AM, Stanley AA, Clifford T, Gill IS, Hung AJ. Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study. World J Urol. 2017;35(6):957-965. [CrossRef] [Medline]
  22. Shabir D, Abdurahiman N, Padhan J, Anbatawi M, Trinh M, Balakrishnan S, et al. Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery. Surg Endosc. 2022;36(5):3663-3674. [FREE Full text] [CrossRef] [Medline]
  23. Nickel F, Cizmic A, Chand M. Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring. JAMA Surg. 2022;157(2):169-170. [CrossRef] [Medline]
  24. Bui DT, Barnett T, Hoang H, Chinthammit W. Tele-mentoring using augmented reality technology in healthcare: a systematic review. AJET. 2021;37(4):68-88. [CrossRef]
  25. Huang EY, Knight S, Guetter CR, Davis CH, Moller M, Slama E, et al. Telemedicine and telementoring in the surgical specialties: a narrative review. Am J Surg. 2019;218(4):760-766. [CrossRef] [Medline]
  26. Jin ML, Brown MM, Patwa D, Nirmalan A, Edwards PA. Telemedicine, telementoring, and telesurgery for surgical practices. Curr Probl Surg. 2021;58(12):100986. [CrossRef] [Medline]
  27. Gerardo R, Lele P, Sundaram K, Ponsky T. Surgical telementoring: feasibility, applicability, and how to. J Surg Oncol. 2021;124(2):241-245. [CrossRef] [Medline]
  28. A Butt K, Augestad KM. Educational value of surgical telementoring. J Surg Oncol. 2021;124(2):231-240. [FREE Full text] [CrossRef] [Medline]
  29. Pfennig M, Lee A, Mi M. How does telementoring impact medical education within the surgical field? A scoping review. Am J Surg. 2022;224(3):869-880. [FREE Full text] [CrossRef] [Medline]
  30. Hamza H, Al-Ansari A, Navkar NV. Technologies used for telementoring in open surgery: a scoping review. Telemed J E Health. 2024;30(7):1810-1824. [CrossRef] [Medline]
  31. Yang A, Kim D, Hwang PH, Lechner M. Telemedicine and telementoring in rhinology, otology, and laryngology: a scoping review. OTO Open. 2022;6(1):2473974X211072791. [FREE Full text] [CrossRef] [Medline]
  32. Seeliger B, Collins JW, Porpiglia F, Marescaux J. The role of virtual reality, telesurgery, and teleproctoring in robotic surgery. In: Robotic Urologic Surgery. Heidelberger Platz. Springer International Publishing; 2022:61-77.
  33. Ayoub CH, El-Asmar JM, Abdulfattah S, El-Hajj A. Telemedicine and telementoring in urology: a glimpse of the past and a leap into the future. Front Surg. 2022;9:811749. [FREE Full text] [CrossRef] [Medline]
  34. Augestad KM, Han H, Paige J, Ponsky T, Schlachta CM, Dunkin B, et al. Educational implications for surgical telementoring: a current review with recommendations for future practice, policy, and research. Surg Endosc. 2017;31(10):3836-3846. [CrossRef] [Medline]
  35. Hung AJ, Chen J, Shah A, Gill IS. Telementoring and telesurgery for minimally invasive procedures. J Urol. 2018;199(2):355-369. [CrossRef] [Medline]
  36. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. [FREE Full text] [CrossRef] [Medline]
  37. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. [FREE Full text] [CrossRef] [Medline]
  38. Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. Association between funding and quality of published medical education research. JAMA. 2007;298(9):1002-1009. [CrossRef] [Medline]
  39. Glossop SC, Bhachoo H, Murray TM, Cherif RA, Helo JY, Morgan E, et al. Undergraduate teaching of surgical skills in the UK: systematic review. BJS Open. 2023;7(5):zrad083. [FREE Full text] [CrossRef] [Medline]
  40. Huettl F, Heinrich F, Boedecker C, Vradelis L, Ludt A, Kneist W, et al. Real-time augmented reality annotation for surgical education during laparoscopic surgery: results from a single-center randomized controlled trial and future aspects. J Am Coll Surg. 2023;237(2):292-300. [CrossRef] [Medline]
  41. Long Y, Li C, Dou Q. Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;11(4):1027-1032. [CrossRef]
  42. Shabir D, Balakrishnan S, Padhan J, Yaacoub E, Mohammed A, Deng Z, et al. Evaluating a remote tele-mentoring gameplay setup for teaching laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH); 2023 August 28-30; Athens, Greece.
  43. Shabir D, Balakrishnan S, Padhan J, Abinahed J, Yaacoub E, Mohammed A, et al. Tele-mentoring using augmented reality: a feasibility study to assess teaching of laparoscopic suturing skills. IEEE; 2023. Presented at: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS); 2023 June 22-24; L'Aquila, Italy. [CrossRef]
  44. Lowry B, Johnson GGRJ, Vergis A. Merged virtual reality teaching of the fundamentals of laparoscopic surgery: a randomized controlled trial. Surg Endosc. 2022;36(9):6368-6376. [FREE Full text] [CrossRef] [Medline]
  45. Youssef SC, Sabbubeh B, Haram K, Noël J, Aydın A, Challacombe B, et al. Augmented reality robot-assisted radical prostatectomy with PROXIMIE: preliminary clinical experience. Urology Video Journal. 2022;16:100187. [CrossRef]
  46. El-Asmar JM, Labban M, El-Hajj A. Integration of aquablation through telemetry: an alternative to onsite proctoring? World J Urol. 2021;39(9):3473-3479. [FREE Full text] [CrossRef] [Medline]
  47. Heinrich F, Huettl F, Schmidt G, Paschold M, Kneist W, Huber T, et al. HoloPointer: a virtual augmented reality pointer for laparoscopic surgery training. Int J Comput Assist Radiol Surg. 2021;16(1):161-168. [FREE Full text] [CrossRef] [Medline]
  48. Shabir D, Abdurahiman N, Padhan J, Trinh M, Balakrishnan S, Kurer M, et al. Towards development of a tele-mentoring framework for minimally invasive surgeries. Int J Med Robot. 2021;17(5):e2305. [CrossRef] [Medline]
  49. Feng Y, Li K, Semsar A, Mcgowan H, Mun J, Zahiri HR, et al. Communication cost of single-user gesturing tool in laparoscopic surgical training. 2019. Presented at: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; 4 - 9 May 2019; Glasgow Scotland Uk. [CrossRef]
  50. Feng Y, McGowan H, Semsar A, Zahiri HR, George IM, Turner T, et al. A virtual pointer to support the adoption of professional vision in laparoscopic training. Int J Comput Assist Radiol Surg. 2018;13(9):1463-1472. [CrossRef] [Medline]
  51. Kowalewski KF, Hendrie JD, Schmidt MW, Garrow CR, Bruckner T, Proctor T, et al. Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg Endosc. 2017;31(5):2155-2165. [CrossRef] [Medline]
  52. Davis MC, Can DD, Pindrik J, Rocque BG, Johnston JM. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World Neurosurg. 2016;86:103-111. [FREE Full text] [CrossRef] [Medline]
  53. Jarc AM, Shah SH, Adebar T, Hwang E, Aron M, Gill IS, et al. Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J Robot Surg. 2016;10(2):103-109. [FREE Full text] [CrossRef] [Medline]
  54. Vera AM, Russo M, Mohsin A, Tsuda S. Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology. Surg Endosc. 2014;28(12):3467-3472. [CrossRef] [Medline]
  55. Syamlan A, Fathurachman, Denis K, Vander Poorten E, Pramujati B, Tjahjowidodo T. Haptic/virtual reality orthopedic surgical simulators: a literature review. Virtual Reality. 2022;26(4):1795-1825. [CrossRef]
  56. Higgins M, Leung S, Radacsi N. 3D printing surgical phantoms and their role in the visualization of medical procedures. Annals of 3D Printed Medicine. 2022;6:100057. [CrossRef]
  57. Bogen EM, Schlachta CM, Ponsky T. White paper: technology for surgical telementoring-SAGES project 6 technology working group. Surg Endosc. 2019;33(3):684-690. [CrossRef] [Medline]
  58. Shabir D, Anbatawi M, Abdurahiman N, Trinh M, Padhan J, Al-Ansari A, et al. Benchmarking network performance of augmented reality based surgical telementoring systems. IEEE; 2022. Presented at: 2022 IEEE 22nd International Conference on Bioinformatics and Bioengineering (BIBE); 2022 November 07-09; Taichung, Taiwan. [CrossRef]
  59. Hassan A, Ghafoor M, Tariq SA, Zia T, Ahmad W. High efficiency video coding (HEVC)-based surgical telementoring system using shallow convolutional neural network. J Digit Imaging. 2019;32(6):1027-1043. [FREE Full text] [CrossRef] [Medline]
  60. Schlachta CM, Nguyen NT, Ponsky T, Dunkin B. Project 6 summit: SAGES telementoring initiative. Surg Endosc. 2016;30(9):3665-3672. [CrossRef] [Medline]
  61. Dohler M, Saikali S, Gamal A, Moschovas MC, Patel V. The crucial role of 5G, 6G, and fiber in robotic telesurgery. J Robot Surg. 2024;19(1):4. [CrossRef] [Medline]
  62. Reddy SK, Saikali S, Gamal A, Moschovas MC, Rogers T, Dohler M, et al. Telesurgery a systematic literature review and future directions. Ann Surg. 2024. [CrossRef] [Medline]


AR: augmented reality
ART: augmented reality telementoring
CVS: Critical View of Safety
EU: European union
FLS: fundamentals of laparoscopic surgery
GOALS: Global Operative Assessment of Laparoscopic Skills
HIPAA: Health Insurance Portability and Accountability Act
HMD: head-mounted display
MERSQI: Medical Education Research Study Quality Instrument
MIS: minimally invasive surgery
MSE: mean square error
NASA-TLX: NASA (National Aeronautics and Space Administration)Task Load Index
OSATS: Objective Structured Assessment of Technical Skills
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
PSNR: peak signal-to-noise ratio
RQ: research question
SAGES: Society of American Gastrointestinal and Endoscopic Surgeons
SSIM: structural similarity index measure
VIPAR: Virtual Interactive Presence and Augmented Reality


Edited by T de Azevedo Cardoso; submitted 03.07.24; peer-reviewed by R Li, X Cheng; comments to author 04.11.24; revised version received 21.11.24; accepted 23.12.24; published 03.02.25.

Copyright

©Hawa Hamza, Omar M Aboumarzouk, Abdulla Al-Ansari, Nikhil V Navkar. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 03.02.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.