An augmented reality and high-speed optical tracking system for laparoscopic surgery

Nati Nawawithan; Jeff Young; Patric Bettati; Armand P. Rathgeb; Kelden T. Pruitt; Jordan Frimpter; Henry Kim; Jonathan Yu; Davis Driver; Amanuel Shiferaw; Aditi Chaudhari; Brett A. Johnson; Jeffrey Gahan; James Yu; Baowei Fei

doi:10.1117/12.3008448

29 March 2024 An augmented reality and high-speed optical tracking system for laparoscopic surgery

Nati Nawawithan, Jeff Young, Patric Bettati, Armand P. Rathgeb, Kelden T. Pruitt, Jordan Frimpter, Henry Kim, Jonathan Yu, Davis Driver, Amanuel Shiferaw, Aditi Chaudhari, Brett A. Johnson, Jeffrey Gahan, James Yu, Baowei Fei

Author Affiliations +

Proceedings Volume 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling; 129280E (2024) https://doi.org/10.1117/12.3008448
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

While minimally invasive laparoscopic surgery can help reduce blood loss, reduce hospital time, and shorten recovery time compared to open surgery, it has the disadvantages of limited field of view and difficulty in locating subsurface targets. Our proposed solution applies an augmented reality (AR) system to overlay pre-operative images, such as those from magnetic resonance imaging (MRI), onto the target organ in the user’s real-world environment. Our system can provide critical information regarding the location of subsurface lesions to guide surgical procedures in real time. An infrared motion tracking camera system was employed to obtain real-time position data of the patient and surgical instruments. To perform hologram registration, fiducial markers were used to track and map virtual coordinates to the real world. In this study, phantom models of each organ were constructed to test the reliability and accuracy of the AR-guided laparoscopic system. Root mean square error (RMSE) was used to evaluate the targeting accuracy of the laparoscopic interventional procedure. Our results demonstrated a registration error of 2.42 ± 0.79 mm and a procedural targeting error of 4.17 ± 1.63 mm using our AR-guided laparoscopic system that will be further refined for potential clinical procedures.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Nati Nawawithan, Jeff Young, Patric Bettati, Armand P. Rathgeb, Kelden T. Pruitt, Jordan Frimpter, Henry Kim, Jonathan Yu, Davis Driver, Amanuel Shiferaw, Aditi Chaudhari, Brett A. Johnson, Jeffrey Gahan, James Yu, and Baowei Fei "An augmented reality and high-speed optical tracking system for laparoscopic surgery", Proc. SPIE 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling, 129280E (29 March 2024); https://doi.org/10.1117/12.3008448

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available