Segmentation of surgical instruments in laparoscopic videos: training dataset generation and deep-learning-based framework

Eung-Joo Lee; William Plishker; Xinyang Liu; Timothy Kane; Shuvra S. Bhattacharyya; Raj Shekhar

doi:10.1117/12.2512994

8 March 2019 Segmentation of surgical instruments in laparoscopic videos: training dataset generation and deep-learning-based framework

Eung-Joo Lee, William Plishker, Xinyang Liu, Timothy Kane, Shuvra S. Bhattacharyya, Raj Shekhar

Author Affiliations +

Proceedings Volume 10951, Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling; 109511T (2019) https://doi.org/10.1117/12.2512994
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Surgical instrument segmentation in laparoscopic image sequences can be utilized for a variety of applications during surgical procedures. Recent studies have shown that deep learning-based methods produce competitive results in surgical instrument segmentation. Difficulties, however, lie in the limited number of training datasets involving surgical instruments in laparoscopic image frames. Even though there are publicly available pixelwise training datasets along with trained models from the Robotic Instrument Segmentation challenge, we are not able to relate them to laparoscopic image frames from different surgical scenarios without any pre- or postprocessing. This is because they contain different instrument shapes, image backgrounds, and specular reflections, which implies laborious manual segmentation for training dataset generation. In this work, we propose a novel framework for semi-automated training dataset generation for the purpose of robust segmentation using deep learning. To generate training datasets in various surgical scenarios faster and more accurately, we utilize the publicly available trained model from the Robotic Instrument Segmentation challenge and then use the Watershed Segmentation-based method. For robust segmentation, we use a two-step approach: first, we obtain a coarse segmentation obtained from a deep convolutional neural network architecture, and then we refine the segmentation result via the GrabCut algorithm. Through experiments using four different laparoscopic image sequences, we demonstrate the ability of our proposed framework to provide robust segmentation quality.

Citation Download Citation

Eung-Joo Lee, William Plishker, Xinyang Liu, Timothy Kane, Shuvra S. Bhattacharyya, and Raj Shekhar "Segmentation of surgical instruments in laparoscopic videos: training dataset generation and deep-learning-based framework", Proc. SPIE 10951, Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling, 109511T (8 March 2019); https://doi.org/10.1117/12.2512994

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available