DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Recognition and Segmentation of Surgical Gestures

Krishnan, Pooja (2019) Recognition and Segmentation of Surgical Gestures. DLR-Interner Bericht. DLR-IB-RM-OP-2019-194. Master's. TUM. 38 S.

[img] PDF


Temporal segmentation and recognition of actions performed throughout a video have numerous applications in robotics, medical science, surveillance, etc. It plays a crucial role in the field of Minimally Invasive Robotic Surgery (MIRS), wherein the results can help obscure skill deficiencies, predict the most probable future gesture and improve the quality of feedback provided during surgical training. The current state-of-the-art techniques for MIRS are developed based on kinematic data. However, recent works have found video data to be equally discriminative. In my work, the video-based action segmentation is performed using the Bidirectional Long short-term memory network designed originally for only kinematic data. The model was further improved to make predictions based on both kinematic and video data. Our model achieves competitive performance using both the video and kinematic data on the JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS). Further, the user is provided with information about the top 3 possible gesture predictions along with an estimate of the model’s confidence for each prediction. Additionally, the model was evaluated on a new surgical activity dataset called MIRO dataset, collected using the DLR’s MiroSurge System.

Item URL in elib:https://elib.dlr.de/133096/
Document Type:Monograph (DLR-Interner Bericht, Master's)
Title:Recognition and Segmentation of Surgical Gestures
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Date:11 December 2019
Refereed publication:No
Open Access:Yes
Number of Pages:38
Keywords:MIROSurge , Surgical Tasks, Neural Networks
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben Multisensorielle Weltmodellierung (old)
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013)
Deposited By: Beinhofer, Gabriele
Deposited On:07 Jan 2020 09:16
Last Modified:07 Jan 2020 09:16

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.