Tracking by Detection for Interactive Image Augmentation in Laparoscopy
Date
2012
Authors
Kim, Jae-Hak
Bartoli, A
Collins, Toby
Hartley, Richard
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Abstract
We present a system for marking, tracking and visually augmenting a deformable surgical site by the robust automatic detection of natural landmarks (image features) in laparoscopic surgery. In our system, the surgeon first selects a frame containing an organ of interest, and this is used by our system both to detect every instance of the organ in a laparoscopic video feed, and to recover the nonrigid deformations. The system then augments the video with customizable visual information such as the location of hidden or weakly visible structures (cysts, vessels, etc), or planned incision points, acquired from pre-operative or intra-operative data. Frame-rate organ detection is performed via a novel procedure that matches the current frame to the reference frame. Because laparoscopic images are known to be extremely difficult to match, we propose to use Shape-from-Shading and conformal flattening to cancel out much of the variation in appearance due to perspective foreshortening, and we then apply robust matching to the flattened surfaces. Experiments show robust tracking and detection results on a laparoscopic procedure with the uterus as target organ. As our system detects the organ in every frame, it is not impaired by target loss, contrary to most previous methods.
Description
Keywords
Keywords: Automatic Detection; Current frame; Customizable; Deformable surfaces; Frame-rate; Image features; Intra-operative; Laparoscopic procedures; Laparoscopic surgery; Natural landmark; Non-rigid deformation; Reference frame; Robust matching; Robust tracking; conformal mapping; deformable surface; detection; laparoscopy; tracking
Citation
Collections
Source
Lecture Notes in Computer Science (LNCS)
Type
Journal article
Book Title
Entity type
Access Statement
License Rights
Restricted until
2037-12-31
Downloads
File
Description