ICG based Augmented-Reality-System for Sentinel Lymph Node Biopsy
View/ Open
Date
2018Author
Noll, Matthias
Noa-Rudolph, Werner
Wesarg, Stefan
Kraly, Michael
Stoffels, Ingo
Klode, Joachim
Spass, Cédric
Spass, Gerrit
Metadata
Show full item recordAbstract
In this paper we introduce a novel augmented-reality (AR) system for the sentinel lymph node (SLN) biopsy. The AR system consists of a cubic recording device with integrated stereo near-infrared (NIR) and stereo color cameras, an head mounted display (HMD) for visualizing the SLN information directly into the physicians view and a controlling software application. The labeling of the SLN is achieved using the fluorescent dye indocyanine green (ICG). The dye accumulates in the SLN where it is excited to fluorescence by applying infrared light. The fluorescence is recorded from two directions by the NIR stereo cameras using appropriate filters. Applying the known rigid camera geometry, an ICG depth map can be generated from the camera images, thus creating a live 3D representation of the SLN. The representation is then superimposed to the physicians field of view, by applying a series of coordinate system transformations, that are determined in four separate system calibration steps. To compensate for the head motion, the recording systems is continuously tracked by a single camera on the HMD using fiducial markers. Because the system does not require additional monitors, the physicians attention is kept solely on the operation site. This can potentially decrease the intervention time and render the procedure safer for the patient.
BibTeX
@inproceedings {10.2312:vcbm.20181224,
booktitle = {Eurographics Workshop on Visual Computing for Biology and Medicine},
editor = {Puig Puig, Anna and Schultz, Thomas and Vilanova, Anna and Hotz, Ingrid and Kozlikova, Barbora and Vázquez, Pere-Pau},
title = {{ICG based Augmented-Reality-System for Sentinel Lymph Node Biopsy}},
author = {Noll, Matthias and Noa-Rudolph, Werner and Wesarg, Stefan and Kraly, Michael and Stoffels, Ingo and Klode, Joachim and Spass, Cédric and Spass, Gerrit},
year = {2018},
publisher = {The Eurographics Association},
ISSN = {2070-5786},
ISBN = {978-3-03868-056-7},
DOI = {10.2312/vcbm.20181224}
}
booktitle = {Eurographics Workshop on Visual Computing for Biology and Medicine},
editor = {Puig Puig, Anna and Schultz, Thomas and Vilanova, Anna and Hotz, Ingrid and Kozlikova, Barbora and Vázquez, Pere-Pau},
title = {{ICG based Augmented-Reality-System for Sentinel Lymph Node Biopsy}},
author = {Noll, Matthias and Noa-Rudolph, Werner and Wesarg, Stefan and Kraly, Michael and Stoffels, Ingo and Klode, Joachim and Spass, Cédric and Spass, Gerrit},
year = {2018},
publisher = {The Eurographics Association},
ISSN = {2070-5786},
ISBN = {978-3-03868-056-7},
DOI = {10.2312/vcbm.20181224}
}