Augmented reality-based feedback for technician-in-the-loop C-arm repositioning

Mathias Unberath, Javad Fotouhi, Jonas Hajek, Andreas Maier, Greg Osgood, Russell H Taylor, Mehran Armand, Nassir Navab

Research output: Contribution to journalArticle

Abstract

Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation. We propose a marker-free ‘technician-in-the-loop’ Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display system capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a target view, the recorded pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. Our proof-of-principle findings from a simulated trauma surgery indicate that the proposed system can decrease the 2.76 X-ray images required for re-aligning the scanner with an intra-operatively recorded C-arm view down to zero, suggesting substantial reductions of radiation dose. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future.

Original languageEnglish (US)
Pages (from-to)143-147
Number of pages5
JournalHealthcare Technology Letters
Volume5
Issue number5
DOIs
StatePublished - Jan 1 2018

Fingerprint

Arm
X-Rays
Radiation
Orthopedic Procedures
Operative Time
Anatomy
Communication
Head
Wounds and Injuries
Surgeons

ASJC Scopus subject areas

  • Health Informatics
  • Health Information Management

Cite this

Augmented reality-based feedback for technician-in-the-loop C-arm repositioning. / Unberath, Mathias; Fotouhi, Javad; Hajek, Jonas; Maier, Andreas; Osgood, Greg; Taylor, Russell H; Armand, Mehran; Navab, Nassir.

In: Healthcare Technology Letters, Vol. 5, No. 5, 01.01.2018, p. 143-147.

Research output: Contribution to journalArticle

Unberath, Mathias ; Fotouhi, Javad ; Hajek, Jonas ; Maier, Andreas ; Osgood, Greg ; Taylor, Russell H ; Armand, Mehran ; Navab, Nassir. / Augmented reality-based feedback for technician-in-the-loop C-arm repositioning. In: Healthcare Technology Letters. 2018 ; Vol. 5, No. 5. pp. 143-147.
@article{738290ce62df487794ed119430fce52b,
title = "Augmented reality-based feedback for technician-in-the-loop C-arm repositioning",
abstract = "Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation. We propose a marker-free ‘technician-in-the-loop’ Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display system capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a target view, the recorded pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. Our proof-of-principle findings from a simulated trauma surgery indicate that the proposed system can decrease the 2.76 X-ray images required for re-aligning the scanner with an intra-operatively recorded C-arm view down to zero, suggesting substantial reductions of radiation dose. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future.",
author = "Mathias Unberath and Javad Fotouhi and Jonas Hajek and Andreas Maier and Greg Osgood and Taylor, {Russell H} and Mehran Armand and Nassir Navab",
year = "2018",
month = "1",
day = "1",
doi = "10.1049/htl.2018.5066",
language = "English (US)",
volume = "5",
pages = "143--147",
journal = "Healthcare Technology Letters",
issn = "2053-3713",
publisher = "Institution of Engineering and Technology",
number = "5",

}

TY - JOUR

T1 - Augmented reality-based feedback for technician-in-the-loop C-arm repositioning

AU - Unberath, Mathias

AU - Fotouhi, Javad

AU - Hajek, Jonas

AU - Maier, Andreas

AU - Osgood, Greg

AU - Taylor, Russell H

AU - Armand, Mehran

AU - Navab, Nassir

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation. We propose a marker-free ‘technician-in-the-loop’ Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display system capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a target view, the recorded pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. Our proof-of-principle findings from a simulated trauma surgery indicate that the proposed system can decrease the 2.76 X-ray images required for re-aligning the scanner with an intra-operatively recorded C-arm view down to zero, suggesting substantial reductions of radiation dose. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future.

AB - Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation. We propose a marker-free ‘technician-in-the-loop’ Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display system capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a target view, the recorded pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. Our proof-of-principle findings from a simulated trauma surgery indicate that the proposed system can decrease the 2.76 X-ray images required for re-aligning the scanner with an intra-operatively recorded C-arm view down to zero, suggesting substantial reductions of radiation dose. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future.

UR - http://www.scopus.com/inward/record.url?scp=85056400164&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056400164&partnerID=8YFLogxK

U2 - 10.1049/htl.2018.5066

DO - 10.1049/htl.2018.5066

M3 - Article

C2 - 30464844

AN - SCOPUS:85056400164

VL - 5

SP - 143

EP - 147

JO - Healthcare Technology Letters

JF - Healthcare Technology Letters

SN - 2053-3713

IS - 5

ER -