Abstract
Pre-operative CT data is available for several orthopedic and trauma interventions, and is mainly used to identify injuries and plan the surgical procedure. In this work we propose an intuitive augmented reality environment allowing visualization of pre-operative data during the intervention, with an overlay of the optical information from the surgical site. The pre-operative CT volume is first registered to the patient by acquiring a single C-Arm X-ray image and using 3D/2D intensity-based registration. Next, we use an RGBD sensor on the C-Arm to fuse the optical information of the surgical site with patient pre-operative medical data and provide an augmented reality environment. The 3D/2D registration of the pre-and intra-operative data allows us to maintain a correct visualization each time the C-Arm is repositioned or the patient moves. An overall mean target registration error (mTRE) and standard deviation of 5.24 ± 3.09 mm was measured averaged over 19 C-Arm poses. The proposed solution enables the surgeon to visualize pre-operative data overlaid with information from the surgical site (e.g. surgeon's hands, surgical tools, etc.) for any C-Arm pose, and negates issues of line-of-sight and long setup times, which are present in commercially available systems.
Original language | English (US) |
---|---|
Title of host publication | Medical Imaging 2018 |
Subtitle of host publication | Imaging Informatics for Healthcare, Research, and Applications |
Publisher | SPIE |
Volume | 10579 |
ISBN (Electronic) | 9781510616479 |
DOIs | |
State | Published - Jan 1 2018 |
Event | Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications - Houston, United States Duration: Feb 13 2018 → Feb 15 2018 |
Other
Other | Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications |
---|---|
Country/Territory | United States |
City | Houston |
Period | 2/13/18 → 2/15/18 |
Keywords
- 3D/2D Registration
- Augmented reality
- Pre-operative CT
- RGBD camera
ASJC Scopus subject areas
- Electronic, Optical and Magnetic Materials
- Biomaterials
- Atomic and Molecular Physics, and Optics
- Radiology Nuclear Medicine and imaging