Deformable MR-CT image registration using an unsupervised synthesis and registration network for neuro-endoscopic surgery

R. Han, C. K. Jones, M. D. Ketcha, P. Wu, P. Vagdargi, Ali Uneri, J. Lee, M. Luciano, W. S. Anderson, J. H. Siewerdsen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Purpose: Deep-brain stimulation via neuro-endoscopic surgery is a challenging procedure that requires accurate targeting of deep-brain structures that can undergo deformations (up to 10 mm). Conventional deformable registration methods have the potential to resolve such geometric error between preoperative MR and intraoperative CT but at the expense of long computation time. New advances in deep learning methods offer benefits to inter-modality image registration accuracy and runtime using novel similarity metrics and network architectures. Method: An unsupervised deformable registration network is reported that first generates a synthetic CT from MR using CycleGAN and then registers the synthetic CT to the intraoperative CT using an inverse-consistent registration network. Diffeomorphism of the registration is maintained using deformation exponentiation "squaring and scaling"layers. The method was trained and tested on a dataset of CT and T1-weighted MR images with randomly simulated deformations that mimic deep-brain deformation during surgery. The method was compared to a baseline method using inter-modality deep learning registration, VoxelMorph. Results: The methods were tested on 10 pairs of CT/MR images from 5 subjects. The proposed method achieved a Dice score of 0.84±0.04 for the lateral ventricles, 0.72±0.09 for the 3rd ventricle, and 0.63±0.10 for the 4th ventricle, with target registration error (TRE) of 0.95±0.54 mm. The proposed method showed statistically significant improvement in both Dice score and TRE in comparison to inter-modality VoxelMorph, while maintaining a fast runtime of less than 3 seconds for a typical MR-CT pair of volume images. Conclusion: The proposed unsupervised image synthesis and registration network demonstrates the capability for accurate volumetric deformable MR-CT registration with near real-time performance. The method will be further developed for application in intraoperative CT (or cone-beam CT) guided neurosurgery.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
EditorsCristian A. Linte, Jeffrey H. Siewerdsen
PublisherSPIE
ISBN (Electronic)9781510640252
DOIs
StatePublished - 2021
EventMedical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling - Virtual, Online
Duration: Feb 15 2021Feb 19 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11598
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling
CityVirtual, Online
Period2/15/212/19/21

Keywords

  • Image Registration
  • Image Synthesis
  • Multimodality Registration
  • Unsupervised Learning

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Deformable MR-CT image registration using an unsupervised synthesis and registration network for neuro-endoscopic surgery'. Together they form a unique fingerprint.

Cite this