Generating anthropomorphic phantoms using fully unsupervised deformable image registration with convolutional neural networks

Junyu Chen, Ye Li, Yong Du, Eric C. Frey

Research output: Contribution to journalArticlepeer-review

Abstract

Purpose: Computerized phantoms have been widely used in nuclear medicine imaging for imaging system optimization and validation. Although the existing computerized phantoms can model anatomical variations through organ and phantom scaling, they do not provide a way to fully reproduce the anatomical variations and details seen in humans. In this work, we present a novel registration-based method for creating highly anatomically detailed computerized phantoms. We experimentally show substantially improved image similarity of the generated phantom to a patient image. Methods: We propose a deep-learning-based unsupervised registration method to generate a highly anatomically detailed computerized phantom by warping an XCAT phantom to a patient computed tomography (CT) scan. We implemented and evaluated the proposed method using the NURBS-based XCAT phantom and a publicly available low-dose CT dataset from TCIA. A rigorous tradeoff analysis between image similarity and deformation regularization was conducted to select the loss function and regularization term for the proposed method. A novel SSIM-based unsupervised objective function was proposed. Finally, ablation studies were conducted to evaluate the performance of the proposed method (using the optimal regularization and loss function) and the current state-of-the-art unsupervised registration methods. Results: The proposed method outperformed the state-of-the-art registration methods, such as SyN and VoxelMorph, by more than 8%, measured by the SSIM and less than 30%, by the MSE. The phantom generated by the proposed method was highly detailed and was almost identical in appearance to a patient image. Conclusions: A deep-learning-based unsupervised registration method was developed to create anthropomorphic phantoms with anatomies labels that can be used as the basis for modeling organ properties. Experimental results demonstrate the effectiveness of the proposed method. The resulting anthropomorphic phantom is highly realistic. Combined with realistic simulations of the image formation process, the generated phantoms could serve in many applications of medical imaging research.

Original languageEnglish (US)
Pages (from-to)6366-6380
Number of pages15
JournalMedical physics
Volume47
Issue number12
DOIs
StatePublished - Dec 2020

Keywords

  • computerized Phantom
  • convolutional Neural Networks
  • deep Neural Networks
  • image Registration
  • medical Image Simulation

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Generating anthropomorphic phantoms using fully unsupervised deformable image registration with convolutional neural networks'. Together they form a unique fingerprint.

Cite this