Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs

Pengfei Guo, Puyang Wang, Rajeev Yasarla, Jinyuan Zhou, Vishal M. Patel, Shanshan Jiang

Research output: Contribution to journalArticlepeer-review


Data-driven automatic approaches have demonstrated their great potential in resolving various clinical diagnostic dilemmas in neuro-oncology, especially with the help of standard anatomic and advanced molecular MR images. However, data quantity and quality remain a key determinant, and a significant limit of the potential applications. In our previous work, we explored the synthesis of anatomic and molecular MR image networks (SAMR) in patients with post-Treatment malignant gliomas. In this work, we extend this through a confidence-guided SAMR (CG-SAMR) that synthesizes data from lesion contour information to multi-modal MR images, including T1-weighted ( {T}-{1}\text{w} ), gadolinium enhanced {T}-{1}\text{w} (Gd-{T}-{1}\text{w} ), T2-weighted ( {T}-{2}\text{w} ), and fluid-Attenuated inversion recovery ( \textit {FLAIR} ), as well as the molecular amide proton transfer-weighted ( \textit {APT}\text{w} ) sequence. We introduce a module that guides the synthesis based on a confidence measure of the intermediate results. Furthermore, we extend the proposed architecture to allow training using unpaired data. Extensive experiments on real clinical data demonstrate that the proposed model can perform better than current the state-of-The-Art synthesis methods. Our code is available at

Original languageEnglish (US)
Pages (from-to)2832-2844
Number of pages13
JournalIEEE transactions on medical imaging
Issue number10
StatePublished - Oct 1 2021


  • Generative adversarial network
  • confidence guidance
  • glioma
  • multi-modal MR image synthesis
  • segmentation

ASJC Scopus subject areas

  • Software
  • Radiological and Ultrasound Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Anatomic and Molecular MR Image Synthesis Using Confidence Guided CNNs'. Together they form a unique fingerprint.

Cite this