Dynamic palatogram generation from Cine MRI for normalized speech assessment

Muhan Shao, Aaron Carass, Jiachen Zhuo, Xiao Liang, Dima H. Ghunaim, Maureen L. Stone, Jerry L. Prince

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Speech is generated through complex contacts of the tongue with the palate and teeth. Evaluation of the tonguepalate contact can be beneficial in studies of linguistics, diagnosis and treatment of speech disorders, and speech synthesis. In this paper, we propose a method of tongue-palate contact assessment based on cine MR images during speech. We use a 2D U-Net to segment the space between the top of the tongue and the palates on the sagittal slices of the cine images. Then a series of MR palatograms are generated by computing the vertical thickness of the segmented space on all the sagittal slices and projecting onto the axial plane. Compared to static palatography and electropalatography, the proposed method assesses the tongue-palate contact information as well as the tongue-to-palate distances over time. We generate a sequence of MR palatograms for two healthy subjects, from three uttered phrases. During pronunciation of the selected phrases, the tongue-palate contact points and the relative tongue-to-palate distances were similar between the subjects.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage Processing
EditorsIvana Isgum, Bennett A. Landman
PublisherSPIE
ISBN (Electronic)9781510640214
DOIs
StatePublished - 2021
Externally publishedYes
EventMedical Imaging 2021: Image Processing - Virtual, Online, United States
Duration: Feb 15 2021Feb 19 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11596
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2021: Image Processing
Country/TerritoryUnited States
CityVirtual, Online
Period2/15/212/19/21

Keywords

  • Cine MRI
  • Palate
  • Palatogram
  • Speech
  • Tongue

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Dynamic palatogram generation from Cine MRI for normalized speech assessment'. Together they form a unique fingerprint.

Cite this