Identifying the common and subject-specific functional units of speech movements via a joint sparse non-negative matrix factorization framework

Jonghye Woo, Fangxu Xing, Jerry L. Prince, Maureen Stone, Timothy G. Reese, Van J. Wedeen, Georges El Fakhri

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The tongue is capable of producing intelligible speech because of successful orchestration of muscle groupings-i.e., functional units-of the highly complex muscles over time. Due to the different motions that tongues produce, functional units are transitional structures which transform muscle activity to surface tongue geometry and they vary significantly from one subject to another. In order to compare and contrast the location and size of functional units in the presence of such substantial inter-person variability, it is essential to study both common and subject-specific functional units in a group of people carrying out the same speech task. In this work, a new normalization technique is presented to simultaneously identify the common and subject-specific functional units defined in the tongue when tracked by tagged magnetic resonance imaging. To achieve our goal, a joint sparse non-negative matrix factorization framework is used, which learns a set of building blocks and subject-specific as well as common weighting matrices from motion quantities extracted from displacements. A spectral clustering technique is then applied to the subject-specific and common weighting matrices to determine the subject-specific functional units for each subject and the common functional units across subjects. Our experimental results using in vivo tongue motion data show that our approach is able to identify the common and subject-specific functional units with reduced size variability of tongue motion during speech.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2020
Subtitle of host publicationImage Processing
EditorsIvana Isgum, Bennett A. Landman
PublisherSPIE
ISBN (Electronic)9781510633933
DOIs
StatePublished - 2020
EventMedical Imaging 2020: Image Processing - Houston, United States
Duration: Feb 17 2020Feb 20 2020

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11313
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2020: Image Processing
CountryUnited States
CityHouston
Period2/17/202/20/20

Keywords

  • Functional Units
  • MRI
  • Speech
  • Tongue Motion

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Identifying the common and subject-specific functional units of speech movements via a joint sparse non-negative matrix factorization framework'. Together they form a unique fingerprint.

Cite this