Fusion of concurrent single trial EEG data and FMRI data using multi-set canonical correlation analysis

Nicolle M. Correa, Tom Eichele, Tülay Adali, Yi Ou Li, Vince Daniel Calhoun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a data fusion method for the fusion of simultaneously acquired functional magnetic resonance imaging (fMRI) and single trial electroencephalography (EEG) data from multiple subjects using multi-set canonical correlation analysis (M-CCA). Our proposed technique utilizes the common time series information in the multimodal datasets to find trial-to-trial covariations across modalities, and based on these covariations, the data is decomposed into spatial maps for the fMRI data and a corresponding temporal evolution for the EEG data. Additionally, the analysis is performed simultaneously on data from a group of subjects, thus providing an efficient tool to make group inferences about cross-modality covariation. The proposed method is multivariate and hence facilitates the study of brain connectivity along with localization of brain function. We demonstrate the promise of the method in finding covarying trial-to-trial amplitude modulations in an auditory task involving implicit pattern learning.

Original languageEnglish (US)
Title of host publicationICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Pages5438-5441
Number of pages4
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010 - Dallas, TX, United States
Duration: Mar 14 2010Mar 19 2010

Other

Other2010 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010
CountryUnited States
CityDallas, TX
Period3/14/103/19/10

    Fingerprint

Keywords

  • Biomedical signal analysis
  • Electroencephalography
  • Functional magnetic resonance
  • Multi-set canonical correlation analysis
  • Multimodal analysis

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Correa, N. M., Eichele, T., Adali, T., Li, Y. O., & Calhoun, V. D. (2010). Fusion of concurrent single trial EEG data and FMRI data using multi-set canonical correlation analysis. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 5438-5441). [5494919] https://doi.org/10.1109/ICASSP.2010.5494919