TY - JOUR
T1 - Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI
AU - Correa, Nicolle M.
AU - Eichele, Tom
AU - Adali, Tülay
AU - Li, Yi Ou
AU - Calhoun, Vince D.
N1 - Funding Information:
This research was supported in part by the NIH grants R01 EB 005846 and R01 EB 000840 , and the NSF grant 0612076 .
PY - 2010/5/1
Y1 - 2010/5/1
N2 - Functional magnetic resonance imaging (fMRI) data and electroencephalography (EEG) data provide complementary spatio-temporal information about brain function. Methods to couple the relative strengths of these modalities usually involve two stages: first forming a feature set from each dataset based on one criterion followed by exploration of connections among the features using a second criterion. We propose a data fusion method for simultaneously acquired fMRI and EEG data that combines these steps using a single criterion for finding the cross-modality associations and performing source separation. Using multi-set canonical correlation analysis (M-CCA), we obtain a decomposition of the two modalities, into spatial maps for fMRI data and a corresponding temporal evolution for EEG data, based on trial-to-trial covariation across the two modalities. Additionally, the analysis is performed on data from a group of subjects in order to make group inferences about the covariation across modalities. Being multivariate, the proposed method facilitates the study of brain connectivity along with localization of brain function. M-CCA can be easily extended to incorporate different data types and additional modalities. We demonstrate the promise of the proposed method in finding covarying trial-to-trial amplitude modulations (AMs) in an auditory task involving implicit pattern learning. The results show approximately linear decreasing trends in AMs for both modalities and the corresponding spatial activations occur mainly in motor, frontal, temporal, inferior parietal, and orbito-frontal areas that are linked both to sensory function as well as learning and expectation-all of which match activations related to the presented paradigm.
AB - Functional magnetic resonance imaging (fMRI) data and electroencephalography (EEG) data provide complementary spatio-temporal information about brain function. Methods to couple the relative strengths of these modalities usually involve two stages: first forming a feature set from each dataset based on one criterion followed by exploration of connections among the features using a second criterion. We propose a data fusion method for simultaneously acquired fMRI and EEG data that combines these steps using a single criterion for finding the cross-modality associations and performing source separation. Using multi-set canonical correlation analysis (M-CCA), we obtain a decomposition of the two modalities, into spatial maps for fMRI data and a corresponding temporal evolution for EEG data, based on trial-to-trial covariation across the two modalities. Additionally, the analysis is performed on data from a group of subjects in order to make group inferences about the covariation across modalities. Being multivariate, the proposed method facilitates the study of brain connectivity along with localization of brain function. M-CCA can be easily extended to incorporate different data types and additional modalities. We demonstrate the promise of the proposed method in finding covarying trial-to-trial amplitude modulations (AMs) in an auditory task involving implicit pattern learning. The results show approximately linear decreasing trends in AMs for both modalities and the corresponding spatial activations occur mainly in motor, frontal, temporal, inferior parietal, and orbito-frontal areas that are linked both to sensory function as well as learning and expectation-all of which match activations related to the presented paradigm.
UR - http://www.scopus.com/inward/record.url?scp=77950594241&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77950594241&partnerID=8YFLogxK
U2 - 10.1016/j.neuroimage.2010.01.062
DO - 10.1016/j.neuroimage.2010.01.062
M3 - Article
C2 - 20100584
AN - SCOPUS:77950594241
VL - 50
SP - 1438
EP - 1445
JO - NeuroImage
JF - NeuroImage
SN - 1053-8119
IS - 4
ER -