TY - JOUR
T1 - Canonical correlation analysis for feature-based fusion of biomedical imaging modalities and its application to detection of associative networks in Schizophrenia
AU - Correa, Nicolle M.
AU - Li, Yi Ou
AU - Adali, Tülay
AU - Calhoun, Vince D.
N1 - Funding Information:
Manuscript received March 15, 2008; revised October 02, 2008. Current version published January 23, 2009. This work was supported in part by NIH grant R01 EB 005846 and by the NSF grant 0612076. The associate editor coordinating the review of this manuscript and approving it for publication was A. Cichocki.
PY - 2008
Y1 - 2008
N2 - Typically data acquired through imaging techniques such as functional magnetic resonance imaging (fMRI), structural MRI (sMRI), and electroencephalography (EEG) are analyzed separately. However, fusing information from such complementary modalities promises to provide additional insight into connectivity across brain networks and changes due to disease. We propose a data fusion scheme at the feature level using canonical correlation analysis (CCA) to determine inter-subject covariations across modalities. As we show both with simulation results and application to real data, multimodal CCA (mCCA) proves to be a flexible and powerful method for discovering associations among various data types. We demonstrate the versatility of the method with application to two datasets, an fMRI and EEG, and an fMRI and sMRI dataset, both collected from patients diagnosed with schizophrenia and healthy controls. CCA results for fMRI and EEG data collected for an auditory oddball task reveal associations of the temporal and motor areas with the N2 and P3 peaks. For the application to fMRI and sMRI data collected for an auditory sensorimotor task, CCA results show an interesting joint relationship between fMRI and gray matter, with patients with schizophrenia showing more functional activity in motor areas and less activity in temporal areas associated with less gray matter as compared to healthy controls. Additionally, we compare our scheme with an independent component analysis based fusion method, joint-ICA that has proven useful for such a study and note that the two methods provide complementary perspectives on data fusion.
AB - Typically data acquired through imaging techniques such as functional magnetic resonance imaging (fMRI), structural MRI (sMRI), and electroencephalography (EEG) are analyzed separately. However, fusing information from such complementary modalities promises to provide additional insight into connectivity across brain networks and changes due to disease. We propose a data fusion scheme at the feature level using canonical correlation analysis (CCA) to determine inter-subject covariations across modalities. As we show both with simulation results and application to real data, multimodal CCA (mCCA) proves to be a flexible and powerful method for discovering associations among various data types. We demonstrate the versatility of the method with application to two datasets, an fMRI and EEG, and an fMRI and sMRI dataset, both collected from patients diagnosed with schizophrenia and healthy controls. CCA results for fMRI and EEG data collected for an auditory oddball task reveal associations of the temporal and motor areas with the N2 and P3 peaks. For the application to fMRI and sMRI data collected for an auditory sensorimotor task, CCA results show an interesting joint relationship between fMRI and gray matter, with patients with schizophrenia showing more functional activity in motor areas and less activity in temporal areas associated with less gray matter as compared to healthy controls. Additionally, we compare our scheme with an independent component analysis based fusion method, joint-ICA that has proven useful for such a study and note that the two methods provide complementary perspectives on data fusion.
KW - Biomedical signal analysis
KW - Canonical correlation analysis
KW - Correlation
KW - Electroencephalography
KW - Independent component analysis
KW - Magnetic resonance imaging
KW - Multimodal analysis
KW - Signal analysis
UR - http://www.scopus.com/inward/record.url?scp=60549115613&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=60549115613&partnerID=8YFLogxK
U2 - 10.1109/JSTSP.2008.2008265
DO - 10.1109/JSTSP.2008.2008265
M3 - Article
C2 - 19834573
AN - SCOPUS:60549115613
SN - 1932-4553
VL - 2
SP - 998
EP - 1007
JO - IEEE Journal on Selected Topics in Signal Processing
JF - IEEE Journal on Selected Topics in Signal Processing
IS - 6
ER -