Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia

Evrim Acar, Yuri Levin-Schwartz, Vince Daniel Calhoun, Tulay Adali

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Neuroimaging modalities such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) provide information about neurological functions in complementary spatiotemporal resolutions; therefore, fusion of these modalities is expected to provide better understanding of brain activity. In this paper, we jointly analyze fMRI and EEG data collected during an auditory oddball task with the goal of capturing brain activity patterns that differ between patients with schizophrenia and healthy controls. Rather than selecting a single electrode or matricizing the third-order tensor that can be naturally used to represent multi-channel EEG signals, we preserve the multi-way structure of EEG data and use a coupled matrix and tensor factorization (CMTF) model to jointly analyze fMRI and EEG signals. Our analysis reveals that (i) joint analysis of EEG and fMRI using a CMTF model can capture meaningful temporal and spatial signatures of patterns that behave differently in patients and controls, and (ii) these differences and the interpretability of the associated components increase by including multiple electrodes from frontal, motor and parietal areas, but not necessarily by including all electrodes in the analysis.

Original languageEnglish (US)
Title of host publicationIEEE International Symposium on Circuits and Systems
Subtitle of host publicationFrom Dreams to Innovation, ISCAS 2017 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467368520
DOIs
StatePublished - Sep 25 2017
Externally publishedYes
Event50th IEEE International Symposium on Circuits and Systems, ISCAS 2017 - Baltimore, United States
Duration: May 28 2017May 31 2017

Other

Other50th IEEE International Symposium on Circuits and Systems, ISCAS 2017
CountryUnited States
CityBaltimore
Period5/28/175/31/17

Fingerprint

Electroencephalography
Tensors
Fusion reactions
Factorization
Electrodes
Brain
Neuroimaging
Magnetic Resonance Imaging

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Acar, E., Levin-Schwartz, Y., Calhoun, V. D., & Adali, T. (2017). Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia. In IEEE International Symposium on Circuits and Systems: From Dreams to Innovation, ISCAS 2017 - Conference Proceedings [8050303] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCAS.2017.8050303

Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia. / Acar, Evrim; Levin-Schwartz, Yuri; Calhoun, Vince Daniel; Adali, Tulay.

IEEE International Symposium on Circuits and Systems: From Dreams to Innovation, ISCAS 2017 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. 8050303.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Acar, E, Levin-Schwartz, Y, Calhoun, VD & Adali, T 2017, Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia. in IEEE International Symposium on Circuits and Systems: From Dreams to Innovation, ISCAS 2017 - Conference Proceedings., 8050303, Institute of Electrical and Electronics Engineers Inc., 50th IEEE International Symposium on Circuits and Systems, ISCAS 2017, Baltimore, United States, 5/28/17. https://doi.org/10.1109/ISCAS.2017.8050303
Acar E, Levin-Schwartz Y, Calhoun VD, Adali T. Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia. In IEEE International Symposium on Circuits and Systems: From Dreams to Innovation, ISCAS 2017 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. 8050303 https://doi.org/10.1109/ISCAS.2017.8050303
Acar, Evrim ; Levin-Schwartz, Yuri ; Calhoun, Vince Daniel ; Adali, Tulay. / Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia. IEEE International Symposium on Circuits and Systems: From Dreams to Innovation, ISCAS 2017 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017.
@inproceedings{255c8e7b272e47c9b2c77014ac4991ea,
title = "Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia",
abstract = "Neuroimaging modalities such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) provide information about neurological functions in complementary spatiotemporal resolutions; therefore, fusion of these modalities is expected to provide better understanding of brain activity. In this paper, we jointly analyze fMRI and EEG data collected during an auditory oddball task with the goal of capturing brain activity patterns that differ between patients with schizophrenia and healthy controls. Rather than selecting a single electrode or matricizing the third-order tensor that can be naturally used to represent multi-channel EEG signals, we preserve the multi-way structure of EEG data and use a coupled matrix and tensor factorization (CMTF) model to jointly analyze fMRI and EEG signals. Our analysis reveals that (i) joint analysis of EEG and fMRI using a CMTF model can capture meaningful temporal and spatial signatures of patterns that behave differently in patients and controls, and (ii) these differences and the interpretability of the associated components increase by including multiple electrodes from frontal, motor and parietal areas, but not necessarily by including all electrodes in the analysis.",
author = "Evrim Acar and Yuri Levin-Schwartz and Calhoun, {Vince Daniel} and Tulay Adali",
year = "2017",
month = "9",
day = "25",
doi = "10.1109/ISCAS.2017.8050303",
language = "English (US)",
booktitle = "IEEE International Symposium on Circuits and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia

AU - Acar, Evrim

AU - Levin-Schwartz, Yuri

AU - Calhoun, Vince Daniel

AU - Adali, Tulay

PY - 2017/9/25

Y1 - 2017/9/25

N2 - Neuroimaging modalities such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) provide information about neurological functions in complementary spatiotemporal resolutions; therefore, fusion of these modalities is expected to provide better understanding of brain activity. In this paper, we jointly analyze fMRI and EEG data collected during an auditory oddball task with the goal of capturing brain activity patterns that differ between patients with schizophrenia and healthy controls. Rather than selecting a single electrode or matricizing the third-order tensor that can be naturally used to represent multi-channel EEG signals, we preserve the multi-way structure of EEG data and use a coupled matrix and tensor factorization (CMTF) model to jointly analyze fMRI and EEG signals. Our analysis reveals that (i) joint analysis of EEG and fMRI using a CMTF model can capture meaningful temporal and spatial signatures of patterns that behave differently in patients and controls, and (ii) these differences and the interpretability of the associated components increase by including multiple electrodes from frontal, motor and parietal areas, but not necessarily by including all electrodes in the analysis.

AB - Neuroimaging modalities such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) provide information about neurological functions in complementary spatiotemporal resolutions; therefore, fusion of these modalities is expected to provide better understanding of brain activity. In this paper, we jointly analyze fMRI and EEG data collected during an auditory oddball task with the goal of capturing brain activity patterns that differ between patients with schizophrenia and healthy controls. Rather than selecting a single electrode or matricizing the third-order tensor that can be naturally used to represent multi-channel EEG signals, we preserve the multi-way structure of EEG data and use a coupled matrix and tensor factorization (CMTF) model to jointly analyze fMRI and EEG signals. Our analysis reveals that (i) joint analysis of EEG and fMRI using a CMTF model can capture meaningful temporal and spatial signatures of patterns that behave differently in patients and controls, and (ii) these differences and the interpretability of the associated components increase by including multiple electrodes from frontal, motor and parietal areas, but not necessarily by including all electrodes in the analysis.

UR - http://www.scopus.com/inward/record.url?scp=85032670577&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032670577&partnerID=8YFLogxK

U2 - 10.1109/ISCAS.2017.8050303

DO - 10.1109/ISCAS.2017.8050303

M3 - Conference contribution

AN - SCOPUS:85032670577

BT - IEEE International Symposium on Circuits and Systems

PB - Institute of Electrical and Electronics Engineers Inc.

ER -