A Realistic Framework for Investigating Decision Making in the Brain with High Spatiotemporal Resolution Using Simultaneous EEG/fMRI and Joint ICA

Sreenath P. Kyathanahally, Ana Franco-Watkins, Xiaoxia Zhang, Vince D. Calhoun, Gopikrishna Deshpande

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

Human decision making is a multidimensional construct, driven by a complex interplay between external factors, internal biases, and computational capacity constraints. Here, we propose a layered approach to experimental design in which multiple tasks - from simple to complex - with additional layers of complexity introduced at each stage are incorporated for investigating decision making. This is demonstrated using tasks involving intertemporal choice between immediate and future prospects. Previous functional magnetic resonance imaging (fMRI) and electroencephalographic (EEG) studies have separately investigated the spatial and temporal neural substrates, respectively, of specific factors underlying decision making. In contrast, we performed simultaneous acquisition of EEG/fMRI data and fusion of both modalities using joint independent component analysis such that: 1) the native temporal/spatial resolutions of either modality is not compromised and 2) fast temporal dynamics of decision making as well as involved deeper striatal structures can be characterized. We show that spatiotemporal neural substrates underlying our proposed complex intertemporal task simultaneously incorporating rewards, costs, and uncertainty of future outcomes can be predicted (using a linear model) from neural substrates of each of these factors, which were separately obtained by simpler tasks. This was not the case for spatial and temporal features obtained separately from fMRI and EEG, respectively. However, certain prefrontal activations in the complex task could not be predicted from activations in simpler tasks, indicating that the assumption of pure insertion has limited validity. Overall, our approach provides a realistic and novel framework for investigating the neural substrates of decision making with high spatiotemporal resolution.

Original languageEnglish (US)
Article number7509628
Pages (from-to)814-825
Number of pages12
JournalIEEE Journal of Biomedical and Health Informatics
Volume21
Issue number3
DOIs
StatePublished - May 2017

Keywords

  • Decision making
  • electroencephalography (EEG)
  • functional magnetic resonance imaging (fMRI)
  • joint independent component analysis (jICA)
  • simultaneous EEG-fMRI

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Informatics
  • Electrical and Electronic Engineering
  • Health Information Management

Fingerprint

Dive into the research topics of 'A Realistic Framework for Investigating Decision Making in the Brain with High Spatiotemporal Resolution Using Simultaneous EEG/fMRI and Joint ICA'. Together they form a unique fingerprint.

Cite this