Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans

Peng Gui, Yixuan Ku, Lei Li, Xiaojin Li, Mark Bodner, Frederick Lenz, Liping Wang, Yong Di Zhou

Research output: Contribution to journalArticle

Abstract

Studies have indicated that a cortical sensory system is capable of processing information from different sensory modalities. However, it still remains unclear when and how a cortical system integrates and retains information across sensory modalities during learning. Here we investigated the neural dynamics underlying crossmodal associations and memory by recording event-related potentials (ERPs) when human participants performed visuo-tactile (crossmodal) and visuo-visual (unimodal) paired-associate (PA) learning tasks. In a trial of the tasks, the participants were required to explore and learn the relationship (paired or non-paired) between two successive stimuli. EEG recordings revealed dynamic ERP changes during participants’ learning of paired-associations. Specifically, (1) the frontal N400 component showed learning-related changes in both unimodal and crossmodal tasks but did not show any significant difference between these two tasks, while the central P400 displayed both learning changes and task differences; (2) a late posterior negative slow wave (LPN) showed the learning effect only in the crossmodal task; (3) alpha-band oscillations appeared to be involved in crossmodal working memory. Additional behavioral experiments suggested that these ERP components were not relevant to the participants’ familiarity with stimuli per se. Further, by shortening the delay length (from 1300 ms to 400 ms or 200 ms) between the first and second stimulus in the crossmodal task, declines in participants’ task performance were observed accordingly. Taken together, these results provide insights into the cortical plasticity (induced by PA learning) of neural networks involved in crossmodal associations in working memory.

Original languageEnglish (US)
Pages (from-to)181-195
Number of pages15
JournalNeuroscience
Volume362
DOIs
StatePublished - Oct 24 2017

Fingerprint

Paired-Associate Learning
Touch
Evoked Potentials
Learning
Short-Term Memory
Association Learning
Task Performance and Analysis
Automatic Data Processing
Electroencephalography

Keywords

  • crossmodal
  • ERP
  • paired-associate learning
  • visuo-tactile
  • working memory

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans. / Gui, Peng; Ku, Yixuan; Li, Lei; Li, Xiaojin; Bodner, Mark; Lenz, Frederick; Wang, Liping; Zhou, Yong Di.

In: Neuroscience, Vol. 362, 24.10.2017, p. 181-195.

Research output: Contribution to journalArticle

Gui, Peng ; Ku, Yixuan ; Li, Lei ; Li, Xiaojin ; Bodner, Mark ; Lenz, Frederick ; Wang, Liping ; Zhou, Yong Di. / Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans. In: Neuroscience. 2017 ; Vol. 362. pp. 181-195.
@article{28a9b95e35184cde9f17fafcc654c8a5,
title = "Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans",
abstract = "Studies have indicated that a cortical sensory system is capable of processing information from different sensory modalities. However, it still remains unclear when and how a cortical system integrates and retains information across sensory modalities during learning. Here we investigated the neural dynamics underlying crossmodal associations and memory by recording event-related potentials (ERPs) when human participants performed visuo-tactile (crossmodal) and visuo-visual (unimodal) paired-associate (PA) learning tasks. In a trial of the tasks, the participants were required to explore and learn the relationship (paired or non-paired) between two successive stimuli. EEG recordings revealed dynamic ERP changes during participants’ learning of paired-associations. Specifically, (1) the frontal N400 component showed learning-related changes in both unimodal and crossmodal tasks but did not show any significant difference between these two tasks, while the central P400 displayed both learning changes and task differences; (2) a late posterior negative slow wave (LPN) showed the learning effect only in the crossmodal task; (3) alpha-band oscillations appeared to be involved in crossmodal working memory. Additional behavioral experiments suggested that these ERP components were not relevant to the participants’ familiarity with stimuli per se. Further, by shortening the delay length (from 1300 ms to 400 ms or 200 ms) between the first and second stimulus in the crossmodal task, declines in participants’ task performance were observed accordingly. Taken together, these results provide insights into the cortical plasticity (induced by PA learning) of neural networks involved in crossmodal associations in working memory.",
keywords = "crossmodal, ERP, paired-associate learning, visuo-tactile, working memory",
author = "Peng Gui and Yixuan Ku and Lei Li and Xiaojin Li and Mark Bodner and Frederick Lenz and Liping Wang and Zhou, {Yong Di}",
year = "2017",
month = "10",
day = "24",
doi = "10.1016/j.neuroscience.2017.08.035",
language = "English (US)",
volume = "362",
pages = "181--195",
journal = "Neuroscience",
issn = "0306-4522",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Neural correlates of visuo-tactile crossmodal paired-associate learning and memory in humans

AU - Gui, Peng

AU - Ku, Yixuan

AU - Li, Lei

AU - Li, Xiaojin

AU - Bodner, Mark

AU - Lenz, Frederick

AU - Wang, Liping

AU - Zhou, Yong Di

PY - 2017/10/24

Y1 - 2017/10/24

N2 - Studies have indicated that a cortical sensory system is capable of processing information from different sensory modalities. However, it still remains unclear when and how a cortical system integrates and retains information across sensory modalities during learning. Here we investigated the neural dynamics underlying crossmodal associations and memory by recording event-related potentials (ERPs) when human participants performed visuo-tactile (crossmodal) and visuo-visual (unimodal) paired-associate (PA) learning tasks. In a trial of the tasks, the participants were required to explore and learn the relationship (paired or non-paired) between two successive stimuli. EEG recordings revealed dynamic ERP changes during participants’ learning of paired-associations. Specifically, (1) the frontal N400 component showed learning-related changes in both unimodal and crossmodal tasks but did not show any significant difference between these two tasks, while the central P400 displayed both learning changes and task differences; (2) a late posterior negative slow wave (LPN) showed the learning effect only in the crossmodal task; (3) alpha-band oscillations appeared to be involved in crossmodal working memory. Additional behavioral experiments suggested that these ERP components were not relevant to the participants’ familiarity with stimuli per se. Further, by shortening the delay length (from 1300 ms to 400 ms or 200 ms) between the first and second stimulus in the crossmodal task, declines in participants’ task performance were observed accordingly. Taken together, these results provide insights into the cortical plasticity (induced by PA learning) of neural networks involved in crossmodal associations in working memory.

AB - Studies have indicated that a cortical sensory system is capable of processing information from different sensory modalities. However, it still remains unclear when and how a cortical system integrates and retains information across sensory modalities during learning. Here we investigated the neural dynamics underlying crossmodal associations and memory by recording event-related potentials (ERPs) when human participants performed visuo-tactile (crossmodal) and visuo-visual (unimodal) paired-associate (PA) learning tasks. In a trial of the tasks, the participants were required to explore and learn the relationship (paired or non-paired) between two successive stimuli. EEG recordings revealed dynamic ERP changes during participants’ learning of paired-associations. Specifically, (1) the frontal N400 component showed learning-related changes in both unimodal and crossmodal tasks but did not show any significant difference between these two tasks, while the central P400 displayed both learning changes and task differences; (2) a late posterior negative slow wave (LPN) showed the learning effect only in the crossmodal task; (3) alpha-band oscillations appeared to be involved in crossmodal working memory. Additional behavioral experiments suggested that these ERP components were not relevant to the participants’ familiarity with stimuli per se. Further, by shortening the delay length (from 1300 ms to 400 ms or 200 ms) between the first and second stimulus in the crossmodal task, declines in participants’ task performance were observed accordingly. Taken together, these results provide insights into the cortical plasticity (induced by PA learning) of neural networks involved in crossmodal associations in working memory.

KW - crossmodal

KW - ERP

KW - paired-associate learning

KW - visuo-tactile

KW - working memory

UR - http://www.scopus.com/inward/record.url?scp=85029002505&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029002505&partnerID=8YFLogxK

U2 - 10.1016/j.neuroscience.2017.08.035

DO - 10.1016/j.neuroscience.2017.08.035

M3 - Article

C2 - 28843996

AN - SCOPUS:85029002505

VL - 362

SP - 181

EP - 195

JO - Neuroscience

JF - Neuroscience

SN - 0306-4522

ER -