Learning similar actions by reinforcement or sensory-prediction errors rely on distinct physiological mechanisms

Shintaro Uehara, Firas Mawase, Pablo A Celnik

Research output: Contribution to journalArticle

Abstract

Humans can acquire knowledge of new motor behavior via different forms of learning. The two forms most commonly studied have been the development of internal models based on sensory-prediction errors (error-based learning) and success-based feedback (reinforcement learning). Human behavioral studies suggest these are distinct learning processes, though the neurophysiological mechanisms that are involved have not been characterized. Here, we evaluated physiological markers from the cerebellum and the primary motor cortex (M1) using noninvasive brain stimulations while healthy participants trained finger-reaching tasks. We manipulated the extent to which subjects rely on error-based or reinforcement by providing either vector or binary feedback about task performance. Our results demonstrated a double dissociation where learning the task mainly via error-based mechanisms leads to cerebellar plasticity modifications but not long-term potentiation (LTP)-like plasticity changes in M1; while learning a similar action via reinforcement mechanisms elicited M1 LTP-like plasticity but not cerebellar plasticity changes. Our findings indicate that learning complex motor behavior is mediated by the interplay of different forms of learning, weighing distinct neural mechanisms in M1 and the cerebellum. Our study provides insights for designing effective interventions to enhance human motor learning.

Original languageEnglish (US)
Pages (from-to)3478-3490
Number of pages13
JournalCerebral Cortex
Volume28
Issue number10
DOIs
StatePublished - Oct 1 2018

Fingerprint

Learning
Long-Term Potentiation
Cerebellum
Reinforcement (Psychology)
Motor Cortex
Task Performance and Analysis
Fingers
Healthy Volunteers
Brain

Keywords

  • cerebellar inhibition (CBI)
  • error-based learning
  • long-term potentiation (LTP)-like plasticity
  • primary motor cortex (M1)
  • reinforcement learning

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Cellular and Molecular Neuroscience

Cite this

Learning similar actions by reinforcement or sensory-prediction errors rely on distinct physiological mechanisms. / Uehara, Shintaro; Mawase, Firas; Celnik, Pablo A.

In: Cerebral Cortex, Vol. 28, No. 10, 01.10.2018, p. 3478-3490.

Research output: Contribution to journalArticle

@article{ea07812fdc40429cb03ac8ea0c776815,
title = "Learning similar actions by reinforcement or sensory-prediction errors rely on distinct physiological mechanisms",
abstract = "Humans can acquire knowledge of new motor behavior via different forms of learning. The two forms most commonly studied have been the development of internal models based on sensory-prediction errors (error-based learning) and success-based feedback (reinforcement learning). Human behavioral studies suggest these are distinct learning processes, though the neurophysiological mechanisms that are involved have not been characterized. Here, we evaluated physiological markers from the cerebellum and the primary motor cortex (M1) using noninvasive brain stimulations while healthy participants trained finger-reaching tasks. We manipulated the extent to which subjects rely on error-based or reinforcement by providing either vector or binary feedback about task performance. Our results demonstrated a double dissociation where learning the task mainly via error-based mechanisms leads to cerebellar plasticity modifications but not long-term potentiation (LTP)-like plasticity changes in M1; while learning a similar action via reinforcement mechanisms elicited M1 LTP-like plasticity but not cerebellar plasticity changes. Our findings indicate that learning complex motor behavior is mediated by the interplay of different forms of learning, weighing distinct neural mechanisms in M1 and the cerebellum. Our study provides insights for designing effective interventions to enhance human motor learning.",
keywords = "cerebellar inhibition (CBI), error-based learning, long-term potentiation (LTP)-like plasticity, primary motor cortex (M1), reinforcement learning",
author = "Shintaro Uehara and Firas Mawase and Celnik, {Pablo A}",
year = "2018",
month = "10",
day = "1",
doi = "10.1093/cercor/bhx214",
language = "English (US)",
volume = "28",
pages = "3478--3490",
journal = "Cerebral Cortex",
issn = "1047-3211",
publisher = "Oxford University Press",
number = "10",

}

TY - JOUR

T1 - Learning similar actions by reinforcement or sensory-prediction errors rely on distinct physiological mechanisms

AU - Uehara, Shintaro

AU - Mawase, Firas

AU - Celnik, Pablo A

PY - 2018/10/1

Y1 - 2018/10/1

N2 - Humans can acquire knowledge of new motor behavior via different forms of learning. The two forms most commonly studied have been the development of internal models based on sensory-prediction errors (error-based learning) and success-based feedback (reinforcement learning). Human behavioral studies suggest these are distinct learning processes, though the neurophysiological mechanisms that are involved have not been characterized. Here, we evaluated physiological markers from the cerebellum and the primary motor cortex (M1) using noninvasive brain stimulations while healthy participants trained finger-reaching tasks. We manipulated the extent to which subjects rely on error-based or reinforcement by providing either vector or binary feedback about task performance. Our results demonstrated a double dissociation where learning the task mainly via error-based mechanisms leads to cerebellar plasticity modifications but not long-term potentiation (LTP)-like plasticity changes in M1; while learning a similar action via reinforcement mechanisms elicited M1 LTP-like plasticity but not cerebellar plasticity changes. Our findings indicate that learning complex motor behavior is mediated by the interplay of different forms of learning, weighing distinct neural mechanisms in M1 and the cerebellum. Our study provides insights for designing effective interventions to enhance human motor learning.

AB - Humans can acquire knowledge of new motor behavior via different forms of learning. The two forms most commonly studied have been the development of internal models based on sensory-prediction errors (error-based learning) and success-based feedback (reinforcement learning). Human behavioral studies suggest these are distinct learning processes, though the neurophysiological mechanisms that are involved have not been characterized. Here, we evaluated physiological markers from the cerebellum and the primary motor cortex (M1) using noninvasive brain stimulations while healthy participants trained finger-reaching tasks. We manipulated the extent to which subjects rely on error-based or reinforcement by providing either vector or binary feedback about task performance. Our results demonstrated a double dissociation where learning the task mainly via error-based mechanisms leads to cerebellar plasticity modifications but not long-term potentiation (LTP)-like plasticity changes in M1; while learning a similar action via reinforcement mechanisms elicited M1 LTP-like plasticity but not cerebellar plasticity changes. Our findings indicate that learning complex motor behavior is mediated by the interplay of different forms of learning, weighing distinct neural mechanisms in M1 and the cerebellum. Our study provides insights for designing effective interventions to enhance human motor learning.

KW - cerebellar inhibition (CBI)

KW - error-based learning

KW - long-term potentiation (LTP)-like plasticity

KW - primary motor cortex (M1)

KW - reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=85053892560&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053892560&partnerID=8YFLogxK

U2 - 10.1093/cercor/bhx214

DO - 10.1093/cercor/bhx214

M3 - Article

VL - 28

SP - 3478

EP - 3490

JO - Cerebral Cortex

JF - Cerebral Cortex

SN - 1047-3211

IS - 10

ER -