Evaluation of a simulation-based pediatric clinical skills curriculum for medical students

Research output: Contribution to journalArticle

Abstract

INTRODUCTION: Simulation-based education is expensive and requires greater resources than traditional methods, yet there is limited evidence to justify such expenditures for medical student education. METHODS: We describe the implementation and evaluation of a simulation-based curriculum delivered to medical students during a pediatric clerkship. This prospective mixed-methods study evaluated a 5-day long simulation-based clinical skills curriculum (PRE-Clerkship EDucational Exercises [PRECEDE]) at the Johns Hopkins University School of Medicine. Two hundred medical students participated in PRECEDE during a 2-year period and were compared with 236 students who had not. Outcomes were assessed across 3 levels of Kirkpatrick's framework for evaluation. The 4-level model consists of reaction, learning, behavior, and results criteria. Secondary outcomes measured changes in assessment scores across 16 student performance domains during clerkship, changes in performance on the National Board of Medical Examiners subject examination in pediatrics, and student assessments of the curriculum. RESULTS: Improvements were noted across 3 levels of the Kirkpatrick's model. Student performance evaluations were significantly higher across all 16 evaluation components, with effect sizes ranging from small to medium (Cohen's d, 0.23-0.44). Students scored significantly higher on the National Board of Medical Examiners pediatric shelf examination (80 vs. 77, P <0.001). Ninety-seven percent of the medical students agreed that their skills increased and that the time lost to real clinical experiences was a worthwhile trade-off for this curriculum CONCLUSIONS: The implementation of a simulation-based curriculum within a pediatrics clerkship resulted in higher knowledge scores and led to improvements in medical student clinical performance during the clerkship.

Original languageEnglish (US)
Pages (from-to)21-32
Number of pages12
JournalSimulation in Healthcare
Volume9
Issue number1
DOIs
StatePublished - Feb 2014

Fingerprint

Pediatrics
Clinical Competence
Medical Students
Curriculum
Curricula
medical student
Students
curriculum
simulation
Evaluation
Coroners and Medical Examiners
evaluation
medical examiner
Simulation
student
Exercise
performance
learning behavior
examination
Effect Size

Keywords

  • Clinical skills
  • Curriculum
  • Evaluation
  • Medical students
  • Simulation
  • Teaching

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Epidemiology
  • Education
  • Modeling and Simulation
  • Medicine(all)

Cite this

@article{417779c5432544e79c4f8e2e708a9703,
title = "Evaluation of a simulation-based pediatric clinical skills curriculum for medical students",
abstract = "INTRODUCTION: Simulation-based education is expensive and requires greater resources than traditional methods, yet there is limited evidence to justify such expenditures for medical student education. METHODS: We describe the implementation and evaluation of a simulation-based curriculum delivered to medical students during a pediatric clerkship. This prospective mixed-methods study evaluated a 5-day long simulation-based clinical skills curriculum (PRE-Clerkship EDucational Exercises [PRECEDE]) at the Johns Hopkins University School of Medicine. Two hundred medical students participated in PRECEDE during a 2-year period and were compared with 236 students who had not. Outcomes were assessed across 3 levels of Kirkpatrick's framework for evaluation. The 4-level model consists of reaction, learning, behavior, and results criteria. Secondary outcomes measured changes in assessment scores across 16 student performance domains during clerkship, changes in performance on the National Board of Medical Examiners subject examination in pediatrics, and student assessments of the curriculum. RESULTS: Improvements were noted across 3 levels of the Kirkpatrick's model. Student performance evaluations were significantly higher across all 16 evaluation components, with effect sizes ranging from small to medium (Cohen's d, 0.23-0.44). Students scored significantly higher on the National Board of Medical Examiners pediatric shelf examination (80 vs. 77, P <0.001). Ninety-seven percent of the medical students agreed that their skills increased and that the time lost to real clinical experiences was a worthwhile trade-off for this curriculum CONCLUSIONS: The implementation of a simulation-based curriculum within a pediatrics clerkship resulted in higher knowledge scores and led to improvements in medical student clinical performance during the clerkship.",
keywords = "Clinical skills, Curriculum, Evaluation, Medical students, Simulation, Teaching",
author = "Dudas, {Robert A} and Jorie Colbert-Getz and Balighian, {Eric D} and Cooke, {David W} and Golden, {W Christopher} and Salwa Khan and Rosalyn Stewart and Michael Barone",
year = "2014",
month = "2",
doi = "10.1097/SIH.0b013e3182a89154",
language = "English (US)",
volume = "9",
pages = "21--32",
journal = "Simulation in Healthcare",
issn = "1559-2332",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - Evaluation of a simulation-based pediatric clinical skills curriculum for medical students

AU - Dudas, Robert A

AU - Colbert-Getz, Jorie

AU - Balighian, Eric D

AU - Cooke, David W

AU - Golden, W Christopher

AU - Khan, Salwa

AU - Stewart, Rosalyn

AU - Barone, Michael

PY - 2014/2

Y1 - 2014/2

N2 - INTRODUCTION: Simulation-based education is expensive and requires greater resources than traditional methods, yet there is limited evidence to justify such expenditures for medical student education. METHODS: We describe the implementation and evaluation of a simulation-based curriculum delivered to medical students during a pediatric clerkship. This prospective mixed-methods study evaluated a 5-day long simulation-based clinical skills curriculum (PRE-Clerkship EDucational Exercises [PRECEDE]) at the Johns Hopkins University School of Medicine. Two hundred medical students participated in PRECEDE during a 2-year period and were compared with 236 students who had not. Outcomes were assessed across 3 levels of Kirkpatrick's framework for evaluation. The 4-level model consists of reaction, learning, behavior, and results criteria. Secondary outcomes measured changes in assessment scores across 16 student performance domains during clerkship, changes in performance on the National Board of Medical Examiners subject examination in pediatrics, and student assessments of the curriculum. RESULTS: Improvements were noted across 3 levels of the Kirkpatrick's model. Student performance evaluations were significantly higher across all 16 evaluation components, with effect sizes ranging from small to medium (Cohen's d, 0.23-0.44). Students scored significantly higher on the National Board of Medical Examiners pediatric shelf examination (80 vs. 77, P <0.001). Ninety-seven percent of the medical students agreed that their skills increased and that the time lost to real clinical experiences was a worthwhile trade-off for this curriculum CONCLUSIONS: The implementation of a simulation-based curriculum within a pediatrics clerkship resulted in higher knowledge scores and led to improvements in medical student clinical performance during the clerkship.

AB - INTRODUCTION: Simulation-based education is expensive and requires greater resources than traditional methods, yet there is limited evidence to justify such expenditures for medical student education. METHODS: We describe the implementation and evaluation of a simulation-based curriculum delivered to medical students during a pediatric clerkship. This prospective mixed-methods study evaluated a 5-day long simulation-based clinical skills curriculum (PRE-Clerkship EDucational Exercises [PRECEDE]) at the Johns Hopkins University School of Medicine. Two hundred medical students participated in PRECEDE during a 2-year period and were compared with 236 students who had not. Outcomes were assessed across 3 levels of Kirkpatrick's framework for evaluation. The 4-level model consists of reaction, learning, behavior, and results criteria. Secondary outcomes measured changes in assessment scores across 16 student performance domains during clerkship, changes in performance on the National Board of Medical Examiners subject examination in pediatrics, and student assessments of the curriculum. RESULTS: Improvements were noted across 3 levels of the Kirkpatrick's model. Student performance evaluations were significantly higher across all 16 evaluation components, with effect sizes ranging from small to medium (Cohen's d, 0.23-0.44). Students scored significantly higher on the National Board of Medical Examiners pediatric shelf examination (80 vs. 77, P <0.001). Ninety-seven percent of the medical students agreed that their skills increased and that the time lost to real clinical experiences was a worthwhile trade-off for this curriculum CONCLUSIONS: The implementation of a simulation-based curriculum within a pediatrics clerkship resulted in higher knowledge scores and led to improvements in medical student clinical performance during the clerkship.

KW - Clinical skills

KW - Curriculum

KW - Evaluation

KW - Medical students

KW - Simulation

KW - Teaching

UR - http://www.scopus.com/inward/record.url?scp=84894044419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84894044419&partnerID=8YFLogxK

U2 - 10.1097/SIH.0b013e3182a89154

DO - 10.1097/SIH.0b013e3182a89154

M3 - Article

C2 - 24096922

AN - SCOPUS:84894044419

VL - 9

SP - 21

EP - 32

JO - Simulation in Healthcare

JF - Simulation in Healthcare

SN - 1559-2332

IS - 1

ER -