Investigating the Relationship Between a Clinical Science Composite Score and USMLE Step 2 Clinical Knowledge and Step 3 Performance

Carol Morrison, Michael Barone, Gregory Baker, Linette Ross, Seohong Pak

Research output: Contribution to journalArticle

Abstract

Previous research has found a moderate relationship between performance on individual clinical science subject examinations and USMLE performance. Given the widespread use of the clinical science subject examinations and the need for measures of clinical knowledge that help predict performance on Steps 2 CK and 3 and performance in residency training, this study explores the use of composite scores based on clinical science subject examinations to predict clinical knowledge outcome measures. The data set included students who took all of the five most widely used clinical science subject examinations (medicine, obstetrics and gynecology, pediatrics, psychiatry, and surgery) between January 1, 2013, and December 31, 2017 (N = 65,516). Composite scores were calculated based on average equated percent correct scores across various combinations of clinical science subject examinations. Stepwise linear regression analyses were performed with composite score and Step 1 score as predictor variables and Step 2 CK score or Step 3 score as the dependent variable. In all cases, the proportion of variance explained (R2) by the composite score (0.62–0.65 for Step 2 CK score and 0.45–0.48 for Step 3 score) was greater than R2 for Step 1 by itself (0.52 for Step 2 CK score and 0.37 for Step 3 score). Logistic regression analyses found that higher composite scores were associated with a greater probability of passing Steps 2 CK and 3. Composite scores can be used alone or in conjunction with Step 1 to identify students at risk of failing Step 2 CK and/or Step 3 to facilitate remediation.

Original languageEnglish (US)
JournalMedical Science Educator
DOIs
StateAccepted/In press - Jan 1 2020

Fingerprint

science
performance
Regression Analysis
Students
examination
Internship and Residency
Gynecology
Obstetrics
Psychiatry
Linear Models
Logistic Models
Medicine
Outcome Assessment (Health Care)
Pediatrics
Research
regression
gynecology
obstetrics
psychiatry
surgery

Keywords

  • Clinical science assessment
  • Composite score
  • Predictive validity

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Education

Cite this

Investigating the Relationship Between a Clinical Science Composite Score and USMLE Step 2 Clinical Knowledge and Step 3 Performance. / Morrison, Carol; Barone, Michael; Baker, Gregory; Ross, Linette; Pak, Seohong.

In: Medical Science Educator, 01.01.2020.

Research output: Contribution to journalArticle

@article{6411ad69f10845ce856891a8172037d6,
title = "Investigating the Relationship Between a Clinical Science Composite Score and USMLE Step 2 Clinical Knowledge and Step 3 Performance",
abstract = "Previous research has found a moderate relationship between performance on individual clinical science subject examinations and USMLE performance. Given the widespread use of the clinical science subject examinations and the need for measures of clinical knowledge that help predict performance on Steps 2 CK and 3 and performance in residency training, this study explores the use of composite scores based on clinical science subject examinations to predict clinical knowledge outcome measures. The data set included students who took all of the five most widely used clinical science subject examinations (medicine, obstetrics and gynecology, pediatrics, psychiatry, and surgery) between January 1, 2013, and December 31, 2017 (N = 65,516). Composite scores were calculated based on average equated percent correct scores across various combinations of clinical science subject examinations. Stepwise linear regression analyses were performed with composite score and Step 1 score as predictor variables and Step 2 CK score or Step 3 score as the dependent variable. In all cases, the proportion of variance explained (R2) by the composite score (0.62–0.65 for Step 2 CK score and 0.45–0.48 for Step 3 score) was greater than R2 for Step 1 by itself (0.52 for Step 2 CK score and 0.37 for Step 3 score). Logistic regression analyses found that higher composite scores were associated with a greater probability of passing Steps 2 CK and 3. Composite scores can be used alone or in conjunction with Step 1 to identify students at risk of failing Step 2 CK and/or Step 3 to facilitate remediation.",
keywords = "Clinical science assessment, Composite score, Predictive validity",
author = "Carol Morrison and Michael Barone and Gregory Baker and Linette Ross and Seohong Pak",
year = "2020",
month = "1",
day = "1",
doi = "10.1007/s40670-019-00893-0",
language = "English (US)",
journal = "Medical Science Educator",
issn = "2156-8650",
publisher = "Springer New York",

}

TY - JOUR

T1 - Investigating the Relationship Between a Clinical Science Composite Score and USMLE Step 2 Clinical Knowledge and Step 3 Performance

AU - Morrison, Carol

AU - Barone, Michael

AU - Baker, Gregory

AU - Ross, Linette

AU - Pak, Seohong

PY - 2020/1/1

Y1 - 2020/1/1

N2 - Previous research has found a moderate relationship between performance on individual clinical science subject examinations and USMLE performance. Given the widespread use of the clinical science subject examinations and the need for measures of clinical knowledge that help predict performance on Steps 2 CK and 3 and performance in residency training, this study explores the use of composite scores based on clinical science subject examinations to predict clinical knowledge outcome measures. The data set included students who took all of the five most widely used clinical science subject examinations (medicine, obstetrics and gynecology, pediatrics, psychiatry, and surgery) between January 1, 2013, and December 31, 2017 (N = 65,516). Composite scores were calculated based on average equated percent correct scores across various combinations of clinical science subject examinations. Stepwise linear regression analyses were performed with composite score and Step 1 score as predictor variables and Step 2 CK score or Step 3 score as the dependent variable. In all cases, the proportion of variance explained (R2) by the composite score (0.62–0.65 for Step 2 CK score and 0.45–0.48 for Step 3 score) was greater than R2 for Step 1 by itself (0.52 for Step 2 CK score and 0.37 for Step 3 score). Logistic regression analyses found that higher composite scores were associated with a greater probability of passing Steps 2 CK and 3. Composite scores can be used alone or in conjunction with Step 1 to identify students at risk of failing Step 2 CK and/or Step 3 to facilitate remediation.

AB - Previous research has found a moderate relationship between performance on individual clinical science subject examinations and USMLE performance. Given the widespread use of the clinical science subject examinations and the need for measures of clinical knowledge that help predict performance on Steps 2 CK and 3 and performance in residency training, this study explores the use of composite scores based on clinical science subject examinations to predict clinical knowledge outcome measures. The data set included students who took all of the five most widely used clinical science subject examinations (medicine, obstetrics and gynecology, pediatrics, psychiatry, and surgery) between January 1, 2013, and December 31, 2017 (N = 65,516). Composite scores were calculated based on average equated percent correct scores across various combinations of clinical science subject examinations. Stepwise linear regression analyses were performed with composite score and Step 1 score as predictor variables and Step 2 CK score or Step 3 score as the dependent variable. In all cases, the proportion of variance explained (R2) by the composite score (0.62–0.65 for Step 2 CK score and 0.45–0.48 for Step 3 score) was greater than R2 for Step 1 by itself (0.52 for Step 2 CK score and 0.37 for Step 3 score). Logistic regression analyses found that higher composite scores were associated with a greater probability of passing Steps 2 CK and 3. Composite scores can be used alone or in conjunction with Step 1 to identify students at risk of failing Step 2 CK and/or Step 3 to facilitate remediation.

KW - Clinical science assessment

KW - Composite score

KW - Predictive validity

UR - http://www.scopus.com/inward/record.url?scp=85077572865&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85077572865&partnerID=8YFLogxK

U2 - 10.1007/s40670-019-00893-0

DO - 10.1007/s40670-019-00893-0

M3 - Article

AN - SCOPUS:85077572865

JO - Medical Science Educator

JF - Medical Science Educator

SN - 2156-8650

ER -