In-training assessment and predictors of competency in endoscopic sinus surgery

Kulsoom Laeeq, Raafeh Waseem, Robert A. Weatherly, Douglas D. Reh, Sandra Y Lin, Andrew P Lane, Masaru Ishii, Charles W Cummings, Nasir Islam Bhatti

Research output: Contribution to journalArticle

Abstract

Objectives: To evaluate the reliability and validity of the assessment tool for endoscopic sinus surgery when used in the operating room for in-training assessment of operative competency; to identify the tasks that may serve as the best indicators for overall surgical performance. Study Design: Cross-sectional validation study. Methods: We implemented the global and checklist parts of the endoscopic sinus surgery (ESS) assessment tool to evaluate the surgical skills of 13 Otolaryngology-Head & Neck Surgery residents (PGY 1-5) in the operating room over a period of 15 months. Rhinology faculty scored residents' performance of every step of ESS at the end of each procedure using a previously validated tool. Construct validity was calculated by comparing scores across training levels (using analysis of variance [ANOVA]). Regression analysis was performed to identify tasks on the ESS checklist that most strongly correlated to the overall surgical performance. Results: Construct validity was demonstrated with senior residents performing better than junior residents. Average checklist and global scores improved with the number of days on rhinology rotation. "Identification of uncinate and boundaries" was found to be the strongest predictor of overall surgical performance. Conclusions: The results indicate that this evaluation tool is a reliable and valid instrument for the assessment of surgical competency in the operating room. It can be used to identify weak areas of performance for which additional training may be required early in the rotation/training.

Original languageEnglish (US)
Pages (from-to)2540-2545
Number of pages6
JournalLaryngoscope
Volume120
Issue number12
DOIs
StatePublished - Dec 2010

Fingerprint

Operating Rooms
Checklist
Reproducibility of Results
Validation Studies
Otolaryngology
Surgical Instruments
Analysis of Variance
Neck
Cross-Sectional Studies
Head
Regression Analysis

Keywords

  • Assessment
  • formative feedback
  • in-training
  • objective
  • operative competency
  • residency
  • surgical skills

ASJC Scopus subject areas

  • Otorhinolaryngology

Cite this

In-training assessment and predictors of competency in endoscopic sinus surgery. / Laeeq, Kulsoom; Waseem, Raafeh; Weatherly, Robert A.; Reh, Douglas D.; Lin, Sandra Y; Lane, Andrew P; Ishii, Masaru; Cummings, Charles W; Bhatti, Nasir Islam.

In: Laryngoscope, Vol. 120, No. 12, 12.2010, p. 2540-2545.

Research output: Contribution to journalArticle

Laeeq, Kulsoom ; Waseem, Raafeh ; Weatherly, Robert A. ; Reh, Douglas D. ; Lin, Sandra Y ; Lane, Andrew P ; Ishii, Masaru ; Cummings, Charles W ; Bhatti, Nasir Islam. / In-training assessment and predictors of competency in endoscopic sinus surgery. In: Laryngoscope. 2010 ; Vol. 120, No. 12. pp. 2540-2545.
@article{bc918556baa04f75a138761d93fbb252,
title = "In-training assessment and predictors of competency in endoscopic sinus surgery",
abstract = "Objectives: To evaluate the reliability and validity of the assessment tool for endoscopic sinus surgery when used in the operating room for in-training assessment of operative competency; to identify the tasks that may serve as the best indicators for overall surgical performance. Study Design: Cross-sectional validation study. Methods: We implemented the global and checklist parts of the endoscopic sinus surgery (ESS) assessment tool to evaluate the surgical skills of 13 Otolaryngology-Head & Neck Surgery residents (PGY 1-5) in the operating room over a period of 15 months. Rhinology faculty scored residents' performance of every step of ESS at the end of each procedure using a previously validated tool. Construct validity was calculated by comparing scores across training levels (using analysis of variance [ANOVA]). Regression analysis was performed to identify tasks on the ESS checklist that most strongly correlated to the overall surgical performance. Results: Construct validity was demonstrated with senior residents performing better than junior residents. Average checklist and global scores improved with the number of days on rhinology rotation. {"}Identification of uncinate and boundaries{"} was found to be the strongest predictor of overall surgical performance. Conclusions: The results indicate that this evaluation tool is a reliable and valid instrument for the assessment of surgical competency in the operating room. It can be used to identify weak areas of performance for which additional training may be required early in the rotation/training.",
keywords = "Assessment, formative feedback, in-training, objective, operative competency, residency, surgical skills",
author = "Kulsoom Laeeq and Raafeh Waseem and Weatherly, {Robert A.} and Reh, {Douglas D.} and Lin, {Sandra Y} and Lane, {Andrew P} and Masaru Ishii and Cummings, {Charles W} and Bhatti, {Nasir Islam}",
year = "2010",
month = "12",
doi = "10.1002/lary.21134",
language = "English (US)",
volume = "120",
pages = "2540--2545",
journal = "Laryngoscope",
issn = "0023-852X",
publisher = "John Wiley and Sons Inc.",
number = "12",

}

TY - JOUR

T1 - In-training assessment and predictors of competency in endoscopic sinus surgery

AU - Laeeq, Kulsoom

AU - Waseem, Raafeh

AU - Weatherly, Robert A.

AU - Reh, Douglas D.

AU - Lin, Sandra Y

AU - Lane, Andrew P

AU - Ishii, Masaru

AU - Cummings, Charles W

AU - Bhatti, Nasir Islam

PY - 2010/12

Y1 - 2010/12

N2 - Objectives: To evaluate the reliability and validity of the assessment tool for endoscopic sinus surgery when used in the operating room for in-training assessment of operative competency; to identify the tasks that may serve as the best indicators for overall surgical performance. Study Design: Cross-sectional validation study. Methods: We implemented the global and checklist parts of the endoscopic sinus surgery (ESS) assessment tool to evaluate the surgical skills of 13 Otolaryngology-Head & Neck Surgery residents (PGY 1-5) in the operating room over a period of 15 months. Rhinology faculty scored residents' performance of every step of ESS at the end of each procedure using a previously validated tool. Construct validity was calculated by comparing scores across training levels (using analysis of variance [ANOVA]). Regression analysis was performed to identify tasks on the ESS checklist that most strongly correlated to the overall surgical performance. Results: Construct validity was demonstrated with senior residents performing better than junior residents. Average checklist and global scores improved with the number of days on rhinology rotation. "Identification of uncinate and boundaries" was found to be the strongest predictor of overall surgical performance. Conclusions: The results indicate that this evaluation tool is a reliable and valid instrument for the assessment of surgical competency in the operating room. It can be used to identify weak areas of performance for which additional training may be required early in the rotation/training.

AB - Objectives: To evaluate the reliability and validity of the assessment tool for endoscopic sinus surgery when used in the operating room for in-training assessment of operative competency; to identify the tasks that may serve as the best indicators for overall surgical performance. Study Design: Cross-sectional validation study. Methods: We implemented the global and checklist parts of the endoscopic sinus surgery (ESS) assessment tool to evaluate the surgical skills of 13 Otolaryngology-Head & Neck Surgery residents (PGY 1-5) in the operating room over a period of 15 months. Rhinology faculty scored residents' performance of every step of ESS at the end of each procedure using a previously validated tool. Construct validity was calculated by comparing scores across training levels (using analysis of variance [ANOVA]). Regression analysis was performed to identify tasks on the ESS checklist that most strongly correlated to the overall surgical performance. Results: Construct validity was demonstrated with senior residents performing better than junior residents. Average checklist and global scores improved with the number of days on rhinology rotation. "Identification of uncinate and boundaries" was found to be the strongest predictor of overall surgical performance. Conclusions: The results indicate that this evaluation tool is a reliable and valid instrument for the assessment of surgical competency in the operating room. It can be used to identify weak areas of performance for which additional training may be required early in the rotation/training.

KW - Assessment

KW - formative feedback

KW - in-training

KW - objective

KW - operative competency

KW - residency

KW - surgical skills

UR - http://www.scopus.com/inward/record.url?scp=78649647861&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78649647861&partnerID=8YFLogxK

U2 - 10.1002/lary.21134

DO - 10.1002/lary.21134

M3 - Article

C2 - 21082748

AN - SCOPUS:78649647861

VL - 120

SP - 2540

EP - 2545

JO - Laryngoscope

JF - Laryngoscope

SN - 0023-852X

IS - 12

ER -