Objective assessment of mastoidectomy skills in the operating room

Howard W. Francis, Hamid Masood, Kashif N. Chaudhry, Kulsoom Laeeq, John P Carey, Charles Coleman Della Santina, Charles J. Limb, John K. Niparko, Nasir Islam Bhatti

Research output: Contribution to journalArticle

Abstract

OBJECTIVE(S):: To determine the feasibility and validity of an objective assessment tool designed to measure the development of mastoidectomy skills by resident trainees in the operating room. STUDY DESIGN:: Prospective longitudinal validation study. SETTING:: Tertiary referral center and residency training program. SUBJECTS:: Otolaryngology residents. MAIN OUTCOME MEASURE:: Technical performance as measured over time using Task-Based Checklist (TBC) and Global Rating Scale (GRS) developed for assessment of mastoidectomy skills. RESULTS:: Seventy pairs of evaluations were completed on 15 residents, showing strong correlation between both instruments (r = 0.93; p <0.0001). Our instrument demonstrated construct validity for both TBC and GRS, showing higher scores with increasing surgical experience in otology. Both instruments showed high interitem reliability with Cronbach α coefficients of 0.98 and 0.95 for TBC and GRS, respectively. Regression analysis showed that thinning posterior external auditory canal (p <0.05) and opening antrum to deepen dissection at sinodural angle (p <0.05) were the strongest predictors of overall surgical performance. CONCLUSION:: Our assessment tool is a feasible and valid method of evaluating acquisition of mastoidectomy skills in the operating room. It can be integrated into surgical teaching in the operating room and yields information for direct formative feedback.

Original languageEnglish (US)
Pages (from-to)759-765
Number of pages7
JournalOtology and Neurotology
Volume31
Issue number5
DOIs
StatePublished - Jul 2010

Fingerprint

Operating Rooms
Checklist
Otolaryngology
Ear Canal
Validation Studies
Internship and Residency
Tertiary Care Centers
Longitudinal Studies
Dissection
Teaching
Regression Analysis
Education

Keywords

  • Competence
  • Evaluation
  • Mastoidectomy
  • Objective structured assessment of technical skills
  • Operating room
  • Otolaryngology
  • Surgical education

ASJC Scopus subject areas

  • Otorhinolaryngology
  • Clinical Neurology
  • Sensory Systems
  • Medicine(all)

Cite this

Objective assessment of mastoidectomy skills in the operating room. / Francis, Howard W.; Masood, Hamid; Chaudhry, Kashif N.; Laeeq, Kulsoom; Carey, John P; Della Santina, Charles Coleman; Limb, Charles J.; Niparko, John K.; Bhatti, Nasir Islam.

In: Otology and Neurotology, Vol. 31, No. 5, 07.2010, p. 759-765.

Research output: Contribution to journalArticle

Francis, Howard W. ; Masood, Hamid ; Chaudhry, Kashif N. ; Laeeq, Kulsoom ; Carey, John P ; Della Santina, Charles Coleman ; Limb, Charles J. ; Niparko, John K. ; Bhatti, Nasir Islam. / Objective assessment of mastoidectomy skills in the operating room. In: Otology and Neurotology. 2010 ; Vol. 31, No. 5. pp. 759-765.
@article{32c075ebd78b4f928174ee6d6174ad87,
title = "Objective assessment of mastoidectomy skills in the operating room",
abstract = "OBJECTIVE(S):: To determine the feasibility and validity of an objective assessment tool designed to measure the development of mastoidectomy skills by resident trainees in the operating room. STUDY DESIGN:: Prospective longitudinal validation study. SETTING:: Tertiary referral center and residency training program. SUBJECTS:: Otolaryngology residents. MAIN OUTCOME MEASURE:: Technical performance as measured over time using Task-Based Checklist (TBC) and Global Rating Scale (GRS) developed for assessment of mastoidectomy skills. RESULTS:: Seventy pairs of evaluations were completed on 15 residents, showing strong correlation between both instruments (r = 0.93; p <0.0001). Our instrument demonstrated construct validity for both TBC and GRS, showing higher scores with increasing surgical experience in otology. Both instruments showed high interitem reliability with Cronbach α coefficients of 0.98 and 0.95 for TBC and GRS, respectively. Regression analysis showed that thinning posterior external auditory canal (p <0.05) and opening antrum to deepen dissection at sinodural angle (p <0.05) were the strongest predictors of overall surgical performance. CONCLUSION:: Our assessment tool is a feasible and valid method of evaluating acquisition of mastoidectomy skills in the operating room. It can be integrated into surgical teaching in the operating room and yields information for direct formative feedback.",
keywords = "Competence, Evaluation, Mastoidectomy, Objective structured assessment of technical skills, Operating room, Otolaryngology, Surgical education",
author = "Francis, {Howard W.} and Hamid Masood and Chaudhry, {Kashif N.} and Kulsoom Laeeq and Carey, {John P} and {Della Santina}, {Charles Coleman} and Limb, {Charles J.} and Niparko, {John K.} and Bhatti, {Nasir Islam}",
year = "2010",
month = "7",
doi = "10.1097/MAO.0b013e3181e3d385",
language = "English (US)",
volume = "31",
pages = "759--765",
journal = "Otology and Neurotology",
issn = "1531-7129",
publisher = "Lippincott Williams and Wilkins",
number = "5",

}

TY - JOUR

T1 - Objective assessment of mastoidectomy skills in the operating room

AU - Francis, Howard W.

AU - Masood, Hamid

AU - Chaudhry, Kashif N.

AU - Laeeq, Kulsoom

AU - Carey, John P

AU - Della Santina, Charles Coleman

AU - Limb, Charles J.

AU - Niparko, John K.

AU - Bhatti, Nasir Islam

PY - 2010/7

Y1 - 2010/7

N2 - OBJECTIVE(S):: To determine the feasibility and validity of an objective assessment tool designed to measure the development of mastoidectomy skills by resident trainees in the operating room. STUDY DESIGN:: Prospective longitudinal validation study. SETTING:: Tertiary referral center and residency training program. SUBJECTS:: Otolaryngology residents. MAIN OUTCOME MEASURE:: Technical performance as measured over time using Task-Based Checklist (TBC) and Global Rating Scale (GRS) developed for assessment of mastoidectomy skills. RESULTS:: Seventy pairs of evaluations were completed on 15 residents, showing strong correlation between both instruments (r = 0.93; p <0.0001). Our instrument demonstrated construct validity for both TBC and GRS, showing higher scores with increasing surgical experience in otology. Both instruments showed high interitem reliability with Cronbach α coefficients of 0.98 and 0.95 for TBC and GRS, respectively. Regression analysis showed that thinning posterior external auditory canal (p <0.05) and opening antrum to deepen dissection at sinodural angle (p <0.05) were the strongest predictors of overall surgical performance. CONCLUSION:: Our assessment tool is a feasible and valid method of evaluating acquisition of mastoidectomy skills in the operating room. It can be integrated into surgical teaching in the operating room and yields information for direct formative feedback.

AB - OBJECTIVE(S):: To determine the feasibility and validity of an objective assessment tool designed to measure the development of mastoidectomy skills by resident trainees in the operating room. STUDY DESIGN:: Prospective longitudinal validation study. SETTING:: Tertiary referral center and residency training program. SUBJECTS:: Otolaryngology residents. MAIN OUTCOME MEASURE:: Technical performance as measured over time using Task-Based Checklist (TBC) and Global Rating Scale (GRS) developed for assessment of mastoidectomy skills. RESULTS:: Seventy pairs of evaluations were completed on 15 residents, showing strong correlation between both instruments (r = 0.93; p <0.0001). Our instrument demonstrated construct validity for both TBC and GRS, showing higher scores with increasing surgical experience in otology. Both instruments showed high interitem reliability with Cronbach α coefficients of 0.98 and 0.95 for TBC and GRS, respectively. Regression analysis showed that thinning posterior external auditory canal (p <0.05) and opening antrum to deepen dissection at sinodural angle (p <0.05) were the strongest predictors of overall surgical performance. CONCLUSION:: Our assessment tool is a feasible and valid method of evaluating acquisition of mastoidectomy skills in the operating room. It can be integrated into surgical teaching in the operating room and yields information for direct formative feedback.

KW - Competence

KW - Evaluation

KW - Mastoidectomy

KW - Objective structured assessment of technical skills

KW - Operating room

KW - Otolaryngology

KW - Surgical education

UR - http://www.scopus.com/inward/record.url?scp=77954387301&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954387301&partnerID=8YFLogxK

U2 - 10.1097/MAO.0b013e3181e3d385

DO - 10.1097/MAO.0b013e3181e3d385

M3 - Article

C2 - 20517169

AN - SCOPUS:77954387301

VL - 31

SP - 759

EP - 765

JO - Otology and Neurotology

JF - Otology and Neurotology

SN - 1531-7129

IS - 5

ER -