Stakeholder-engaged measure development for pediatric obstructive sleep-disordered breathing the obstructive sleep-disordered breathing and adenotonsillectomy knowledge scale for parents

Anne R. Links, David E Tunkel, Emily Boss

Research output: Contribution to journalArticle

Abstract

IMPORTANCE Parental decision making about adenotonsillectomy (AT) for obstructive sleep-disordered breathing (oSDB) is associated with decisional conflict that may be alleviated with improved knowledge about symptoms and treatments. OBJECTIVE To develop a measure of parental knowledge about oSDB and AT. DESIGN, SETTING, AND PARTICIPANTS A sequential design was used for scale development. A prototype measure containing 9 oSDB and AT themes and 85 items was administered in survey format via an online platform. Participants included 19 clinician experts (otolaryngologists and pediatricians) and 13 laymen (parents of children who snore or do not snore, and other adults). Quantitative and qualitative responses were used to modify the measure and create the knowledge scale. Content validity of the scale was established through expert feedback and evaluation. Criterion validity was established with t test comparisons of experts with laymen. Reliability of the responses was assessed with Cronbach a testing. MAIN OUTCOMES AND MEASURES An 85-item prototype measure and 39-item modified measure were evaluated for consensus/approval and psychometric integrity. RESULTS Of 45 potential participants, 32 individuals (71%) responded to the prototype scale. Respondents included 19 clinician experts (59%) (otolaryngologists and pediatricians) and 13 laymen (41%) (parents of children who snore [n = 8] or do not snore [n = 2] and other adults [n = 3]); demographic data were not collected. Content analysis and qualitative feedback were largely rated positively: 27 respondents (84%) stated that the measure was a good evaluation of knowledge, 30 respondents (94%) commented that the items were clear, and 31 individuals (97%) approved of its organization, although there were several suggestions for rewording and/or addition of response options. Experts identified themes most important for assessing oSDB (symptoms) and AT (experiences: risks and benefits) knowledge. These qualitative comments were used to modify the scale, and items were eliminated if more than 2 were reported as misleading or less than 85% of clinicians provided correct responses. Five themes (oSDB symptoms, treatment options, AT risks, anesthesia, and AT benefits) and 39 items composed the final scale. Experts scored higher than laymen on the oSDB and AT Knowledge Scale for Parents overall (17 [94%] vs 12 [67%]; Cohen d = 1.96; 95% CI, 1.05-2.86) and within all themes, including experiences of children with oSDB (19 [88%] vs 13 [62%]; Cohen d = 1.53; 95% CI, 0.71-2.32), treatment options (19 [97%] vs 12 [68%]; Cohen d = 1.74; 95% CI, 0.88-2.57), AT risks (17 [97%] vs 12 [59%]; Cohen d = 1.94; 95% CI, 1.03-2.83), anesthesia (17 [97%] vs 12 [79%]; Cohen d = 1.09; 95% CI, 0.29-1.88), and AT benefits (17 [95%] vs 12 [67%]; Cohen d = 1.28; 95% CI, 0.46-2.09), demonstrating criterion validity. All responses demonstrated high reliability (Cronbach a = 0.94). CONCLUSIONS AND RELEVANCE The oSDB and AT Knowledge Scale for Parents is psychometrically sound for use in the assessment of parental knowledge.

Original languageEnglish (US)
Pages (from-to)46-54
Number of pages9
JournalJAMA Otolaryngology - Head and Neck Surgery
Volume143
Issue number1
DOIs
StatePublished - Jan 1 2017

Fingerprint

Sleep Apnea Syndromes
Parents
Pediatrics
Anesthesia
Psychometrics
Consensus
Decision Making
Therapeutics
Demography
Surveys and Questionnaires

ASJC Scopus subject areas

  • Surgery
  • Otorhinolaryngology

Cite this

@article{b3bd2efce3764915b42405ea30467ba5,
title = "Stakeholder-engaged measure development for pediatric obstructive sleep-disordered breathing the obstructive sleep-disordered breathing and adenotonsillectomy knowledge scale for parents",
abstract = "IMPORTANCE Parental decision making about adenotonsillectomy (AT) for obstructive sleep-disordered breathing (oSDB) is associated with decisional conflict that may be alleviated with improved knowledge about symptoms and treatments. OBJECTIVE To develop a measure of parental knowledge about oSDB and AT. DESIGN, SETTING, AND PARTICIPANTS A sequential design was used for scale development. A prototype measure containing 9 oSDB and AT themes and 85 items was administered in survey format via an online platform. Participants included 19 clinician experts (otolaryngologists and pediatricians) and 13 laymen (parents of children who snore or do not snore, and other adults). Quantitative and qualitative responses were used to modify the measure and create the knowledge scale. Content validity of the scale was established through expert feedback and evaluation. Criterion validity was established with t test comparisons of experts with laymen. Reliability of the responses was assessed with Cronbach a testing. MAIN OUTCOMES AND MEASURES An 85-item prototype measure and 39-item modified measure were evaluated for consensus/approval and psychometric integrity. RESULTS Of 45 potential participants, 32 individuals (71{\%}) responded to the prototype scale. Respondents included 19 clinician experts (59{\%}) (otolaryngologists and pediatricians) and 13 laymen (41{\%}) (parents of children who snore [n = 8] or do not snore [n = 2] and other adults [n = 3]); demographic data were not collected. Content analysis and qualitative feedback were largely rated positively: 27 respondents (84{\%}) stated that the measure was a good evaluation of knowledge, 30 respondents (94{\%}) commented that the items were clear, and 31 individuals (97{\%}) approved of its organization, although there were several suggestions for rewording and/or addition of response options. Experts identified themes most important for assessing oSDB (symptoms) and AT (experiences: risks and benefits) knowledge. These qualitative comments were used to modify the scale, and items were eliminated if more than 2 were reported as misleading or less than 85{\%} of clinicians provided correct responses. Five themes (oSDB symptoms, treatment options, AT risks, anesthesia, and AT benefits) and 39 items composed the final scale. Experts scored higher than laymen on the oSDB and AT Knowledge Scale for Parents overall (17 [94{\%}] vs 12 [67{\%}]; Cohen d = 1.96; 95{\%} CI, 1.05-2.86) and within all themes, including experiences of children with oSDB (19 [88{\%}] vs 13 [62{\%}]; Cohen d = 1.53; 95{\%} CI, 0.71-2.32), treatment options (19 [97{\%}] vs 12 [68{\%}]; Cohen d = 1.74; 95{\%} CI, 0.88-2.57), AT risks (17 [97{\%}] vs 12 [59{\%}]; Cohen d = 1.94; 95{\%} CI, 1.03-2.83), anesthesia (17 [97{\%}] vs 12 [79{\%}]; Cohen d = 1.09; 95{\%} CI, 0.29-1.88), and AT benefits (17 [95{\%}] vs 12 [67{\%}]; Cohen d = 1.28; 95{\%} CI, 0.46-2.09), demonstrating criterion validity. All responses demonstrated high reliability (Cronbach a = 0.94). CONCLUSIONS AND RELEVANCE The oSDB and AT Knowledge Scale for Parents is psychometrically sound for use in the assessment of parental knowledge.",
author = "Links, {Anne R.} and Tunkel, {David E} and Emily Boss",
year = "2017",
month = "1",
day = "1",
doi = "10.1001/jamaoto.2016.2681",
language = "English (US)",
volume = "143",
pages = "46--54",
journal = "Archives of Otolaryngology",
issn = "2168-6181",
publisher = "American Medical Association",
number = "1",

}

TY - JOUR

T1 - Stakeholder-engaged measure development for pediatric obstructive sleep-disordered breathing the obstructive sleep-disordered breathing and adenotonsillectomy knowledge scale for parents

AU - Links, Anne R.

AU - Tunkel, David E

AU - Boss, Emily

PY - 2017/1/1

Y1 - 2017/1/1

N2 - IMPORTANCE Parental decision making about adenotonsillectomy (AT) for obstructive sleep-disordered breathing (oSDB) is associated with decisional conflict that may be alleviated with improved knowledge about symptoms and treatments. OBJECTIVE To develop a measure of parental knowledge about oSDB and AT. DESIGN, SETTING, AND PARTICIPANTS A sequential design was used for scale development. A prototype measure containing 9 oSDB and AT themes and 85 items was administered in survey format via an online platform. Participants included 19 clinician experts (otolaryngologists and pediatricians) and 13 laymen (parents of children who snore or do not snore, and other adults). Quantitative and qualitative responses were used to modify the measure and create the knowledge scale. Content validity of the scale was established through expert feedback and evaluation. Criterion validity was established with t test comparisons of experts with laymen. Reliability of the responses was assessed with Cronbach a testing. MAIN OUTCOMES AND MEASURES An 85-item prototype measure and 39-item modified measure were evaluated for consensus/approval and psychometric integrity. RESULTS Of 45 potential participants, 32 individuals (71%) responded to the prototype scale. Respondents included 19 clinician experts (59%) (otolaryngologists and pediatricians) and 13 laymen (41%) (parents of children who snore [n = 8] or do not snore [n = 2] and other adults [n = 3]); demographic data were not collected. Content analysis and qualitative feedback were largely rated positively: 27 respondents (84%) stated that the measure was a good evaluation of knowledge, 30 respondents (94%) commented that the items were clear, and 31 individuals (97%) approved of its organization, although there were several suggestions for rewording and/or addition of response options. Experts identified themes most important for assessing oSDB (symptoms) and AT (experiences: risks and benefits) knowledge. These qualitative comments were used to modify the scale, and items were eliminated if more than 2 were reported as misleading or less than 85% of clinicians provided correct responses. Five themes (oSDB symptoms, treatment options, AT risks, anesthesia, and AT benefits) and 39 items composed the final scale. Experts scored higher than laymen on the oSDB and AT Knowledge Scale for Parents overall (17 [94%] vs 12 [67%]; Cohen d = 1.96; 95% CI, 1.05-2.86) and within all themes, including experiences of children with oSDB (19 [88%] vs 13 [62%]; Cohen d = 1.53; 95% CI, 0.71-2.32), treatment options (19 [97%] vs 12 [68%]; Cohen d = 1.74; 95% CI, 0.88-2.57), AT risks (17 [97%] vs 12 [59%]; Cohen d = 1.94; 95% CI, 1.03-2.83), anesthesia (17 [97%] vs 12 [79%]; Cohen d = 1.09; 95% CI, 0.29-1.88), and AT benefits (17 [95%] vs 12 [67%]; Cohen d = 1.28; 95% CI, 0.46-2.09), demonstrating criterion validity. All responses demonstrated high reliability (Cronbach a = 0.94). CONCLUSIONS AND RELEVANCE The oSDB and AT Knowledge Scale for Parents is psychometrically sound for use in the assessment of parental knowledge.

AB - IMPORTANCE Parental decision making about adenotonsillectomy (AT) for obstructive sleep-disordered breathing (oSDB) is associated with decisional conflict that may be alleviated with improved knowledge about symptoms and treatments. OBJECTIVE To develop a measure of parental knowledge about oSDB and AT. DESIGN, SETTING, AND PARTICIPANTS A sequential design was used for scale development. A prototype measure containing 9 oSDB and AT themes and 85 items was administered in survey format via an online platform. Participants included 19 clinician experts (otolaryngologists and pediatricians) and 13 laymen (parents of children who snore or do not snore, and other adults). Quantitative and qualitative responses were used to modify the measure and create the knowledge scale. Content validity of the scale was established through expert feedback and evaluation. Criterion validity was established with t test comparisons of experts with laymen. Reliability of the responses was assessed with Cronbach a testing. MAIN OUTCOMES AND MEASURES An 85-item prototype measure and 39-item modified measure were evaluated for consensus/approval and psychometric integrity. RESULTS Of 45 potential participants, 32 individuals (71%) responded to the prototype scale. Respondents included 19 clinician experts (59%) (otolaryngologists and pediatricians) and 13 laymen (41%) (parents of children who snore [n = 8] or do not snore [n = 2] and other adults [n = 3]); demographic data were not collected. Content analysis and qualitative feedback were largely rated positively: 27 respondents (84%) stated that the measure was a good evaluation of knowledge, 30 respondents (94%) commented that the items were clear, and 31 individuals (97%) approved of its organization, although there were several suggestions for rewording and/or addition of response options. Experts identified themes most important for assessing oSDB (symptoms) and AT (experiences: risks and benefits) knowledge. These qualitative comments were used to modify the scale, and items were eliminated if more than 2 were reported as misleading or less than 85% of clinicians provided correct responses. Five themes (oSDB symptoms, treatment options, AT risks, anesthesia, and AT benefits) and 39 items composed the final scale. Experts scored higher than laymen on the oSDB and AT Knowledge Scale for Parents overall (17 [94%] vs 12 [67%]; Cohen d = 1.96; 95% CI, 1.05-2.86) and within all themes, including experiences of children with oSDB (19 [88%] vs 13 [62%]; Cohen d = 1.53; 95% CI, 0.71-2.32), treatment options (19 [97%] vs 12 [68%]; Cohen d = 1.74; 95% CI, 0.88-2.57), AT risks (17 [97%] vs 12 [59%]; Cohen d = 1.94; 95% CI, 1.03-2.83), anesthesia (17 [97%] vs 12 [79%]; Cohen d = 1.09; 95% CI, 0.29-1.88), and AT benefits (17 [95%] vs 12 [67%]; Cohen d = 1.28; 95% CI, 0.46-2.09), demonstrating criterion validity. All responses demonstrated high reliability (Cronbach a = 0.94). CONCLUSIONS AND RELEVANCE The oSDB and AT Knowledge Scale for Parents is psychometrically sound for use in the assessment of parental knowledge.

UR - http://www.scopus.com/inward/record.url?scp=85012041430&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85012041430&partnerID=8YFLogxK

U2 - 10.1001/jamaoto.2016.2681

DO - 10.1001/jamaoto.2016.2681

M3 - Article

C2 - 27631116

AN - SCOPUS:85012041430

VL - 143

SP - 46

EP - 54

JO - Archives of Otolaryngology

JF - Archives of Otolaryngology

SN - 2168-6181

IS - 1

ER -