TY - JOUR
T1 - Using the American College of Radiology Thyroid Imaging Reporting and Data System at the Point of Care
T2 - Sonographer Performance and Interobserver Variability
AU - Wildman-Tobriner, Benjamin
AU - Ahmed, Salmaan
AU - Erkanli, Al
AU - Mazurowski, Maciej A.
AU - Hoang, Jenny K.
N1 - Publisher Copyright:
© 2020 World Federation for Ultrasound in Medicine & Biology
PY - 2020/8
Y1 - 2020/8
N2 - The purpose of this study was to assess inter-observer variability and performance when sonographers assign features to thyroid nodules on ultrasound using the American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS). Fifteen sonographers retrospectively evaluated 100 thyroid nodules and assigned features to each nodule according to ACR TI-RADS lexicon. Ratings were compared with one another and to a gold standard using Fleiss’ and Cohen's kappa statistics, respectively. Sonographers were also asked subjective questions regarding their comfort level assessing each feature, and opinions were compared with performance using a mixed effects model. Sonographers demonstrated only slight agreement for margin (κ = 0.18, 95% confidence interval [CI]: 0.16–0.20) and large comet tail artifact (κ = 0.08, 95% CI: 0.06–0.10) but better performance for macrocalcification (κ = 0.41, 95% CI: 0.39–0.43) and no echogenic foci (κ = 0.52, 95% CI: 0.50–0.54). Sonographer comfort level with different feature assignments did not statistically correlate with performance for a given feature. In conclusion, sonographers using ACR TI-RADS to assign thyroid nodule features on ultrasound demonstrate a range of agreement across features, with margin and large comet tail artifact showing the most variability. These results highlight potential areas of focus for sonographer education efforts as ACR TI-RADS continues to be implemented in radiology departments.
AB - The purpose of this study was to assess inter-observer variability and performance when sonographers assign features to thyroid nodules on ultrasound using the American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS). Fifteen sonographers retrospectively evaluated 100 thyroid nodules and assigned features to each nodule according to ACR TI-RADS lexicon. Ratings were compared with one another and to a gold standard using Fleiss’ and Cohen's kappa statistics, respectively. Sonographers were also asked subjective questions regarding their comfort level assessing each feature, and opinions were compared with performance using a mixed effects model. Sonographers demonstrated only slight agreement for margin (κ = 0.18, 95% confidence interval [CI]: 0.16–0.20) and large comet tail artifact (κ = 0.08, 95% CI: 0.06–0.10) but better performance for macrocalcification (κ = 0.41, 95% CI: 0.39–0.43) and no echogenic foci (κ = 0.52, 95% CI: 0.50–0.54). Sonographer comfort level with different feature assignments did not statistically correlate with performance for a given feature. In conclusion, sonographers using ACR TI-RADS to assign thyroid nodule features on ultrasound demonstrate a range of agreement across features, with margin and large comet tail artifact showing the most variability. These results highlight potential areas of focus for sonographer education efforts as ACR TI-RADS continues to be implemented in radiology departments.
KW - FNA
KW - Follow-up
KW - TI-RADS
KW - Ultrasound
UR - http://www.scopus.com/inward/record.url?scp=85085651018&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085651018&partnerID=8YFLogxK
U2 - 10.1016/j.ultrasmedbio.2020.04.019
DO - 10.1016/j.ultrasmedbio.2020.04.019
M3 - Article
C2 - 32507343
AN - SCOPUS:85085651018
SN - 0301-5629
VL - 46
SP - 1928
EP - 1933
JO - Ultrasound in Medicine and Biology
JF - Ultrasound in Medicine and Biology
IS - 8
ER -