Interobserver variability in assessment of cranial ultrasound in very preterm infants

C. F. Hagmann, M. Halbherr, B. Koller, P. Wintermark, T. Huisman, H. U. Bucher

Research output: Contribution to journalArticle

Abstract

Background: Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required. Aims: The aims of this study were (i) to assess the interobserver variability in cUS interpretation, and (ii) to evaluate whether level of cUS expertise influences the interobserver variability. Methods: Fifty-eight cUS image series of preterm infants born below 32. weeks of gestation collected within the Swiss Neonatal Network were sent to 27 observers for reviewing. Observers were grouped into radiologists, experienced neonatologists and less experienced neonatologists. Agreement between observers was calculated using Kappa statistics. Results: When cystic periventricular leukomalacia, intraventricular haemorrhage and periventricular haemorrhagic infarction were combined to one outcome, agreement among all observers was moderate. When divided into subgroups, kappa for the combined outcome was 0.7 for experienced neonatologists, 0.67 for radiologists and 0.53 for inexperienced neonatologists. Marked difference in interobserver agreement between experienced neonatologists and radiologists could be found for haemorrhagic periventricular ifraction (HPI). Conclusions: Our results suggest that interobserver agreement for interpretation of cUS varies from poor to good varying with the type of abnormality and level of expertise, suggesting that widespread structured training should be made available to improve the performance and interpretation of cUS.

Original languageEnglish (US)
Pages (from-to)291-297
Number of pages7
JournalJournal of Neuroradiology
Volume38
Issue number5
DOIs
StatePublished - Dec 2011
Externally publishedYes

Fingerprint

Observer Variation
Premature Infants
Periventricular Leukomalacia
Infarction
Parents
Outcome Assessment (Health Care)
Neonatologists
Hemorrhage
Pregnancy
Research
Radiologists

Keywords

  • Cranial ultrasound
  • Interobserver agreement
  • Neonatal

ASJC Scopus subject areas

  • Clinical Neurology
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology

Cite this

Hagmann, C. F., Halbherr, M., Koller, B., Wintermark, P., Huisman, T., & Bucher, H. U. (2011). Interobserver variability in assessment of cranial ultrasound in very preterm infants. Journal of Neuroradiology, 38(5), 291-297. https://doi.org/10.1016/j.neurad.2010.12.008

Interobserver variability in assessment of cranial ultrasound in very preterm infants. / Hagmann, C. F.; Halbherr, M.; Koller, B.; Wintermark, P.; Huisman, T.; Bucher, H. U.

In: Journal of Neuroradiology, Vol. 38, No. 5, 12.2011, p. 291-297.

Research output: Contribution to journalArticle

Hagmann, CF, Halbherr, M, Koller, B, Wintermark, P, Huisman, T & Bucher, HU 2011, 'Interobserver variability in assessment of cranial ultrasound in very preterm infants', Journal of Neuroradiology, vol. 38, no. 5, pp. 291-297. https://doi.org/10.1016/j.neurad.2010.12.008
Hagmann, C. F. ; Halbherr, M. ; Koller, B. ; Wintermark, P. ; Huisman, T. ; Bucher, H. U. / Interobserver variability in assessment of cranial ultrasound in very preterm infants. In: Journal of Neuroradiology. 2011 ; Vol. 38, No. 5. pp. 291-297.
@article{7bfef600404943918f937e525a8b9717,
title = "Interobserver variability in assessment of cranial ultrasound in very preterm infants",
abstract = "Background: Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required. Aims: The aims of this study were (i) to assess the interobserver variability in cUS interpretation, and (ii) to evaluate whether level of cUS expertise influences the interobserver variability. Methods: Fifty-eight cUS image series of preterm infants born below 32. weeks of gestation collected within the Swiss Neonatal Network were sent to 27 observers for reviewing. Observers were grouped into radiologists, experienced neonatologists and less experienced neonatologists. Agreement between observers was calculated using Kappa statistics. Results: When cystic periventricular leukomalacia, intraventricular haemorrhage and periventricular haemorrhagic infarction were combined to one outcome, agreement among all observers was moderate. When divided into subgroups, kappa for the combined outcome was 0.7 for experienced neonatologists, 0.67 for radiologists and 0.53 for inexperienced neonatologists. Marked difference in interobserver agreement between experienced neonatologists and radiologists could be found for haemorrhagic periventricular ifraction (HPI). Conclusions: Our results suggest that interobserver agreement for interpretation of cUS varies from poor to good varying with the type of abnormality and level of expertise, suggesting that widespread structured training should be made available to improve the performance and interpretation of cUS.",
keywords = "Cranial ultrasound, Interobserver agreement, Neonatal",
author = "Hagmann, {C. F.} and M. Halbherr and B. Koller and P. Wintermark and T. Huisman and Bucher, {H. U.}",
year = "2011",
month = "12",
doi = "10.1016/j.neurad.2010.12.008",
language = "English (US)",
volume = "38",
pages = "291--297",
journal = "Journal of Neuroradiology",
issn = "0150-9861",
publisher = "Elsevier Masson",
number = "5",

}

TY - JOUR

T1 - Interobserver variability in assessment of cranial ultrasound in very preterm infants

AU - Hagmann, C. F.

AU - Halbherr, M.

AU - Koller, B.

AU - Wintermark, P.

AU - Huisman, T.

AU - Bucher, H. U.

PY - 2011/12

Y1 - 2011/12

N2 - Background: Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required. Aims: The aims of this study were (i) to assess the interobserver variability in cUS interpretation, and (ii) to evaluate whether level of cUS expertise influences the interobserver variability. Methods: Fifty-eight cUS image series of preterm infants born below 32. weeks of gestation collected within the Swiss Neonatal Network were sent to 27 observers for reviewing. Observers were grouped into radiologists, experienced neonatologists and less experienced neonatologists. Agreement between observers was calculated using Kappa statistics. Results: When cystic periventricular leukomalacia, intraventricular haemorrhage and periventricular haemorrhagic infarction were combined to one outcome, agreement among all observers was moderate. When divided into subgroups, kappa for the combined outcome was 0.7 for experienced neonatologists, 0.67 for radiologists and 0.53 for inexperienced neonatologists. Marked difference in interobserver agreement between experienced neonatologists and radiologists could be found for haemorrhagic periventricular ifraction (HPI). Conclusions: Our results suggest that interobserver agreement for interpretation of cUS varies from poor to good varying with the type of abnormality and level of expertise, suggesting that widespread structured training should be made available to improve the performance and interpretation of cUS.

AB - Background: Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required. Aims: The aims of this study were (i) to assess the interobserver variability in cUS interpretation, and (ii) to evaluate whether level of cUS expertise influences the interobserver variability. Methods: Fifty-eight cUS image series of preterm infants born below 32. weeks of gestation collected within the Swiss Neonatal Network were sent to 27 observers for reviewing. Observers were grouped into radiologists, experienced neonatologists and less experienced neonatologists. Agreement between observers was calculated using Kappa statistics. Results: When cystic periventricular leukomalacia, intraventricular haemorrhage and periventricular haemorrhagic infarction were combined to one outcome, agreement among all observers was moderate. When divided into subgroups, kappa for the combined outcome was 0.7 for experienced neonatologists, 0.67 for radiologists and 0.53 for inexperienced neonatologists. Marked difference in interobserver agreement between experienced neonatologists and radiologists could be found for haemorrhagic periventricular ifraction (HPI). Conclusions: Our results suggest that interobserver agreement for interpretation of cUS varies from poor to good varying with the type of abnormality and level of expertise, suggesting that widespread structured training should be made available to improve the performance and interpretation of cUS.

KW - Cranial ultrasound

KW - Interobserver agreement

KW - Neonatal

UR - http://www.scopus.com/inward/record.url?scp=82455212103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=82455212103&partnerID=8YFLogxK

U2 - 10.1016/j.neurad.2010.12.008

DO - 10.1016/j.neurad.2010.12.008

M3 - Article

VL - 38

SP - 291

EP - 297

JO - Journal of Neuroradiology

JF - Journal of Neuroradiology

SN - 0150-9861

IS - 5

ER -