A systematic review of behavioural marker systems in healthcare: What do we know about their attributes, validity and application?

Aaron S. Dietz, Peter J. Pronovost, Kari N. Benson, Pedro Alejandro Mendez-Tellez, Cynthia Dwyer, Rhonda Wyskiel, Michael A. Rosen

Research output: Contribution to journalReview article

Abstract

Objective Behavioural marker systems are advocated as a method for providing accurate assessments, directing feedback and determining the impact of teamwork improvement initiatives. The present article reports on the state of quality surrounding their use in healthcare and discusses the implications of these findings for future research, development and application. In doing so, this article provides a practical resource where marker systems can be selected and evaluated based on their strengths and limitations.

Methods Four research questions framed this review: what are the attributes of behavioural marker systems? What evidence of reliability and validity exists? What skills and expertise are required for their use? How have they been applied to investigate the relationship between teamwork and other constructs?

Results Behavioural markers systems are generally designed for specific work domains or tasks. They often cover similar content with inconsistent terminology, which complicates the comparison of research findings across clinical domains. Although several approaches were used to establish the reliability and validity of marker systems, the marker system literature, as a whole, requires more robust reliability and validity evidence. The impact of rater training on rater proficiency was mixed, but evidence suggests that improvements can be made over time.

Conclusions A consensus of definitions for teamwork constructs must be reached to ensure that the meaning behind behavioural measurement is understood across disciplines, work domains and task types. Future development efforts should focus on the cost effectiveness and feasibility of measurement tools including time spent training raters. Further,standards for the testing and reporting of psychometric evidence must be established. Last, a library of tools should be generated around whether the instrument measures general or domain-specific behaviours.

Original languageEnglish (US)
Pages (from-to)1031-1039
Number of pages9
JournalBMJ Quality and Safety
Volume23
Issue number12
DOIs
StatePublished - Dec 1 2014

ASJC Scopus subject areas

  • Health Policy

Fingerprint Dive into the research topics of 'A systematic review of behavioural marker systems in healthcare: What do we know about their attributes, validity and application?'. Together they form a unique fingerprint.

  • Cite this