The development and validation of hand motion analysis to evaluate competency in central line catheterization

David Clinkard, Matthew Holden, Tamas Ungi, David Messenger, Colleen Davison, Gabor Fichtinger, Robert McGraw

Research output: Contribution to journalArticle

Abstract

Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.

Original languageEnglish (US)
Pages (from-to)212-218
Number of pages7
JournalAcademic Emergency Medicine
Volume22
Issue number2
DOIs
StatePublished - Feb 1 2015
Externally publishedYes

Fingerprint

Central Venous Catheterization
Hand
Electromagnetic Phenomena
Central Venous Catheters
Observation
Manikins
Emergency Medicine
Critical Care
Catheterization
Mental Competency
Needles
Neck
Learning
Physicians

ASJC Scopus subject areas

  • Emergency Medicine
  • Medicine(all)

Cite this

Clinkard, D., Holden, M., Ungi, T., Messenger, D., Davison, C., Fichtinger, G., & McGraw, R. (2015). The development and validation of hand motion analysis to evaluate competency in central line catheterization. Academic Emergency Medicine, 22(2), 212-218. https://doi.org/10.1111/acem.12590

The development and validation of hand motion analysis to evaluate competency in central line catheterization. / Clinkard, David; Holden, Matthew; Ungi, Tamas; Messenger, David; Davison, Colleen; Fichtinger, Gabor; McGraw, Robert.

In: Academic Emergency Medicine, Vol. 22, No. 2, 01.02.2015, p. 212-218.

Research output: Contribution to journalArticle

Clinkard, D, Holden, M, Ungi, T, Messenger, D, Davison, C, Fichtinger, G & McGraw, R 2015, 'The development and validation of hand motion analysis to evaluate competency in central line catheterization', Academic Emergency Medicine, vol. 22, no. 2, pp. 212-218. https://doi.org/10.1111/acem.12590
Clinkard, David ; Holden, Matthew ; Ungi, Tamas ; Messenger, David ; Davison, Colleen ; Fichtinger, Gabor ; McGraw, Robert. / The development and validation of hand motion analysis to evaluate competency in central line catheterization. In: Academic Emergency Medicine. 2015 ; Vol. 22, No. 2. pp. 212-218.
@article{4e375cc3be8b49fcb169926ded8839ee,
title = "The development and validation of hand motion analysis to evaluate competency in central line catheterization",
abstract = "Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66{\%} less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.",
author = "David Clinkard and Matthew Holden and Tamas Ungi and David Messenger and Colleen Davison and Gabor Fichtinger and Robert McGraw",
year = "2015",
month = "2",
day = "1",
doi = "10.1111/acem.12590",
language = "English (US)",
volume = "22",
pages = "212--218",
journal = "Academic Emergency Medicine",
issn = "1069-6563",
publisher = "Wiley-Blackwell",
number = "2",

}

TY - JOUR

T1 - The development and validation of hand motion analysis to evaluate competency in central line catheterization

AU - Clinkard, David

AU - Holden, Matthew

AU - Ungi, Tamas

AU - Messenger, David

AU - Davison, Colleen

AU - Fichtinger, Gabor

AU - McGraw, Robert

PY - 2015/2/1

Y1 - 2015/2/1

N2 - Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.

AB - Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.

UR - http://www.scopus.com/inward/record.url?scp=84925359712&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84925359712&partnerID=8YFLogxK

U2 - 10.1111/acem.12590

DO - 10.1111/acem.12590

M3 - Article

C2 - 25676530

AN - SCOPUS:84925359712

VL - 22

SP - 212

EP - 218

JO - Academic Emergency Medicine

JF - Academic Emergency Medicine

SN - 1069-6563

IS - 2

ER -