Abstract
Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 212-218 |
| Number of pages | 7 |
| Journal | Academic Emergency Medicine |
| Volume | 22 |
| Issue number | 2 |
| DOIs | |
| State | Published - Feb 1 2015 |
| Externally published | Yes |
Fingerprint
ASJC Scopus subject areas
- Emergency Medicine
- Medicine(all)
Cite this
The development and validation of hand motion analysis to evaluate competency in central line catheterization. / Clinkard, David; Holden, Matthew; Ungi, Tamas; Messenger, David; Davison, Colleen; Fichtinger, Gabor; McGraw, Robert.
In: Academic Emergency Medicine, Vol. 22, No. 2, 01.02.2015, p. 212-218.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - The development and validation of hand motion analysis to evaluate competency in central line catheterization
AU - Clinkard, David
AU - Holden, Matthew
AU - Ungi, Tamas
AU - Messenger, David
AU - Davison, Colleen
AU - Fichtinger, Gabor
AU - McGraw, Robert
PY - 2015/2/1
Y1 - 2015/2/1
N2 - Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.
AB - Objectives Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. Methods Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. Results There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p <0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. Conclusions Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.
UR - http://www.scopus.com/inward/record.url?scp=84925359712&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84925359712&partnerID=8YFLogxK
U2 - 10.1111/acem.12590
DO - 10.1111/acem.12590
M3 - Article
C2 - 25676530
AN - SCOPUS:84925359712
VL - 22
SP - 212
EP - 218
JO - Academic Emergency Medicine
JF - Academic Emergency Medicine
SN - 1069-6563
IS - 2
ER -