A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model

Alan Cook, Jo Weddle, Susan Baker, David Hosmer, Laurent Glance, Lee Friedman, Turner Osler

Research output: Contribution to journalArticle

Abstract

BACKGROUND: Performance benchmarking requires accurate measurement of injury severity. Despite its shortcomings, the Injury Severity Score (ISS) remains the industry standard 40 years after its creation. A new severity measure, the Trauma Mortality Prediction Model (TMPM), uses either the Abbreviated Injury Scale (AIS) or DRG International Classification of DiseasesV9th Rev. (ICD-9) lexicons and may better quantify injury severity compared with ISS. We compared the performance of TMPM with ISS and other measures of injury severity in a single cohort of patients. METHODS: We included 337,359 patient records with injuries reliably described in both the AIS and the ICD-9 lexicons from the National Trauma Data Bank. Five injury severity measures (ISS, maximum AIS score, New Injury Severity Score [NISS], ICD-9YBased Injury Severity Score [ICISS], TMPM) were computed using either the AIS or ICD-9 codes. These measures were compared for discrimination (area under the receiver operating characteristic curve), an estimate of proximity to a model that perfectly predicts the outcome (Akaike information criterion), and model calibration curves. RESULTS: TMPM demonstrated superior receiver operating characteristic curve, Akaike information criterion, and calibration using either the AIS or ICD-9 lexicons. Calibration plots demonstrate the monotonic characteristics of the TMPM models contrasted by the nonmonotonic features of the other prediction models. CONCLUSION: Severity measures were more accurate with the AIS lexicon rather than ICD-9. NISS proved superior to ISS in either lexicon. Since NISS is simpler to compute, it should replace ISS when a quick estimate of injury severity is required for AIS-coded injuries. Calibration curves suggest that the nonmonotonic nature of ISS may undermine its performance. TMPM demonstrated superior overall mortality prediction compared with all other models including ISS whether the AIS or ICD-9 lexicons were used. Because TMPM provides an absolute probability of death, it may allow clinicians to communicate more precisely with one another and with patients and families. (J Trauma Acute Care Surg. 2014;76: 47Y53.

Original languageEnglish (US)
Pages (from-to)47-53
Number of pages7
JournalThe journal of trauma and acute care surgery
Volume76
Issue number1
DOIs
StatePublished - Jan 2014

Fingerprint

Injury Severity Score
Abbreviated Injury Scale
Mortality
Wounds and Injuries
Calibration
ROC Curve
Benchmarking
Diagnosis-Related Groups

Keywords

  • ISS
  • Mortality prediction
  • NISS
  • TMPM

ASJC Scopus subject areas

  • Critical Care and Intensive Care Medicine
  • Surgery

Cite this

A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model. / Cook, Alan; Weddle, Jo; Baker, Susan; Hosmer, David; Glance, Laurent; Friedman, Lee; Osler, Turner.

In: The journal of trauma and acute care surgery, Vol. 76, No. 1, 01.2014, p. 47-53.

Research output: Contribution to journalArticle

Cook, A, Weddle, J, Baker, S, Hosmer, D, Glance, L, Friedman, L & Osler, T 2014, 'A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model', The journal of trauma and acute care surgery, vol. 76, no. 1, pp. 47-53. https://doi.org/10.1097/TA.0b013e3182ab0d5d
Cook, Alan ; Weddle, Jo ; Baker, Susan ; Hosmer, David ; Glance, Laurent ; Friedman, Lee ; Osler, Turner. / A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model. In: The journal of trauma and acute care surgery. 2014 ; Vol. 76, No. 1. pp. 47-53.
@article{9f4ef53b01b945f981812004c84347d7,
title = "A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model",
abstract = "BACKGROUND: Performance benchmarking requires accurate measurement of injury severity. Despite its shortcomings, the Injury Severity Score (ISS) remains the industry standard 40 years after its creation. A new severity measure, the Trauma Mortality Prediction Model (TMPM), uses either the Abbreviated Injury Scale (AIS) or DRG International Classification of DiseasesV9th Rev. (ICD-9) lexicons and may better quantify injury severity compared with ISS. We compared the performance of TMPM with ISS and other measures of injury severity in a single cohort of patients. METHODS: We included 337,359 patient records with injuries reliably described in both the AIS and the ICD-9 lexicons from the National Trauma Data Bank. Five injury severity measures (ISS, maximum AIS score, New Injury Severity Score [NISS], ICD-9YBased Injury Severity Score [ICISS], TMPM) were computed using either the AIS or ICD-9 codes. These measures were compared for discrimination (area under the receiver operating characteristic curve), an estimate of proximity to a model that perfectly predicts the outcome (Akaike information criterion), and model calibration curves. RESULTS: TMPM demonstrated superior receiver operating characteristic curve, Akaike information criterion, and calibration using either the AIS or ICD-9 lexicons. Calibration plots demonstrate the monotonic characteristics of the TMPM models contrasted by the nonmonotonic features of the other prediction models. CONCLUSION: Severity measures were more accurate with the AIS lexicon rather than ICD-9. NISS proved superior to ISS in either lexicon. Since NISS is simpler to compute, it should replace ISS when a quick estimate of injury severity is required for AIS-coded injuries. Calibration curves suggest that the nonmonotonic nature of ISS may undermine its performance. TMPM demonstrated superior overall mortality prediction compared with all other models including ISS whether the AIS or ICD-9 lexicons were used. Because TMPM provides an absolute probability of death, it may allow clinicians to communicate more precisely with one another and with patients and families. (J Trauma Acute Care Surg. 2014;76: 47Y53.",
keywords = "ISS, Mortality prediction, NISS, TMPM",
author = "Alan Cook and Jo Weddle and Susan Baker and David Hosmer and Laurent Glance and Lee Friedman and Turner Osler",
year = "2014",
month = "1",
doi = "10.1097/TA.0b013e3182ab0d5d",
language = "English (US)",
volume = "76",
pages = "47--53",
journal = "Journal of Trauma and Acute Care Surgery",
issn = "2163-0755",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model

AU - Cook, Alan

AU - Weddle, Jo

AU - Baker, Susan

AU - Hosmer, David

AU - Glance, Laurent

AU - Friedman, Lee

AU - Osler, Turner

PY - 2014/1

Y1 - 2014/1

N2 - BACKGROUND: Performance benchmarking requires accurate measurement of injury severity. Despite its shortcomings, the Injury Severity Score (ISS) remains the industry standard 40 years after its creation. A new severity measure, the Trauma Mortality Prediction Model (TMPM), uses either the Abbreviated Injury Scale (AIS) or DRG International Classification of DiseasesV9th Rev. (ICD-9) lexicons and may better quantify injury severity compared with ISS. We compared the performance of TMPM with ISS and other measures of injury severity in a single cohort of patients. METHODS: We included 337,359 patient records with injuries reliably described in both the AIS and the ICD-9 lexicons from the National Trauma Data Bank. Five injury severity measures (ISS, maximum AIS score, New Injury Severity Score [NISS], ICD-9YBased Injury Severity Score [ICISS], TMPM) were computed using either the AIS or ICD-9 codes. These measures were compared for discrimination (area under the receiver operating characteristic curve), an estimate of proximity to a model that perfectly predicts the outcome (Akaike information criterion), and model calibration curves. RESULTS: TMPM demonstrated superior receiver operating characteristic curve, Akaike information criterion, and calibration using either the AIS or ICD-9 lexicons. Calibration plots demonstrate the monotonic characteristics of the TMPM models contrasted by the nonmonotonic features of the other prediction models. CONCLUSION: Severity measures were more accurate with the AIS lexicon rather than ICD-9. NISS proved superior to ISS in either lexicon. Since NISS is simpler to compute, it should replace ISS when a quick estimate of injury severity is required for AIS-coded injuries. Calibration curves suggest that the nonmonotonic nature of ISS may undermine its performance. TMPM demonstrated superior overall mortality prediction compared with all other models including ISS whether the AIS or ICD-9 lexicons were used. Because TMPM provides an absolute probability of death, it may allow clinicians to communicate more precisely with one another and with patients and families. (J Trauma Acute Care Surg. 2014;76: 47Y53.

AB - BACKGROUND: Performance benchmarking requires accurate measurement of injury severity. Despite its shortcomings, the Injury Severity Score (ISS) remains the industry standard 40 years after its creation. A new severity measure, the Trauma Mortality Prediction Model (TMPM), uses either the Abbreviated Injury Scale (AIS) or DRG International Classification of DiseasesV9th Rev. (ICD-9) lexicons and may better quantify injury severity compared with ISS. We compared the performance of TMPM with ISS and other measures of injury severity in a single cohort of patients. METHODS: We included 337,359 patient records with injuries reliably described in both the AIS and the ICD-9 lexicons from the National Trauma Data Bank. Five injury severity measures (ISS, maximum AIS score, New Injury Severity Score [NISS], ICD-9YBased Injury Severity Score [ICISS], TMPM) were computed using either the AIS or ICD-9 codes. These measures were compared for discrimination (area under the receiver operating characteristic curve), an estimate of proximity to a model that perfectly predicts the outcome (Akaike information criterion), and model calibration curves. RESULTS: TMPM demonstrated superior receiver operating characteristic curve, Akaike information criterion, and calibration using either the AIS or ICD-9 lexicons. Calibration plots demonstrate the monotonic characteristics of the TMPM models contrasted by the nonmonotonic features of the other prediction models. CONCLUSION: Severity measures were more accurate with the AIS lexicon rather than ICD-9. NISS proved superior to ISS in either lexicon. Since NISS is simpler to compute, it should replace ISS when a quick estimate of injury severity is required for AIS-coded injuries. Calibration curves suggest that the nonmonotonic nature of ISS may undermine its performance. TMPM demonstrated superior overall mortality prediction compared with all other models including ISS whether the AIS or ICD-9 lexicons were used. Because TMPM provides an absolute probability of death, it may allow clinicians to communicate more precisely with one another and with patients and families. (J Trauma Acute Care Surg. 2014;76: 47Y53.

KW - ISS

KW - Mortality prediction

KW - NISS

KW - TMPM

UR - http://www.scopus.com/inward/record.url?scp=84892163727&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892163727&partnerID=8YFLogxK

U2 - 10.1097/TA.0b013e3182ab0d5d

DO - 10.1097/TA.0b013e3182ab0d5d

M3 - Article

VL - 76

SP - 47

EP - 53

JO - Journal of Trauma and Acute Care Surgery

JF - Journal of Trauma and Acute Care Surgery

SN - 2163-0755

IS - 1

ER -