Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: A systematic review and meta-analysis

Christopher R. Carpenter, Erica Shelton, Susan Fowler, Brian Suffoletto, Timothy F. Platts-Mills, Richard Rothman, Teresita M. Hogan

Research output: Contribution to journalArticle

Abstract

Objectives A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. Methods A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. Results A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency, malnutrition, pressure sore risk, and self-rated health. None of these risk factors significantly increased the risk of adverse outcome (LR+ range = 0.78 to 2.84). The absence of dependency reduces the risk of 1-year mortality (LR- = 0.27) and nursing home placement (LR- = 0.27). Five constructs of frailty were evaluated, but none increased or decreased the risk of adverse outcome. Three instruments were evaluated in the meta-analysis: Identification of Seniors at Risk, Triage Risk Screening Tool, and Variables Indicative of Placement Risk. None of these instruments significantly increased (LR+ range for various outcomes = 0.98 to 1.40) or decreased (LR- range = 0.53 to 1.11) the risk of adverse outcomes. The test threshold for 3-month functional decline based on the most accurate instrument was 42%, and the treatment threshold was 61%. Conclusions Risk stratification of geriatric adults following ED care is limited by the lack of pragmatic, accurate, and reliable instruments. Although absence of dependency reduces the risk of 1-year mortality, no individual risk factor, frailty construct, or risk assessment instrument accurately predicts risk of adverse outcomes in older ED patients. Existing instruments designed to risk stratify older ED patients do not accurately distinguish high- or low-risk subsets. Clinicians, educators, and policy-makers should not use these instruments as valid predictors of post-ED adverse outcomes. Future research to derive and validate feasible ED instruments to distinguish vulnerable elders should employ published decision instrument methods and examine the contributions of alternative variables, such as health literacy and dementia, which often remain clinically occult.

Original languageEnglish (US)
Pages (from-to)1-21
Number of pages21
JournalAcademic Emergency Medicine
Volume22
Issue number1
DOIs
StatePublished - Jan 1 2015

Fingerprint

Meta-Analysis
Hospital Emergency Service
Emergency Medical Services
Geriatrics
Dementia
Librarians
Physicians
Health Literacy
Patient Readmission
Mortality
Delirium
Pressure Ulcer
Triage
Nursing Homes
Administrative Personnel
PubMed
Malnutrition
Emergencies
Software
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Emergency Medicine
  • Medicine(all)

Cite this

Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients : A systematic review and meta-analysis. / Carpenter, Christopher R.; Shelton, Erica; Fowler, Susan; Suffoletto, Brian; Platts-Mills, Timothy F.; Rothman, Richard; Hogan, Teresita M.

In: Academic Emergency Medicine, Vol. 22, No. 1, 01.01.2015, p. 1-21.

Research output: Contribution to journalArticle

Carpenter, Christopher R. ; Shelton, Erica ; Fowler, Susan ; Suffoletto, Brian ; Platts-Mills, Timothy F. ; Rothman, Richard ; Hogan, Teresita M. / Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients : A systematic review and meta-analysis. In: Academic Emergency Medicine. 2015 ; Vol. 22, No. 1. pp. 1-21.
@article{574432d2a1e54aaa95449194e0b566a0,
title = "Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: A systematic review and meta-analysis",
abstract = "Objectives A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. Methods A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. Results A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency, malnutrition, pressure sore risk, and self-rated health. None of these risk factors significantly increased the risk of adverse outcome (LR+ range = 0.78 to 2.84). The absence of dependency reduces the risk of 1-year mortality (LR- = 0.27) and nursing home placement (LR- = 0.27). Five constructs of frailty were evaluated, but none increased or decreased the risk of adverse outcome. Three instruments were evaluated in the meta-analysis: Identification of Seniors at Risk, Triage Risk Screening Tool, and Variables Indicative of Placement Risk. None of these instruments significantly increased (LR+ range for various outcomes = 0.98 to 1.40) or decreased (LR- range = 0.53 to 1.11) the risk of adverse outcomes. The test threshold for 3-month functional decline based on the most accurate instrument was 42{\%}, and the treatment threshold was 61{\%}. Conclusions Risk stratification of geriatric adults following ED care is limited by the lack of pragmatic, accurate, and reliable instruments. Although absence of dependency reduces the risk of 1-year mortality, no individual risk factor, frailty construct, or risk assessment instrument accurately predicts risk of adverse outcomes in older ED patients. Existing instruments designed to risk stratify older ED patients do not accurately distinguish high- or low-risk subsets. Clinicians, educators, and policy-makers should not use these instruments as valid predictors of post-ED adverse outcomes. Future research to derive and validate feasible ED instruments to distinguish vulnerable elders should employ published decision instrument methods and examine the contributions of alternative variables, such as health literacy and dementia, which often remain clinically occult.",
author = "Carpenter, {Christopher R.} and Erica Shelton and Susan Fowler and Brian Suffoletto and Platts-Mills, {Timothy F.} and Richard Rothman and Hogan, {Teresita M.}",
year = "2015",
month = "1",
day = "1",
doi = "10.1111/acem.12569",
language = "English (US)",
volume = "22",
pages = "1--21",
journal = "Academic Emergency Medicine",
issn = "1069-6563",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients

T2 - A systematic review and meta-analysis

AU - Carpenter, Christopher R.

AU - Shelton, Erica

AU - Fowler, Susan

AU - Suffoletto, Brian

AU - Platts-Mills, Timothy F.

AU - Rothman, Richard

AU - Hogan, Teresita M.

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Objectives A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. Methods A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. Results A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency, malnutrition, pressure sore risk, and self-rated health. None of these risk factors significantly increased the risk of adverse outcome (LR+ range = 0.78 to 2.84). The absence of dependency reduces the risk of 1-year mortality (LR- = 0.27) and nursing home placement (LR- = 0.27). Five constructs of frailty were evaluated, but none increased or decreased the risk of adverse outcome. Three instruments were evaluated in the meta-analysis: Identification of Seniors at Risk, Triage Risk Screening Tool, and Variables Indicative of Placement Risk. None of these instruments significantly increased (LR+ range for various outcomes = 0.98 to 1.40) or decreased (LR- range = 0.53 to 1.11) the risk of adverse outcomes. The test threshold for 3-month functional decline based on the most accurate instrument was 42%, and the treatment threshold was 61%. Conclusions Risk stratification of geriatric adults following ED care is limited by the lack of pragmatic, accurate, and reliable instruments. Although absence of dependency reduces the risk of 1-year mortality, no individual risk factor, frailty construct, or risk assessment instrument accurately predicts risk of adverse outcomes in older ED patients. Existing instruments designed to risk stratify older ED patients do not accurately distinguish high- or low-risk subsets. Clinicians, educators, and policy-makers should not use these instruments as valid predictors of post-ED adverse outcomes. Future research to derive and validate feasible ED instruments to distinguish vulnerable elders should employ published decision instrument methods and examine the contributions of alternative variables, such as health literacy and dementia, which often remain clinically occult.

AB - Objectives A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. Methods A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. Results A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency, malnutrition, pressure sore risk, and self-rated health. None of these risk factors significantly increased the risk of adverse outcome (LR+ range = 0.78 to 2.84). The absence of dependency reduces the risk of 1-year mortality (LR- = 0.27) and nursing home placement (LR- = 0.27). Five constructs of frailty were evaluated, but none increased or decreased the risk of adverse outcome. Three instruments were evaluated in the meta-analysis: Identification of Seniors at Risk, Triage Risk Screening Tool, and Variables Indicative of Placement Risk. None of these instruments significantly increased (LR+ range for various outcomes = 0.98 to 1.40) or decreased (LR- range = 0.53 to 1.11) the risk of adverse outcomes. The test threshold for 3-month functional decline based on the most accurate instrument was 42%, and the treatment threshold was 61%. Conclusions Risk stratification of geriatric adults following ED care is limited by the lack of pragmatic, accurate, and reliable instruments. Although absence of dependency reduces the risk of 1-year mortality, no individual risk factor, frailty construct, or risk assessment instrument accurately predicts risk of adverse outcomes in older ED patients. Existing instruments designed to risk stratify older ED patients do not accurately distinguish high- or low-risk subsets. Clinicians, educators, and policy-makers should not use these instruments as valid predictors of post-ED adverse outcomes. Future research to derive and validate feasible ED instruments to distinguish vulnerable elders should employ published decision instrument methods and examine the contributions of alternative variables, such as health literacy and dementia, which often remain clinically occult.

UR - http://www.scopus.com/inward/record.url?scp=84920782217&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84920782217&partnerID=8YFLogxK

U2 - 10.1111/acem.12569

DO - 10.1111/acem.12569

M3 - Article

C2 - 25565487

AN - SCOPUS:84920782217

VL - 22

SP - 1

EP - 21

JO - Academic Emergency Medicine

JF - Academic Emergency Medicine

SN - 1069-6563

IS - 1

ER -