Psychological assessment instruments

a coverage analysis using SNOMED CT, LOINC and QS terminology.

Piper A. Ranallo, Terrence J. Adam, Katherine J. Nelson, Robert F. Krueger, Martin LaVenture, Christopher Chute

Research output: Contribution to journalArticle

Abstract

Psychometric instruments, inventories, surveys, and questionnaires are widely accepted tools in the field of behavioral health. They are used extensively in primary and clinical research, patient care, quality measurement, and payor oversight. To accurately capture and communicate instrument-related activities and results in electronic systems, existing healthcare standards must be capable of representing the full range of psychometric instruments used in research and clinical care. Several terminologies and controlled vocabularies contain representations of psychological instruments. While a handful of studies have assessed the representational adequacy of terminologies in this domain, no study to date has assessed content coverage. The current study was designed to fill this gap. Using a sample of 63 commonly used instruments, we found no concept in any of the three terminologies evaluated for more than half of all instruments. Of the three terminologies studied, SNOMED CT (Standard Nomenclature of Medicine - Clinical Terms) had the greatest breadth, but least granular coverage of all systems. While SNOMED CT contained concepts for over one third (36%) of the instrument classes in this sample, only 11% of the actual instruments were represented in SNOMED CT. LOINC (Logical Observation Identifiers, Names, and Codes), on the other hand, was able to represent instruments with the greatest level of granularity of the three terminologies. However, LOINC had the poorest coverage, covering fewer than 8% of the instruments in our sample. Given that instruments selected for this study were selected on the basis of their status as gold standard measures for conditions most likely to present in clinical settings, we believe these results overestimate the actual coverage provided by these terminologies. The results of this study demonstrate significant gaps in existing healthcare terminologies vis-à-vis psychological instruments and instrument-related procedures. Based on these findings, we recommend that systematic efforts be made to enhance standard healthcare terminologies to provide better coverage of this domain.

Original languageEnglish (US)
Pages (from-to)1333-1340
Number of pages8
JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
Volume2013
StatePublished - 2013
Externally publishedYes

Fingerprint

Logical Observation Identifiers Names and Codes
Systematized Nomenclature of Medicine
Terminology
Psychology
Delivery of Health Care
Psychometrics
Controlled Vocabulary
Clinical Medicine
Research
Patient Care

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Psychological assessment instruments : a coverage analysis using SNOMED CT, LOINC and QS terminology. / Ranallo, Piper A.; Adam, Terrence J.; Nelson, Katherine J.; Krueger, Robert F.; LaVenture, Martin; Chute, Christopher.

In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, Vol. 2013, 2013, p. 1333-1340.

Research output: Contribution to journalArticle

Ranallo, Piper A. ; Adam, Terrence J. ; Nelson, Katherine J. ; Krueger, Robert F. ; LaVenture, Martin ; Chute, Christopher. / Psychological assessment instruments : a coverage analysis using SNOMED CT, LOINC and QS terminology. In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium. 2013 ; Vol. 2013. pp. 1333-1340.
@article{c0c96bc0c9c64170848351822494a3da,
title = "Psychological assessment instruments: a coverage analysis using SNOMED CT, LOINC and QS terminology.",
abstract = "Psychometric instruments, inventories, surveys, and questionnaires are widely accepted tools in the field of behavioral health. They are used extensively in primary and clinical research, patient care, quality measurement, and payor oversight. To accurately capture and communicate instrument-related activities and results in electronic systems, existing healthcare standards must be capable of representing the full range of psychometric instruments used in research and clinical care. Several terminologies and controlled vocabularies contain representations of psychological instruments. While a handful of studies have assessed the representational adequacy of terminologies in this domain, no study to date has assessed content coverage. The current study was designed to fill this gap. Using a sample of 63 commonly used instruments, we found no concept in any of the three terminologies evaluated for more than half of all instruments. Of the three terminologies studied, SNOMED CT (Standard Nomenclature of Medicine - Clinical Terms) had the greatest breadth, but least granular coverage of all systems. While SNOMED CT contained concepts for over one third (36{\%}) of the instrument classes in this sample, only 11{\%} of the actual instruments were represented in SNOMED CT. LOINC (Logical Observation Identifiers, Names, and Codes), on the other hand, was able to represent instruments with the greatest level of granularity of the three terminologies. However, LOINC had the poorest coverage, covering fewer than 8{\%} of the instruments in our sample. Given that instruments selected for this study were selected on the basis of their status as gold standard measures for conditions most likely to present in clinical settings, we believe these results overestimate the actual coverage provided by these terminologies. The results of this study demonstrate significant gaps in existing healthcare terminologies vis-{\`a}-vis psychological instruments and instrument-related procedures. Based on these findings, we recommend that systematic efforts be made to enhance standard healthcare terminologies to provide better coverage of this domain.",
author = "Ranallo, {Piper A.} and Adam, {Terrence J.} and Nelson, {Katherine J.} and Krueger, {Robert F.} and Martin LaVenture and Christopher Chute",
year = "2013",
language = "English (US)",
volume = "2013",
pages = "1333--1340",
journal = "AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium",
issn = "1559-4076",
publisher = "American Medical Informatics Association",

}

TY - JOUR

T1 - Psychological assessment instruments

T2 - a coverage analysis using SNOMED CT, LOINC and QS terminology.

AU - Ranallo, Piper A.

AU - Adam, Terrence J.

AU - Nelson, Katherine J.

AU - Krueger, Robert F.

AU - LaVenture, Martin

AU - Chute, Christopher

PY - 2013

Y1 - 2013

N2 - Psychometric instruments, inventories, surveys, and questionnaires are widely accepted tools in the field of behavioral health. They are used extensively in primary and clinical research, patient care, quality measurement, and payor oversight. To accurately capture and communicate instrument-related activities and results in electronic systems, existing healthcare standards must be capable of representing the full range of psychometric instruments used in research and clinical care. Several terminologies and controlled vocabularies contain representations of psychological instruments. While a handful of studies have assessed the representational adequacy of terminologies in this domain, no study to date has assessed content coverage. The current study was designed to fill this gap. Using a sample of 63 commonly used instruments, we found no concept in any of the three terminologies evaluated for more than half of all instruments. Of the three terminologies studied, SNOMED CT (Standard Nomenclature of Medicine - Clinical Terms) had the greatest breadth, but least granular coverage of all systems. While SNOMED CT contained concepts for over one third (36%) of the instrument classes in this sample, only 11% of the actual instruments were represented in SNOMED CT. LOINC (Logical Observation Identifiers, Names, and Codes), on the other hand, was able to represent instruments with the greatest level of granularity of the three terminologies. However, LOINC had the poorest coverage, covering fewer than 8% of the instruments in our sample. Given that instruments selected for this study were selected on the basis of their status as gold standard measures for conditions most likely to present in clinical settings, we believe these results overestimate the actual coverage provided by these terminologies. The results of this study demonstrate significant gaps in existing healthcare terminologies vis-à-vis psychological instruments and instrument-related procedures. Based on these findings, we recommend that systematic efforts be made to enhance standard healthcare terminologies to provide better coverage of this domain.

AB - Psychometric instruments, inventories, surveys, and questionnaires are widely accepted tools in the field of behavioral health. They are used extensively in primary and clinical research, patient care, quality measurement, and payor oversight. To accurately capture and communicate instrument-related activities and results in electronic systems, existing healthcare standards must be capable of representing the full range of psychometric instruments used in research and clinical care. Several terminologies and controlled vocabularies contain representations of psychological instruments. While a handful of studies have assessed the representational adequacy of terminologies in this domain, no study to date has assessed content coverage. The current study was designed to fill this gap. Using a sample of 63 commonly used instruments, we found no concept in any of the three terminologies evaluated for more than half of all instruments. Of the three terminologies studied, SNOMED CT (Standard Nomenclature of Medicine - Clinical Terms) had the greatest breadth, but least granular coverage of all systems. While SNOMED CT contained concepts for over one third (36%) of the instrument classes in this sample, only 11% of the actual instruments were represented in SNOMED CT. LOINC (Logical Observation Identifiers, Names, and Codes), on the other hand, was able to represent instruments with the greatest level of granularity of the three terminologies. However, LOINC had the poorest coverage, covering fewer than 8% of the instruments in our sample. Given that instruments selected for this study were selected on the basis of their status as gold standard measures for conditions most likely to present in clinical settings, we believe these results overestimate the actual coverage provided by these terminologies. The results of this study demonstrate significant gaps in existing healthcare terminologies vis-à-vis psychological instruments and instrument-related procedures. Based on these findings, we recommend that systematic efforts be made to enhance standard healthcare terminologies to provide better coverage of this domain.

UR - http://www.scopus.com/inward/record.url?scp=84901262606&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901262606&partnerID=8YFLogxK

M3 - Article

VL - 2013

SP - 1333

EP - 1340

JO - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

JF - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

SN - 1559-4076

ER -