Internal consistency reliability is a poor predictor of responsiveness

Milo A. Puhan, Dianne Bryant, Gordon H. Guyatt, Diane Heels-Ansdell, Holger J. Schünemann

Research output: Contribution to journalArticle

Abstract

Background: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. Methods: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). Results: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95% Cl -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between

Original languageEnglish (US)
Article number33
JournalHealth and Quality of Life Outcomes
Volume3
DOIs
StatePublished - May 9 2005
Externally publishedYes

Fingerprint

Quality of Life
Knee Injuries
Lung Injury
Reproducibility of Results
Chronic Obstructive Pulmonary Disease
Longitudinal Studies
Linear Models
Research Personnel
Surveys and Questionnaires

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Puhan, M. A., Bryant, D., Guyatt, G. H., Heels-Ansdell, D., & Schünemann, H. J. (2005). Internal consistency reliability is a poor predictor of responsiveness. Health and Quality of Life Outcomes, 3, [33]. https://doi.org/10.1186/1477-7525-3-33

Internal consistency reliability is a poor predictor of responsiveness. / Puhan, Milo A.; Bryant, Dianne; Guyatt, Gordon H.; Heels-Ansdell, Diane; Schünemann, Holger J.

In: Health and Quality of Life Outcomes, Vol. 3, 33, 09.05.2005.

Research output: Contribution to journalArticle

Puhan, Milo A. ; Bryant, Dianne ; Guyatt, Gordon H. ; Heels-Ansdell, Diane ; Schünemann, Holger J. / Internal consistency reliability is a poor predictor of responsiveness. In: Health and Quality of Life Outcomes. 2005 ; Vol. 3.
@article{8f5636910c744164aca67ae508bb0236,
title = "Internal consistency reliability is a poor predictor of responsiveness",
abstract = "Background: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. Methods: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). Results: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95{\%} Cl -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between",
author = "Puhan, {Milo A.} and Dianne Bryant and Guyatt, {Gordon H.} and Diane Heels-Ansdell and Sch{\"u}nemann, {Holger J.}",
year = "2005",
month = "5",
day = "9",
doi = "10.1186/1477-7525-3-33",
language = "English (US)",
volume = "3",
journal = "Health and Quality of Life Outcomes",
issn = "1477-7525",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Internal consistency reliability is a poor predictor of responsiveness

AU - Puhan, Milo A.

AU - Bryant, Dianne

AU - Guyatt, Gordon H.

AU - Heels-Ansdell, Diane

AU - Schünemann, Holger J.

PY - 2005/5/9

Y1 - 2005/5/9

N2 - Background: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. Methods: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). Results: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95% Cl -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between

AB - Background: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. Methods: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). Results: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95% Cl -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between

UR - http://www.scopus.com/inward/record.url?scp=27344435435&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27344435435&partnerID=8YFLogxK

U2 - 10.1186/1477-7525-3-33

DO - 10.1186/1477-7525-3-33

M3 - Article

C2 - 15877824

AN - SCOPUS:27344435435

VL - 3

JO - Health and Quality of Life Outcomes

JF - Health and Quality of Life Outcomes

SN - 1477-7525

M1 - 33

ER -