Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases

Roy W. Beck, Maureen G. Maguire, Neil M Bressler, Adam R. Glassman, Anne S. Lindblad, Frederick L. Ferris

Research output: Contribution to journalArticle

Abstract

Purpose: Visual acuity (VA) is the primary outcome measure in many studies involving eye diseases. A standard statistical approach for comparing a continuous measurement such as a VA letter score between 2 treatment groups is to perform a t test comparing the means. However, frequently a binary variable is created from the continuous VA letter score based on whether or not there has been a worsening (or gain) of ≥15 letters (equivalent to ≥3 lines), and a chi square or similar statistical test is performed to compare the proportions of success (or failure) between groups. The purpose of this article is to contrast these 2 approaches. Methods: Clinical trial reports of retinal disorders were used to compare results using mean change in the VA letter score versus binary proportions created from the VA letter score. Additionally, analyses were performed using generated data to gain a perspective on the magnitude of differences that might be expected between the 2 methods. Results: Studies from the literature showed that differences of 6% to 15% in ≥15-letter worsening corresponded to mean differences in letter scores between groups of 3.0 to 7.0 (approximately 0.6 to 1.4 lines). Analyses using generated data demonstrated that a mean improvement in the VA letter score of 5 corresponded to a doubling of the proportion of eyes with ≥15-letter improvement and a 28% relative reduction in the proportion of eyes with ≥15-letter worsening. Conclusions: How VA data should be analyzed in a clinical trial depends to large extent on the research question. The frequently used outcome of ≥15-letter change has several drawbacks, including loss of efficiency (need for a larger sample), misclassification of the outcome, and potential for a ceiling or floor effect. Therefore, for most clinical trials we believe that the primary outcome analysis should be a comparison of changes in the VA letter score, and created binary variables should be reported as secondary outcomes. This approach maximizes the information gained from the data and accommodates both improvement and worsening of acuity.

Original languageEnglish (US)
Pages (from-to)1804-1809
Number of pages6
JournalOphthalmology
Volume114
Issue number10
DOIs
StatePublished - Oct 2007

Fingerprint

Retinal Diseases
Visual Acuity
Outcome Assessment (Health Care)
Clinical Trials
Eye Diseases

ASJC Scopus subject areas

  • Ophthalmology

Cite this

Beck, R. W., Maguire, M. G., Bressler, N. M., Glassman, A. R., Lindblad, A. S., & Ferris, F. L. (2007). Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases. Ophthalmology, 114(10), 1804-1809. https://doi.org/10.1016/j.ophtha.2007.06.047

Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases. / Beck, Roy W.; Maguire, Maureen G.; Bressler, Neil M; Glassman, Adam R.; Lindblad, Anne S.; Ferris, Frederick L.

In: Ophthalmology, Vol. 114, No. 10, 10.2007, p. 1804-1809.

Research output: Contribution to journalArticle

Beck, RW, Maguire, MG, Bressler, NM, Glassman, AR, Lindblad, AS & Ferris, FL 2007, 'Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases', Ophthalmology, vol. 114, no. 10, pp. 1804-1809. https://doi.org/10.1016/j.ophtha.2007.06.047
Beck, Roy W. ; Maguire, Maureen G. ; Bressler, Neil M ; Glassman, Adam R. ; Lindblad, Anne S. ; Ferris, Frederick L. / Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases. In: Ophthalmology. 2007 ; Vol. 114, No. 10. pp. 1804-1809.
@article{dd0178724cb745bb88b147fef14b442b,
title = "Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases",
abstract = "Purpose: Visual acuity (VA) is the primary outcome measure in many studies involving eye diseases. A standard statistical approach for comparing a continuous measurement such as a VA letter score between 2 treatment groups is to perform a t test comparing the means. However, frequently a binary variable is created from the continuous VA letter score based on whether or not there has been a worsening (or gain) of ≥15 letters (equivalent to ≥3 lines), and a chi square or similar statistical test is performed to compare the proportions of success (or failure) between groups. The purpose of this article is to contrast these 2 approaches. Methods: Clinical trial reports of retinal disorders were used to compare results using mean change in the VA letter score versus binary proportions created from the VA letter score. Additionally, analyses were performed using generated data to gain a perspective on the magnitude of differences that might be expected between the 2 methods. Results: Studies from the literature showed that differences of 6{\%} to 15{\%} in ≥15-letter worsening corresponded to mean differences in letter scores between groups of 3.0 to 7.0 (approximately 0.6 to 1.4 lines). Analyses using generated data demonstrated that a mean improvement in the VA letter score of 5 corresponded to a doubling of the proportion of eyes with ≥15-letter improvement and a 28{\%} relative reduction in the proportion of eyes with ≥15-letter worsening. Conclusions: How VA data should be analyzed in a clinical trial depends to large extent on the research question. The frequently used outcome of ≥15-letter change has several drawbacks, including loss of efficiency (need for a larger sample), misclassification of the outcome, and potential for a ceiling or floor effect. Therefore, for most clinical trials we believe that the primary outcome analysis should be a comparison of changes in the VA letter score, and created binary variables should be reported as secondary outcomes. This approach maximizes the information gained from the data and accommodates both improvement and worsening of acuity.",
author = "Beck, {Roy W.} and Maguire, {Maureen G.} and Bressler, {Neil M} and Glassman, {Adam R.} and Lindblad, {Anne S.} and Ferris, {Frederick L.}",
year = "2007",
month = "10",
doi = "10.1016/j.ophtha.2007.06.047",
language = "English (US)",
volume = "114",
pages = "1804--1809",
journal = "Ophthalmology",
issn = "0161-6420",
publisher = "Elsevier Inc.",
number = "10",

}

TY - JOUR

T1 - Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases

AU - Beck, Roy W.

AU - Maguire, Maureen G.

AU - Bressler, Neil M

AU - Glassman, Adam R.

AU - Lindblad, Anne S.

AU - Ferris, Frederick L.

PY - 2007/10

Y1 - 2007/10

N2 - Purpose: Visual acuity (VA) is the primary outcome measure in many studies involving eye diseases. A standard statistical approach for comparing a continuous measurement such as a VA letter score between 2 treatment groups is to perform a t test comparing the means. However, frequently a binary variable is created from the continuous VA letter score based on whether or not there has been a worsening (or gain) of ≥15 letters (equivalent to ≥3 lines), and a chi square or similar statistical test is performed to compare the proportions of success (or failure) between groups. The purpose of this article is to contrast these 2 approaches. Methods: Clinical trial reports of retinal disorders were used to compare results using mean change in the VA letter score versus binary proportions created from the VA letter score. Additionally, analyses were performed using generated data to gain a perspective on the magnitude of differences that might be expected between the 2 methods. Results: Studies from the literature showed that differences of 6% to 15% in ≥15-letter worsening corresponded to mean differences in letter scores between groups of 3.0 to 7.0 (approximately 0.6 to 1.4 lines). Analyses using generated data demonstrated that a mean improvement in the VA letter score of 5 corresponded to a doubling of the proportion of eyes with ≥15-letter improvement and a 28% relative reduction in the proportion of eyes with ≥15-letter worsening. Conclusions: How VA data should be analyzed in a clinical trial depends to large extent on the research question. The frequently used outcome of ≥15-letter change has several drawbacks, including loss of efficiency (need for a larger sample), misclassification of the outcome, and potential for a ceiling or floor effect. Therefore, for most clinical trials we believe that the primary outcome analysis should be a comparison of changes in the VA letter score, and created binary variables should be reported as secondary outcomes. This approach maximizes the information gained from the data and accommodates both improvement and worsening of acuity.

AB - Purpose: Visual acuity (VA) is the primary outcome measure in many studies involving eye diseases. A standard statistical approach for comparing a continuous measurement such as a VA letter score between 2 treatment groups is to perform a t test comparing the means. However, frequently a binary variable is created from the continuous VA letter score based on whether or not there has been a worsening (or gain) of ≥15 letters (equivalent to ≥3 lines), and a chi square or similar statistical test is performed to compare the proportions of success (or failure) between groups. The purpose of this article is to contrast these 2 approaches. Methods: Clinical trial reports of retinal disorders were used to compare results using mean change in the VA letter score versus binary proportions created from the VA letter score. Additionally, analyses were performed using generated data to gain a perspective on the magnitude of differences that might be expected between the 2 methods. Results: Studies from the literature showed that differences of 6% to 15% in ≥15-letter worsening corresponded to mean differences in letter scores between groups of 3.0 to 7.0 (approximately 0.6 to 1.4 lines). Analyses using generated data demonstrated that a mean improvement in the VA letter score of 5 corresponded to a doubling of the proportion of eyes with ≥15-letter improvement and a 28% relative reduction in the proportion of eyes with ≥15-letter worsening. Conclusions: How VA data should be analyzed in a clinical trial depends to large extent on the research question. The frequently used outcome of ≥15-letter change has several drawbacks, including loss of efficiency (need for a larger sample), misclassification of the outcome, and potential for a ceiling or floor effect. Therefore, for most clinical trials we believe that the primary outcome analysis should be a comparison of changes in the VA letter score, and created binary variables should be reported as secondary outcomes. This approach maximizes the information gained from the data and accommodates both improvement and worsening of acuity.

UR - http://www.scopus.com/inward/record.url?scp=34748872167&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34748872167&partnerID=8YFLogxK

U2 - 10.1016/j.ophtha.2007.06.047

DO - 10.1016/j.ophtha.2007.06.047

M3 - Article

C2 - 17908590

AN - SCOPUS:34748872167

VL - 114

SP - 1804

EP - 1809

JO - Ophthalmology

JF - Ophthalmology

SN - 0161-6420

IS - 10

ER -