Inter-grader Agreement of the Ocular Staining Score in the Sjögren's International Clinical Collaborative Alliance (SICCA) Registry

Purpose To determine the intra-observer and inter-observer reliability of a novel ocular staining score among trained ophthalmologists. Design Reliability analysis within a prospective, observational, multicenter cohort study. Methods Those enrolled in the National Institutes of Health-funded Sjögren's International Collaborative Clinical Alliance (SICCA) who presented for follow-up at the University of California San Francisco, Aravind Eye Hospital, Johns Hopkins University, and the University of Pennsylvania were included. Study participants were graded using the ocular staining score by at least 2 masked SICCA-trained ophthalmologists. The primary outcome for this study was the intraclass correlation coefficient (ICC) for the total ocular staining score. ICCs were also calculated for tear break-up time (TBUT) and conjunctival and corneal staining. Results Total ocular staining score had an ICC of 0.91 for the right eye (95% confidence interval [CI] 0.85-0.96) and 0.90 for the left eye (95% CI 0.83-0.97). Corneal staining (right eye 0.86, 95% CI 0.76-0.93, left eye 0.90, 95% CI 0.81-0.95) and conjunctival staining (right eye 0.87, 95% CI 0.80-0.93, left eye 0.85, 95% CI 0.75-0.93) demonstrated excellent agreement. The ICC for TBUT was slightly lower (right eye 0.77, 95% CI 0.64-0.89; left eye 0.81, 95% CI 0.68-0.90). Conclusions Previous studies have shown that the ocular staining score is correlated with other diagnostic components of Sjögren syndrome. In this study, we demonstrate high reliability in grading among trained ophthalmologists, completing the validation of this test.