Effects of computer versus paper administration of an adult functional writing assessment

Jing Chen, Sheida White, Michael McCloskey, Jaleh Soroui, Young Chun

Research output: Contribution to journalArticlepeer-review

Abstract

This study investigated the comparability of paper and computer versions of a functional writing assessment administered to adults 16 and older. Three writing tasks were administered in both paper and computer modes to volunteers in the field test of an assessment of adult literacy in 2008. One set of analyses examined mode effects on scoring by comparing scores for adults' original handwritten responses to scores for their transcribed word-processed versions. Differences in overall or individual criterion scores were either statistically or practically nonsignificant. A second analysis examined differences in performance between adults who received paper versus computer versions of the same task. A third analysis examined whether the differences between administration modes were moderated by demographic variables or by computer experience. Results showed that adults performed better overall and on most aspects of the writing tasks when writing on paper than on computer. The effects of administration mode varied by employment status for one task, by race/ethnicity, age and word-processor experience for another task, and remained the same for all subgroups for the third task. These results suggest that, depending upon the writing tasks, a computer mode of administration may disadvantage some subgroups (e.g., unemployed) more than others (e.g., employed).

Original languageEnglish (US)
Pages (from-to)49-71
Number of pages23
JournalAssessing Writing
Volume16
Issue number1
DOIs
StatePublished - Jan 1 2011

Keywords

  • Adult writing assessment
  • Computer administration
  • Mode effects
  • Paper administration
  • Scoring bias

ASJC Scopus subject areas

  • Language and Linguistics
  • Education
  • Linguistics and Language

Fingerprint Dive into the research topics of 'Effects of computer versus paper administration of an adult functional writing assessment'. Together they form a unique fingerprint.

Cite this