Is this the wave of the future? Examining the psychometric properties of child behavior ratings administered online

A. E. Pritchard, C. M. Stephan, T. A. Zabel, L. A. Jacobson

Research output: Contribution to journalArticle

Abstract

Online data collection is increasingly utilized in the field of psychology. While there is a growing literature regarding the advantages of computer-based data collection, little is known regarding the psychometric comparability of measures across computer-based and traditional paper-and-pencil administration methods. This is especially true with regard to caregiver-report ratings of children's behavioral, academic, and emotional functioning. In this between-subjects study, the psychometric properties of caregiver behavioral, academic, and emotional functioning ratings for youth between the ages of 5 and 18 representing a mixed clinical sample were compared across computer-based (online group; n = 3831) and paper-and-pencil (P&P group; n = 514) administration formats. Groups differed on sex, age, and rater education distributions. Controlling for these variables, no statistically significant differences between groups were found in terms of symptomatology. In terms of psychometric characteristics, no group differences were found on inter-item reliability for any measure, and inter-item reliability for all scales across groups fell within the acceptable range. Similarly, comparisons of factor loadings across groups indicate marked consistency in the psychometric structure of all measures across administration formats. These results suggest that, regardless of administration method, the psychometric properties of caregiver ratings of childrens’ behavioral, academic, and emotional functioning remain consistent.

Original languageEnglish (US)
Pages (from-to)518-522
Number of pages5
JournalComputers in Human Behavior
Volume70
DOIs
StatePublished - May 1 2017

Fingerprint

Psychometrics
Child Behavior
Rating
Caregivers
Data collection
Personnel rating
Education
Psychology
Group differences
Child behavior
Waves

Keywords

  • Caregiver behavior ratings
  • Child psychology
  • Psychometric equivalence

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Human-Computer Interaction
  • Psychology(all)

Cite this

Is this the wave of the future? Examining the psychometric properties of child behavior ratings administered online. / Pritchard, A. E.; Stephan, C. M.; Zabel, T. A.; Jacobson, L. A.

In: Computers in Human Behavior, Vol. 70, 01.05.2017, p. 518-522.

Research output: Contribution to journalArticle

Pritchard, A. E.; Stephan, C. M.; Zabel, T. A.; Jacobson, L. A. / Is this the wave of the future? Examining the psychometric properties of child behavior ratings administered online.

In: Computers in Human Behavior, Vol. 70, 01.05.2017, p. 518-522.

Research output: Contribution to journalArticle

@article{13ecefe173a748878a10354a52823b3b,
title = "Is this the wave of the future? Examining the psychometric properties of child behavior ratings administered online",
abstract = "Online data collection is increasingly utilized in the field of psychology. While there is a growing literature regarding the advantages of computer-based data collection, little is known regarding the psychometric comparability of measures across computer-based and traditional paper-and-pencil administration methods. This is especially true with regard to caregiver-report ratings of children's behavioral, academic, and emotional functioning. In this between-subjects study, the psychometric properties of caregiver behavioral, academic, and emotional functioning ratings for youth between the ages of 5 and 18 representing a mixed clinical sample were compared across computer-based (online group; n = 3831) and paper-and-pencil (P&P group; n = 514) administration formats. Groups differed on sex, age, and rater education distributions. Controlling for these variables, no statistically significant differences between groups were found in terms of symptomatology. In terms of psychometric characteristics, no group differences were found on inter-item reliability for any measure, and inter-item reliability for all scales across groups fell within the acceptable range. Similarly, comparisons of factor loadings across groups indicate marked consistency in the psychometric structure of all measures across administration formats. These results suggest that, regardless of administration method, the psychometric properties of caregiver ratings of childrens’ behavioral, academic, and emotional functioning remain consistent.",
keywords = "Caregiver behavior ratings, Child psychology, Psychometric equivalence",
author = "Pritchard, {A. E.} and Stephan, {C. M.} and Zabel, {T. A.} and Jacobson, {L. A.}",
year = "2017",
month = "5",
doi = "10.1016/j.chb.2017.01.030",
volume = "70",
pages = "518--522",
journal = "Computers in Human Behavior",
issn = "0747-5632",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Is this the wave of the future? Examining the psychometric properties of child behavior ratings administered online

AU - Pritchard,A. E.

AU - Stephan,C. M.

AU - Zabel,T. A.

AU - Jacobson,L. A.

PY - 2017/5/1

Y1 - 2017/5/1

N2 - Online data collection is increasingly utilized in the field of psychology. While there is a growing literature regarding the advantages of computer-based data collection, little is known regarding the psychometric comparability of measures across computer-based and traditional paper-and-pencil administration methods. This is especially true with regard to caregiver-report ratings of children's behavioral, academic, and emotional functioning. In this between-subjects study, the psychometric properties of caregiver behavioral, academic, and emotional functioning ratings for youth between the ages of 5 and 18 representing a mixed clinical sample were compared across computer-based (online group; n = 3831) and paper-and-pencil (P&P group; n = 514) administration formats. Groups differed on sex, age, and rater education distributions. Controlling for these variables, no statistically significant differences between groups were found in terms of symptomatology. In terms of psychometric characteristics, no group differences were found on inter-item reliability for any measure, and inter-item reliability for all scales across groups fell within the acceptable range. Similarly, comparisons of factor loadings across groups indicate marked consistency in the psychometric structure of all measures across administration formats. These results suggest that, regardless of administration method, the psychometric properties of caregiver ratings of childrens’ behavioral, academic, and emotional functioning remain consistent.

AB - Online data collection is increasingly utilized in the field of psychology. While there is a growing literature regarding the advantages of computer-based data collection, little is known regarding the psychometric comparability of measures across computer-based and traditional paper-and-pencil administration methods. This is especially true with regard to caregiver-report ratings of children's behavioral, academic, and emotional functioning. In this between-subjects study, the psychometric properties of caregiver behavioral, academic, and emotional functioning ratings for youth between the ages of 5 and 18 representing a mixed clinical sample were compared across computer-based (online group; n = 3831) and paper-and-pencil (P&P group; n = 514) administration formats. Groups differed on sex, age, and rater education distributions. Controlling for these variables, no statistically significant differences between groups were found in terms of symptomatology. In terms of psychometric characteristics, no group differences were found on inter-item reliability for any measure, and inter-item reliability for all scales across groups fell within the acceptable range. Similarly, comparisons of factor loadings across groups indicate marked consistency in the psychometric structure of all measures across administration formats. These results suggest that, regardless of administration method, the psychometric properties of caregiver ratings of childrens’ behavioral, academic, and emotional functioning remain consistent.

KW - Caregiver behavior ratings

KW - Child psychology

KW - Psychometric equivalence

UR - http://www.scopus.com/inward/record.url?scp=85010399585&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85010399585&partnerID=8YFLogxK

U2 - 10.1016/j.chb.2017.01.030

DO - 10.1016/j.chb.2017.01.030

M3 - Article

VL - 70

SP - 518

EP - 522

JO - Computers in Human Behavior

T2 - Computers in Human Behavior

JF - Computers in Human Behavior

SN - 0747-5632

ER -