Interrater and test-retest reliability of a fixed condition Design Fluency Test

Lisle R. Kingery, David Schretlen, Sara Sateri, Linda K. Langley, Nicole C. Marano, Stephen M. Meyer

Research output: Contribution to journalArticle

Abstract

Despite its potential as a unique neuropsychological test, the emergence of a psychometrically sound research foundation for Jones-Gotman and Milner's (1977) Design Fluency Test (DFT) has been constrained by the lack of consistent administration and scoring practices and limited information about its reliability. Here we describe an approach to administering and scoring the fixed condition DFT that is modeled on Jones-Gotman and Milner's original method and that clarifies procedural ambiguities. Results include interrater and long-term test-retest reliability analyses using this approach. First, based on five raters who scored 50 DFT protocols, good to excellent intra-class correlation coefficients were obtained for all DFT scores. Second, in a broadly representative sample of 87 healthy adults who were tested twice over an average of 5 1/2 years, the test-retest reliabilities for total and novel design scores ranged from good to excellent. This study demonstrates that the fixed condition DFT can be scored reliably using these procedures and that the reliability coefficients for DFT total and novel designs scores are comparable to those of other commonly used neuropsychological tests.

Original languageEnglish (US)
Pages (from-to)729-740
Number of pages12
JournalClinical Neuropsychologist
Volume20
Issue number4
DOIs
StatePublished - Dec 1 2006

Fingerprint

Neuropsychological Tests
Reproducibility of Results
Research
Test-retest Reliability
Fluency

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

Interrater and test-retest reliability of a fixed condition Design Fluency Test. / Kingery, Lisle R.; Schretlen, David; Sateri, Sara; Langley, Linda K.; Marano, Nicole C.; Meyer, Stephen M.

In: Clinical Neuropsychologist, Vol. 20, No. 4, 01.12.2006, p. 729-740.

Research output: Contribution to journalArticle

Kingery, Lisle R. ; Schretlen, David ; Sateri, Sara ; Langley, Linda K. ; Marano, Nicole C. ; Meyer, Stephen M. / Interrater and test-retest reliability of a fixed condition Design Fluency Test. In: Clinical Neuropsychologist. 2006 ; Vol. 20, No. 4. pp. 729-740.
@article{27ca39d9d16b4d848ab131440c838a9c,
title = "Interrater and test-retest reliability of a fixed condition Design Fluency Test",
abstract = "Despite its potential as a unique neuropsychological test, the emergence of a psychometrically sound research foundation for Jones-Gotman and Milner's (1977) Design Fluency Test (DFT) has been constrained by the lack of consistent administration and scoring practices and limited information about its reliability. Here we describe an approach to administering and scoring the fixed condition DFT that is modeled on Jones-Gotman and Milner's original method and that clarifies procedural ambiguities. Results include interrater and long-term test-retest reliability analyses using this approach. First, based on five raters who scored 50 DFT protocols, good to excellent intra-class correlation coefficients were obtained for all DFT scores. Second, in a broadly representative sample of 87 healthy adults who were tested twice over an average of 5 1/2 years, the test-retest reliabilities for total and novel design scores ranged from good to excellent. This study demonstrates that the fixed condition DFT can be scored reliably using these procedures and that the reliability coefficients for DFT total and novel designs scores are comparable to those of other commonly used neuropsychological tests.",
author = "Kingery, {Lisle R.} and David Schretlen and Sara Sateri and Langley, {Linda K.} and Marano, {Nicole C.} and Meyer, {Stephen M.}",
year = "2006",
month = "12",
day = "1",
doi = "10.1080/13854040500350992",
language = "English (US)",
volume = "20",
pages = "729--740",
journal = "Clinical Neuropsychologist",
issn = "1385-4046",
publisher = "Swets & Zeitlinger",
number = "4",

}

TY - JOUR

T1 - Interrater and test-retest reliability of a fixed condition Design Fluency Test

AU - Kingery, Lisle R.

AU - Schretlen, David

AU - Sateri, Sara

AU - Langley, Linda K.

AU - Marano, Nicole C.

AU - Meyer, Stephen M.

PY - 2006/12/1

Y1 - 2006/12/1

N2 - Despite its potential as a unique neuropsychological test, the emergence of a psychometrically sound research foundation for Jones-Gotman and Milner's (1977) Design Fluency Test (DFT) has been constrained by the lack of consistent administration and scoring practices and limited information about its reliability. Here we describe an approach to administering and scoring the fixed condition DFT that is modeled on Jones-Gotman and Milner's original method and that clarifies procedural ambiguities. Results include interrater and long-term test-retest reliability analyses using this approach. First, based on five raters who scored 50 DFT protocols, good to excellent intra-class correlation coefficients were obtained for all DFT scores. Second, in a broadly representative sample of 87 healthy adults who were tested twice over an average of 5 1/2 years, the test-retest reliabilities for total and novel design scores ranged from good to excellent. This study demonstrates that the fixed condition DFT can be scored reliably using these procedures and that the reliability coefficients for DFT total and novel designs scores are comparable to those of other commonly used neuropsychological tests.

AB - Despite its potential as a unique neuropsychological test, the emergence of a psychometrically sound research foundation for Jones-Gotman and Milner's (1977) Design Fluency Test (DFT) has been constrained by the lack of consistent administration and scoring practices and limited information about its reliability. Here we describe an approach to administering and scoring the fixed condition DFT that is modeled on Jones-Gotman and Milner's original method and that clarifies procedural ambiguities. Results include interrater and long-term test-retest reliability analyses using this approach. First, based on five raters who scored 50 DFT protocols, good to excellent intra-class correlation coefficients were obtained for all DFT scores. Second, in a broadly representative sample of 87 healthy adults who were tested twice over an average of 5 1/2 years, the test-retest reliabilities for total and novel design scores ranged from good to excellent. This study demonstrates that the fixed condition DFT can be scored reliably using these procedures and that the reliability coefficients for DFT total and novel designs scores are comparable to those of other commonly used neuropsychological tests.

UR - http://www.scopus.com/inward/record.url?scp=33748795551&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33748795551&partnerID=8YFLogxK

U2 - 10.1080/13854040500350992

DO - 10.1080/13854040500350992

M3 - Article

C2 - 16980258

AN - SCOPUS:33748795551

VL - 20

SP - 729

EP - 740

JO - Clinical Neuropsychologist

JF - Clinical Neuropsychologist

SN - 1385-4046

IS - 4

ER -