A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs: Studies with rhesus monkeys and computer simulations

Paul L. Soto, Jesse Dallery, Nancy A Ator, Brian R. Katz

Research output: Contribution to journalArticle

Abstract

Rationale: Best dose analysis involves identifying the dose associated with the greatest improvement in performance for each subject and comparing performances associated with these individually determined best doses to control performances. Objectives: The current experiments were conducted to examine whether significant best dose effects might result from the selective analysis of data rather than an actual drug effect. Methods: Experiment 1 examined the effects of nicotine and methylphenidate on delayed matching-to-sample (DMTS) and self-ordered spatial search (SOSS) performances in rhesus monkeys (DMTS: n = 7; SOSS: n = 6) to determine the validity and reliability of best dose effects. Experiment 2 used Monte Carlo computer simulations to estimate the likelihood of obtaining a significant outcome when the best dose method was applied to randomly generated data sets for which no difference existed. Results: Significant effects were obtained when the best dose analysis was applied to performances from nondrug sessions, and best dose performances were not significantly different from the best nondrug performances. The doses identified as best doses from two nicotine dose-response curve determinations were unrelated, and the improvement associated with the best dose observed during the first dose-response curve determination was not reliable when the dose was administered repeatedly. Finally, there was a high likelihood of obtaining a statistically significant difference when no real difference existed. Conclusions: Best dose analysis for the identification of potential therapeutic agents should be replaced by single-subject designs.

Original languageEnglish (US)
Pages (from-to)611-622
Number of pages12
JournalPsychopharmacology
Volume228
Issue number4
DOIs
StatePublished - Aug 2013

Fingerprint

Macaca mulatta
Nicotine
Computer Simulation
Methylphenidate
Reproducibility of Results
Pharmaceutical Preparations
Therapeutics
Datasets

Keywords

  • Best dose analysis
  • CANTAB
  • Cognitive enhancer
  • Delayed matching-to-sample
  • Methylphenidate
  • Nicotine
  • Rhesus monkey
  • Self-ordered spatial search
  • Working memory

ASJC Scopus subject areas

  • Pharmacology

Cite this

A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs : Studies with rhesus monkeys and computer simulations. / Soto, Paul L.; Dallery, Jesse; Ator, Nancy A; Katz, Brian R.

In: Psychopharmacology, Vol. 228, No. 4, 08.2013, p. 611-622.

Research output: Contribution to journalArticle

@article{57416a5ed80248108c26765e905553f7,
title = "A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs: Studies with rhesus monkeys and computer simulations",
abstract = "Rationale: Best dose analysis involves identifying the dose associated with the greatest improvement in performance for each subject and comparing performances associated with these individually determined best doses to control performances. Objectives: The current experiments were conducted to examine whether significant best dose effects might result from the selective analysis of data rather than an actual drug effect. Methods: Experiment 1 examined the effects of nicotine and methylphenidate on delayed matching-to-sample (DMTS) and self-ordered spatial search (SOSS) performances in rhesus monkeys (DMTS: n = 7; SOSS: n = 6) to determine the validity and reliability of best dose effects. Experiment 2 used Monte Carlo computer simulations to estimate the likelihood of obtaining a significant outcome when the best dose method was applied to randomly generated data sets for which no difference existed. Results: Significant effects were obtained when the best dose analysis was applied to performances from nondrug sessions, and best dose performances were not significantly different from the best nondrug performances. The doses identified as best doses from two nicotine dose-response curve determinations were unrelated, and the improvement associated with the best dose observed during the first dose-response curve determination was not reliable when the dose was administered repeatedly. Finally, there was a high likelihood of obtaining a statistically significant difference when no real difference existed. Conclusions: Best dose analysis for the identification of potential therapeutic agents should be replaced by single-subject designs.",
keywords = "Best dose analysis, CANTAB, Cognitive enhancer, Delayed matching-to-sample, Methylphenidate, Nicotine, Rhesus monkey, Self-ordered spatial search, Working memory",
author = "Soto, {Paul L.} and Jesse Dallery and Ator, {Nancy A} and Katz, {Brian R.}",
year = "2013",
month = "8",
doi = "10.1007/s00213-013-3070-4",
language = "English (US)",
volume = "228",
pages = "611--622",
journal = "Psychopharmacology",
issn = "0033-3158",
publisher = "Springer Verlag",
number = "4",

}

TY - JOUR

T1 - A critical examination of best dose analysis for determining cognitive-enhancing potential of drugs

T2 - Studies with rhesus monkeys and computer simulations

AU - Soto, Paul L.

AU - Dallery, Jesse

AU - Ator, Nancy A

AU - Katz, Brian R.

PY - 2013/8

Y1 - 2013/8

N2 - Rationale: Best dose analysis involves identifying the dose associated with the greatest improvement in performance for each subject and comparing performances associated with these individually determined best doses to control performances. Objectives: The current experiments were conducted to examine whether significant best dose effects might result from the selective analysis of data rather than an actual drug effect. Methods: Experiment 1 examined the effects of nicotine and methylphenidate on delayed matching-to-sample (DMTS) and self-ordered spatial search (SOSS) performances in rhesus monkeys (DMTS: n = 7; SOSS: n = 6) to determine the validity and reliability of best dose effects. Experiment 2 used Monte Carlo computer simulations to estimate the likelihood of obtaining a significant outcome when the best dose method was applied to randomly generated data sets for which no difference existed. Results: Significant effects were obtained when the best dose analysis was applied to performances from nondrug sessions, and best dose performances were not significantly different from the best nondrug performances. The doses identified as best doses from two nicotine dose-response curve determinations were unrelated, and the improvement associated with the best dose observed during the first dose-response curve determination was not reliable when the dose was administered repeatedly. Finally, there was a high likelihood of obtaining a statistically significant difference when no real difference existed. Conclusions: Best dose analysis for the identification of potential therapeutic agents should be replaced by single-subject designs.

AB - Rationale: Best dose analysis involves identifying the dose associated with the greatest improvement in performance for each subject and comparing performances associated with these individually determined best doses to control performances. Objectives: The current experiments were conducted to examine whether significant best dose effects might result from the selective analysis of data rather than an actual drug effect. Methods: Experiment 1 examined the effects of nicotine and methylphenidate on delayed matching-to-sample (DMTS) and self-ordered spatial search (SOSS) performances in rhesus monkeys (DMTS: n = 7; SOSS: n = 6) to determine the validity and reliability of best dose effects. Experiment 2 used Monte Carlo computer simulations to estimate the likelihood of obtaining a significant outcome when the best dose method was applied to randomly generated data sets for which no difference existed. Results: Significant effects were obtained when the best dose analysis was applied to performances from nondrug sessions, and best dose performances were not significantly different from the best nondrug performances. The doses identified as best doses from two nicotine dose-response curve determinations were unrelated, and the improvement associated with the best dose observed during the first dose-response curve determination was not reliable when the dose was administered repeatedly. Finally, there was a high likelihood of obtaining a statistically significant difference when no real difference existed. Conclusions: Best dose analysis for the identification of potential therapeutic agents should be replaced by single-subject designs.

KW - Best dose analysis

KW - CANTAB

KW - Cognitive enhancer

KW - Delayed matching-to-sample

KW - Methylphenidate

KW - Nicotine

KW - Rhesus monkey

KW - Self-ordered spatial search

KW - Working memory

UR - http://www.scopus.com/inward/record.url?scp=84881238762&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881238762&partnerID=8YFLogxK

U2 - 10.1007/s00213-013-3070-4

DO - 10.1007/s00213-013-3070-4

M3 - Article

C2 - 23529381

AN - SCOPUS:84881238762

VL - 228

SP - 611

EP - 622

JO - Psychopharmacology

JF - Psychopharmacology

SN - 0033-3158

IS - 4

ER -