Common scientific and statistical errors in obesity research

Brandon J. George, T. Mark Beasley, Andrew W. Brown, John Dawson, Rositsa Dimova, Jasmin Divers, Tashauna U. Goldsby, Moonseong Heo, Kathryn A. Kaiser, Scott W. Keith, Mimi Y. Kim, Peng Li, Tapan Mehta, J. Michael Oakes, Asheley Skinner, Elizabeth Stuart, David B. Allison

Research output: Contribution to journalArticle

Abstract

This review identifies 10 common errors and problems in the statistical analysis, design, interpretation, and reporting of obesity research and discuss how they can be avoided. The 10 topics are: 1) misinterpretation of statistical significance, 2) inappropriate testing against baseline values, 3) excessive and undisclosed multiple testing and "P-value hacking," 4) mishandling of clustering in cluster randomized trials, 5) misconceptions about nonparametric tests, 6) mishandling of missing data, 7) miscalculation of effect sizes, 8) ignoring regression to the mean, 9) ignoring confirmation bias, and 10) insufficient statistical reporting. It is hoped that discussion of these errors can improve the quality of obesity research by helping researchers to implement proper statistical practice and to know when to seek the help of a statistician.

Original languageEnglish (US)
Pages (from-to)781-790
Number of pages10
JournalObesity
Volume24
Issue number4
DOIs
StatePublished - Apr 1 2016

Fingerprint

Obesity
Research
Cluster Analysis
Research Personnel

ASJC Scopus subject areas

  • Endocrinology
  • Medicine (miscellaneous)
  • Endocrinology, Diabetes and Metabolism
  • Nutrition and Dietetics

Cite this

George, B. J., Beasley, T. M., Brown, A. W., Dawson, J., Dimova, R., Divers, J., ... Allison, D. B. (2016). Common scientific and statistical errors in obesity research. Obesity, 24(4), 781-790. https://doi.org/10.1002/oby.21449

Common scientific and statistical errors in obesity research. / George, Brandon J.; Beasley, T. Mark; Brown, Andrew W.; Dawson, John; Dimova, Rositsa; Divers, Jasmin; Goldsby, Tashauna U.; Heo, Moonseong; Kaiser, Kathryn A.; Keith, Scott W.; Kim, Mimi Y.; Li, Peng; Mehta, Tapan; Oakes, J. Michael; Skinner, Asheley; Stuart, Elizabeth; Allison, David B.

In: Obesity, Vol. 24, No. 4, 01.04.2016, p. 781-790.

Research output: Contribution to journalArticle

George, BJ, Beasley, TM, Brown, AW, Dawson, J, Dimova, R, Divers, J, Goldsby, TU, Heo, M, Kaiser, KA, Keith, SW, Kim, MY, Li, P, Mehta, T, Oakes, JM, Skinner, A, Stuart, E & Allison, DB 2016, 'Common scientific and statistical errors in obesity research', Obesity, vol. 24, no. 4, pp. 781-790. https://doi.org/10.1002/oby.21449
George BJ, Beasley TM, Brown AW, Dawson J, Dimova R, Divers J et al. Common scientific and statistical errors in obesity research. Obesity. 2016 Apr 1;24(4):781-790. https://doi.org/10.1002/oby.21449
George, Brandon J. ; Beasley, T. Mark ; Brown, Andrew W. ; Dawson, John ; Dimova, Rositsa ; Divers, Jasmin ; Goldsby, Tashauna U. ; Heo, Moonseong ; Kaiser, Kathryn A. ; Keith, Scott W. ; Kim, Mimi Y. ; Li, Peng ; Mehta, Tapan ; Oakes, J. Michael ; Skinner, Asheley ; Stuart, Elizabeth ; Allison, David B. / Common scientific and statistical errors in obesity research. In: Obesity. 2016 ; Vol. 24, No. 4. pp. 781-790.
@article{a81ee2c266b74f3aba8ce7382e35d33c,
title = "Common scientific and statistical errors in obesity research",
abstract = "This review identifies 10 common errors and problems in the statistical analysis, design, interpretation, and reporting of obesity research and discuss how they can be avoided. The 10 topics are: 1) misinterpretation of statistical significance, 2) inappropriate testing against baseline values, 3) excessive and undisclosed multiple testing and {"}P-value hacking,{"} 4) mishandling of clustering in cluster randomized trials, 5) misconceptions about nonparametric tests, 6) mishandling of missing data, 7) miscalculation of effect sizes, 8) ignoring regression to the mean, 9) ignoring confirmation bias, and 10) insufficient statistical reporting. It is hoped that discussion of these errors can improve the quality of obesity research by helping researchers to implement proper statistical practice and to know when to seek the help of a statistician.",
author = "George, {Brandon J.} and Beasley, {T. Mark} and Brown, {Andrew W.} and John Dawson and Rositsa Dimova and Jasmin Divers and Goldsby, {Tashauna U.} and Moonseong Heo and Kaiser, {Kathryn A.} and Keith, {Scott W.} and Kim, {Mimi Y.} and Peng Li and Tapan Mehta and Oakes, {J. Michael} and Asheley Skinner and Elizabeth Stuart and Allison, {David B.}",
year = "2016",
month = "4",
day = "1",
doi = "10.1002/oby.21449",
language = "English (US)",
volume = "24",
pages = "781--790",
journal = "Obesity",
issn = "1930-7381",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - Common scientific and statistical errors in obesity research

AU - George, Brandon J.

AU - Beasley, T. Mark

AU - Brown, Andrew W.

AU - Dawson, John

AU - Dimova, Rositsa

AU - Divers, Jasmin

AU - Goldsby, Tashauna U.

AU - Heo, Moonseong

AU - Kaiser, Kathryn A.

AU - Keith, Scott W.

AU - Kim, Mimi Y.

AU - Li, Peng

AU - Mehta, Tapan

AU - Oakes, J. Michael

AU - Skinner, Asheley

AU - Stuart, Elizabeth

AU - Allison, David B.

PY - 2016/4/1

Y1 - 2016/4/1

N2 - This review identifies 10 common errors and problems in the statistical analysis, design, interpretation, and reporting of obesity research and discuss how they can be avoided. The 10 topics are: 1) misinterpretation of statistical significance, 2) inappropriate testing against baseline values, 3) excessive and undisclosed multiple testing and "P-value hacking," 4) mishandling of clustering in cluster randomized trials, 5) misconceptions about nonparametric tests, 6) mishandling of missing data, 7) miscalculation of effect sizes, 8) ignoring regression to the mean, 9) ignoring confirmation bias, and 10) insufficient statistical reporting. It is hoped that discussion of these errors can improve the quality of obesity research by helping researchers to implement proper statistical practice and to know when to seek the help of a statistician.

AB - This review identifies 10 common errors and problems in the statistical analysis, design, interpretation, and reporting of obesity research and discuss how they can be avoided. The 10 topics are: 1) misinterpretation of statistical significance, 2) inappropriate testing against baseline values, 3) excessive and undisclosed multiple testing and "P-value hacking," 4) mishandling of clustering in cluster randomized trials, 5) misconceptions about nonparametric tests, 6) mishandling of missing data, 7) miscalculation of effect sizes, 8) ignoring regression to the mean, 9) ignoring confirmation bias, and 10) insufficient statistical reporting. It is hoped that discussion of these errors can improve the quality of obesity research by helping researchers to implement proper statistical practice and to know when to seek the help of a statistician.

UR - http://www.scopus.com/inward/record.url?scp=84962110833&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962110833&partnerID=8YFLogxK

U2 - 10.1002/oby.21449

DO - 10.1002/oby.21449

M3 - Article

VL - 24

SP - 781

EP - 790

JO - Obesity

JF - Obesity

SN - 1930-7381

IS - 4

ER -