Monte Carlo assessments of goodness-of-fit for ecological simulation models

Lance A. Waller, David Smith, James E. Childs, Leslie A. Real

Research output: Contribution to journalArticlepeer-review

Abstract

One often develops stochastic ecologic simulation models based on local interactions between individuals or groups and bases systemic conclusions on trends summarized over multiple data sets generated from the model. In many cases, such models generate data sets ("realizations") each violating the usual assumptions associated with traditional statistical tests of goodness-of-fit, most notably that of independent observations. Monte Carlo hypothesis tests applied to multiple realizations from such models provide appropriate goodness-of-fit tests regardless of within-model peculiarities. The Monte Carlo tests address the question "Do the observed data appear consistent with the model?" in contrast to the usual question "Does the model appear consistent with the observed data?". In addition, such tests can make use of the same data sets used to draw systemic inference (i.e. the tests require no additional simulation runs). We illustrate the concept using Pearson's chi-square statistic with correlated data. We also consider the behavior of a similar statistic and of "modeling efficiency" in assessing the fit of a simulation model for the spatial spread of raccoon rabies in Connecticut.

Original languageEnglish (US)
Pages (from-to)49-63
Number of pages15
JournalEcological Modelling
Volume164
Issue number1
DOIs
StatePublished - Jun 1 2003
Externally publishedYes

Keywords

  • Goodness-of-fit
  • Model assessment
  • Model validation
  • Modeling efficiency
  • Simulation

ASJC Scopus subject areas

  • Ecological Modeling

Fingerprint

Dive into the research topics of 'Monte Carlo assessments of goodness-of-fit for ecological simulation models'. Together they form a unique fingerprint.

Cite this