Web-Based Enrollment and Other Types of Self-Selection in Surveys and Studies: Consequences for Generalizability

Niels Keiding, Thomas Louis

Research output: Contribution to journalReview article

Abstract

Web-based enrollment in surveys and studies is increasingly attractive as the Internet is approaching near-universal coverage and the attitude of respondents toward participation in classical modes of study deteriorates. Follow-up is also facilitated by the web-based approach. However, the consequent self-selection raises the question of the importance of representativity when attempting to generalize the results of a study beyond the context in which they were obtained, particularly under effect heterogeneity. Our review is divided into three main components: first, sample surveys or prevalence studies, assessing the frequency or prevalence of some attitude or disease condition in a population from its frequency in a sample from this population; second, generalization of the results from randomized trials to the population in which they were performed and to other populations; and third, generalization of results from observational studies.

Original languageEnglish (US)
Pages (from-to)25-47
Number of pages23
JournalAnnual Review of Statistics and Its Application
Volume5
DOIs
StatePublished - Mar 7 2018

Fingerprint

Web-based
Randomized Trial
Sample Survey
Observational Study
Coverage
Generalise
Self-selection
Enrollment
Generalizability
Generalization

Keywords

  • External validity
  • Internal validity
  • Nonprobability samples
  • Representativity
  • Transportability
  • Unmeasured confounders

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Cite this

@article{589bab7d9b7542f6a79e235bb4a1778a,
title = "Web-Based Enrollment and Other Types of Self-Selection in Surveys and Studies: Consequences for Generalizability",
abstract = "Web-based enrollment in surveys and studies is increasingly attractive as the Internet is approaching near-universal coverage and the attitude of respondents toward participation in classical modes of study deteriorates. Follow-up is also facilitated by the web-based approach. However, the consequent self-selection raises the question of the importance of representativity when attempting to generalize the results of a study beyond the context in which they were obtained, particularly under effect heterogeneity. Our review is divided into three main components: first, sample surveys or prevalence studies, assessing the frequency or prevalence of some attitude or disease condition in a population from its frequency in a sample from this population; second, generalization of the results from randomized trials to the population in which they were performed and to other populations; and third, generalization of results from observational studies.",
keywords = "External validity, Internal validity, Nonprobability samples, Representativity, Transportability, Unmeasured confounders",
author = "Niels Keiding and Thomas Louis",
year = "2018",
month = "3",
day = "7",
doi = "10.1146/annurev-statistics-031017-100127",
language = "English (US)",
volume = "5",
pages = "25--47",
journal = "Annual Review of Statistics and Its Application",
issn = "2326-831X",
publisher = "Annual Reviews Inc.",

}

TY - JOUR

T1 - Web-Based Enrollment and Other Types of Self-Selection in Surveys and Studies

T2 - Consequences for Generalizability

AU - Keiding, Niels

AU - Louis, Thomas

PY - 2018/3/7

Y1 - 2018/3/7

N2 - Web-based enrollment in surveys and studies is increasingly attractive as the Internet is approaching near-universal coverage and the attitude of respondents toward participation in classical modes of study deteriorates. Follow-up is also facilitated by the web-based approach. However, the consequent self-selection raises the question of the importance of representativity when attempting to generalize the results of a study beyond the context in which they were obtained, particularly under effect heterogeneity. Our review is divided into three main components: first, sample surveys or prevalence studies, assessing the frequency or prevalence of some attitude or disease condition in a population from its frequency in a sample from this population; second, generalization of the results from randomized trials to the population in which they were performed and to other populations; and third, generalization of results from observational studies.

AB - Web-based enrollment in surveys and studies is increasingly attractive as the Internet is approaching near-universal coverage and the attitude of respondents toward participation in classical modes of study deteriorates. Follow-up is also facilitated by the web-based approach. However, the consequent self-selection raises the question of the importance of representativity when attempting to generalize the results of a study beyond the context in which they were obtained, particularly under effect heterogeneity. Our review is divided into three main components: first, sample surveys or prevalence studies, assessing the frequency or prevalence of some attitude or disease condition in a population from its frequency in a sample from this population; second, generalization of the results from randomized trials to the population in which they were performed and to other populations; and third, generalization of results from observational studies.

KW - External validity

KW - Internal validity

KW - Nonprobability samples

KW - Representativity

KW - Transportability

KW - Unmeasured confounders

UR - http://www.scopus.com/inward/record.url?scp=85043466080&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85043466080&partnerID=8YFLogxK

U2 - 10.1146/annurev-statistics-031017-100127

DO - 10.1146/annurev-statistics-031017-100127

M3 - Review article

AN - SCOPUS:85043466080

VL - 5

SP - 25

EP - 47

JO - Annual Review of Statistics and Its Application

JF - Annual Review of Statistics and Its Application

SN - 2326-831X

ER -