Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings

C. King, J. Beard, A. C. Crampin, A. Costello, C. Mwansambo, N. A. Cunliffe, R. S. Heyderman, N. French, Naor Bar-Zeev

Research output: Contribution to journalReview article

Abstract

Post-licensure real world evaluation of vaccine implementation is important for establishing evidence of vaccine effectiveness (VE) and programme impact, including indirect effects. Large cohort studies offer an important epidemiological approach for evaluating VE, but have inherent methodological challenges.Since March 2012, we have conducted an open prospective cohort study in two sites in rural Malawi to evaluate the post-introduction effectiveness of 13-valent pneumococcal conjugate vaccine (PCV13) against all-cause post-neonatal infant mortality and monovalent rotavirus vaccine (RV1) against diarrhoea-related post-neonatal infant mortality. Our study sites cover a population of 500,000, with a baseline post-neonatal infant mortality of 25 per 1000 live births.We conducted a methodological review of cohort studies for vaccine effectiveness in a developing country setting, applied to our study context. Based on published literature, we outline key considerations when defining the denominator (study population), exposure (vaccination status) and outcome ascertainment (mortality and cause of death) of such studies. We assess various definitions in these three domains, in terms of their impact on power, effect size and potential biases and their direction, using our cohort study for illustration. Based on this iterative process, we discuss the pros and cons of our final per-protocol analysis plan. Since no single set of definitions or analytical approach accounts for all possible biases, we propose sensitivity analyses to interrogate our assumptions and methodological decisions.In the poorest regions of the world where routine vital birth and death surveillance are frequently unavailable and the burden of disease and death is greatest We conclude that provided the balance between definitions and their overall assumed impact on estimated VE are acknowledged, such large scale real-world cohort studies can provide crucial information to policymakers by providing robust and compelling evidence of total benefits of newly introduced vaccines on reducing child mortality.

Original languageEnglish (US)
Pages (from-to)4748-4755
Number of pages8
JournalVaccine
Volume33
Issue number38
DOIs
StatePublished - Sep 11 2015
Externally publishedYes

Fingerprint

Infant Mortality
Vaccines
vaccines
Cohort Studies
cohort studies
infant mortality
neonatal mortality
Population
death
Rotavirus Vaccines
Malawi
Child Mortality
Conjugate Vaccines
Program Evaluation
Live Birth
Licensure
Developing Countries
burden of disease
Cause of Death
Diarrhea

Keywords

  • Children
  • Cohort
  • Diarrhoea
  • Methodology
  • PCV13
  • Pneumococcal disease
  • Pneumonia
  • RV1
  • Survival analysis
  • Vaccine effectiveness

ASJC Scopus subject areas

  • Molecular Medicine
  • Immunology and Microbiology(all)
  • veterinary(all)
  • Public Health, Environmental and Occupational Health
  • Infectious Diseases

Cite this

Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings. / King, C.; Beard, J.; Crampin, A. C.; Costello, A.; Mwansambo, C.; Cunliffe, N. A.; Heyderman, R. S.; French, N.; Bar-Zeev, Naor.

In: Vaccine, Vol. 33, No. 38, 11.09.2015, p. 4748-4755.

Research output: Contribution to journalReview article

King, C, Beard, J, Crampin, AC, Costello, A, Mwansambo, C, Cunliffe, NA, Heyderman, RS, French, N & Bar-Zeev, N 2015, 'Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings', Vaccine, vol. 33, no. 38, pp. 4748-4755. https://doi.org/10.1016/j.vaccine.2015.07.062
King, C. ; Beard, J. ; Crampin, A. C. ; Costello, A. ; Mwansambo, C. ; Cunliffe, N. A. ; Heyderman, R. S. ; French, N. ; Bar-Zeev, Naor. / Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings. In: Vaccine. 2015 ; Vol. 33, No. 38. pp. 4748-4755.
@article{47076790aeb24e088d2ac95965d1947e,
title = "Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings",
abstract = "Post-licensure real world evaluation of vaccine implementation is important for establishing evidence of vaccine effectiveness (VE) and programme impact, including indirect effects. Large cohort studies offer an important epidemiological approach for evaluating VE, but have inherent methodological challenges.Since March 2012, we have conducted an open prospective cohort study in two sites in rural Malawi to evaluate the post-introduction effectiveness of 13-valent pneumococcal conjugate vaccine (PCV13) against all-cause post-neonatal infant mortality and monovalent rotavirus vaccine (RV1) against diarrhoea-related post-neonatal infant mortality. Our study sites cover a population of 500,000, with a baseline post-neonatal infant mortality of 25 per 1000 live births.We conducted a methodological review of cohort studies for vaccine effectiveness in a developing country setting, applied to our study context. Based on published literature, we outline key considerations when defining the denominator (study population), exposure (vaccination status) and outcome ascertainment (mortality and cause of death) of such studies. We assess various definitions in these three domains, in terms of their impact on power, effect size and potential biases and their direction, using our cohort study for illustration. Based on this iterative process, we discuss the pros and cons of our final per-protocol analysis plan. Since no single set of definitions or analytical approach accounts for all possible biases, we propose sensitivity analyses to interrogate our assumptions and methodological decisions.In the poorest regions of the world where routine vital birth and death surveillance are frequently unavailable and the burden of disease and death is greatest We conclude that provided the balance between definitions and their overall assumed impact on estimated VE are acknowledged, such large scale real-world cohort studies can provide crucial information to policymakers by providing robust and compelling evidence of total benefits of newly introduced vaccines on reducing child mortality.",
keywords = "Children, Cohort, Diarrhoea, Methodology, PCV13, Pneumococcal disease, Pneumonia, RV1, Survival analysis, Vaccine effectiveness",
author = "C. King and J. Beard and Crampin, {A. C.} and A. Costello and C. Mwansambo and Cunliffe, {N. A.} and Heyderman, {R. S.} and N. French and Naor Bar-Zeev",
year = "2015",
month = "9",
day = "11",
doi = "10.1016/j.vaccine.2015.07.062",
language = "English (US)",
volume = "33",
pages = "4748--4755",
journal = "Vaccine",
issn = "0264-410X",
publisher = "Elsevier BV",
number = "38",

}

TY - JOUR

T1 - Methodological challenges in measuring vaccine effectiveness using population cohorts in low resource settings

AU - King, C.

AU - Beard, J.

AU - Crampin, A. C.

AU - Costello, A.

AU - Mwansambo, C.

AU - Cunliffe, N. A.

AU - Heyderman, R. S.

AU - French, N.

AU - Bar-Zeev, Naor

PY - 2015/9/11

Y1 - 2015/9/11

N2 - Post-licensure real world evaluation of vaccine implementation is important for establishing evidence of vaccine effectiveness (VE) and programme impact, including indirect effects. Large cohort studies offer an important epidemiological approach for evaluating VE, but have inherent methodological challenges.Since March 2012, we have conducted an open prospective cohort study in two sites in rural Malawi to evaluate the post-introduction effectiveness of 13-valent pneumococcal conjugate vaccine (PCV13) against all-cause post-neonatal infant mortality and monovalent rotavirus vaccine (RV1) against diarrhoea-related post-neonatal infant mortality. Our study sites cover a population of 500,000, with a baseline post-neonatal infant mortality of 25 per 1000 live births.We conducted a methodological review of cohort studies for vaccine effectiveness in a developing country setting, applied to our study context. Based on published literature, we outline key considerations when defining the denominator (study population), exposure (vaccination status) and outcome ascertainment (mortality and cause of death) of such studies. We assess various definitions in these three domains, in terms of their impact on power, effect size and potential biases and their direction, using our cohort study for illustration. Based on this iterative process, we discuss the pros and cons of our final per-protocol analysis plan. Since no single set of definitions or analytical approach accounts for all possible biases, we propose sensitivity analyses to interrogate our assumptions and methodological decisions.In the poorest regions of the world where routine vital birth and death surveillance are frequently unavailable and the burden of disease and death is greatest We conclude that provided the balance between definitions and their overall assumed impact on estimated VE are acknowledged, such large scale real-world cohort studies can provide crucial information to policymakers by providing robust and compelling evidence of total benefits of newly introduced vaccines on reducing child mortality.

AB - Post-licensure real world evaluation of vaccine implementation is important for establishing evidence of vaccine effectiveness (VE) and programme impact, including indirect effects. Large cohort studies offer an important epidemiological approach for evaluating VE, but have inherent methodological challenges.Since March 2012, we have conducted an open prospective cohort study in two sites in rural Malawi to evaluate the post-introduction effectiveness of 13-valent pneumococcal conjugate vaccine (PCV13) against all-cause post-neonatal infant mortality and monovalent rotavirus vaccine (RV1) against diarrhoea-related post-neonatal infant mortality. Our study sites cover a population of 500,000, with a baseline post-neonatal infant mortality of 25 per 1000 live births.We conducted a methodological review of cohort studies for vaccine effectiveness in a developing country setting, applied to our study context. Based on published literature, we outline key considerations when defining the denominator (study population), exposure (vaccination status) and outcome ascertainment (mortality and cause of death) of such studies. We assess various definitions in these three domains, in terms of their impact on power, effect size and potential biases and their direction, using our cohort study for illustration. Based on this iterative process, we discuss the pros and cons of our final per-protocol analysis plan. Since no single set of definitions or analytical approach accounts for all possible biases, we propose sensitivity analyses to interrogate our assumptions and methodological decisions.In the poorest regions of the world where routine vital birth and death surveillance are frequently unavailable and the burden of disease and death is greatest We conclude that provided the balance between definitions and their overall assumed impact on estimated VE are acknowledged, such large scale real-world cohort studies can provide crucial information to policymakers by providing robust and compelling evidence of total benefits of newly introduced vaccines on reducing child mortality.

KW - Children

KW - Cohort

KW - Diarrhoea

KW - Methodology

KW - PCV13

KW - Pneumococcal disease

KW - Pneumonia

KW - RV1

KW - Survival analysis

KW - Vaccine effectiveness

UR - http://www.scopus.com/inward/record.url?scp=84940724194&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940724194&partnerID=8YFLogxK

U2 - 10.1016/j.vaccine.2015.07.062

DO - 10.1016/j.vaccine.2015.07.062

M3 - Review article

C2 - 26235370

AN - SCOPUS:84940724194

VL - 33

SP - 4748

EP - 4755

JO - Vaccine

JF - Vaccine

SN - 0264-410X

IS - 38

ER -