Population Health Metrics Research Consortium gold standard verbal autopsy validation study: Design, implementation, and development of analysis datasets

Christopher J L Murray, Alan D. Lopez, Robert E Black, Ramesh Ahuja, Said M. Ali, Abdullah Baqui, Lalit Dandona, Emily Dantzer, Vinita Das, Usha Dhingra, Arup Dutta, Wafaie Fawzi, Abraham D. Flaxman, Sara Gómez, Bernardo Hernández, Rohina Joshi, Henry Kalter, Aarti Kumar, Vishwajeet Kumar, Rafael LozanoMarilla Lucero, Saurabh Mehta, Bruce Neal, Summer L. Ohno, Rajendra Prasad, Devarsetty Praveen, Zul Premji, Dolores Ramírez-Villalobos, Hazel Remolador, Ian Riley, Minerva Romero, Mwanaidi Said, Diozele Sanvictores, Sunil Sazawal, Veronica Tallo

Research output: Contribution to journalArticle

Abstract

Background: Verbal autopsy methods are critically important for evaluating the leading causes of death in populations without adequate vital registration systems. With a myriad of analytical and data collection approaches, it is essential to create a high quality validation dataset from different populations to evaluate comparative method performance and make recommendations for future verbal autopsy implementation. This study was undertaken to compile a set of strictly defined gold standard deaths for which verbal autopsies were collected to validate the accuracy of different methods of verbal autopsy cause of death assignment.Methods: Data collection was implemented in six sites in four countries: Andhra Pradesh, India; Bohol, Philippines; Dar es Salaam, Tanzania; Mexico City, Mexico; Pemba Island, Tanzania; and Uttar Pradesh, India. The Population Health Metrics Research Consortium (PHMRC) developed stringent diagnostic criteria including laboratory, pathology, and medical imaging findings to identify gold standard deaths in health facilities as well as an enhanced verbal autopsy instrument based on World Health Organization (WHO) standards. A cause list was constructed based on the WHO Global Burden of Disease estimates of the leading causes of death, potential to identify unique signs and symptoms, and the likely existence of sufficient medical technology to ascertain gold standard cases. Blinded verbal autopsies were collected on all gold standard deaths.Results: Over 12,000 verbal autopsies on deaths with gold standard diagnoses were collected (7,836 adults, 2,075 children, 1,629 neonates, and 1,002 stillbirths). Difficulties in finding sufficient cases to meet gold standard criteria as well as problems with misclassification for certain causes meant that the target list of causes for analysis was reduced to 34 for adults, 21 for children, and 10 for neonates, excluding stillbirths. To ensure strict independence for the validation of methods and assessment of comparative performance, 500 test-train datasets were created from the universe of cases, covering a range of cause-specific compositions.Conclusions: This unique, robust validation dataset will allow scholars to evaluate the performance of different verbal autopsy analytic methods as well as instrument design. This dataset can be used to inform the implementation of verbal autopsies to more reliably ascertain cause of death in national health information systems.

Original languageEnglish (US)
Article number27
JournalPopulation Health Metrics
Volume9
DOIs
StatePublished - Aug 4 2011

Fingerprint

Validation Studies
Autopsy
Health
Research
Population
Cause of Death
Stillbirth
Tanzania
Mexico
India
Indian Ocean Islands
Newborn Infant
Health Information Systems
Datasets
Philippines
Health Facilities
Diagnostic Imaging
Islands
Signs and Symptoms
Pathology

Keywords

  • Cause of death
  • Gold standard
  • India
  • Mexico
  • Philippines
  • Tanzania
  • VA
  • Validation
  • Verbal autopsy

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health
  • Epidemiology

Cite this

Population Health Metrics Research Consortium gold standard verbal autopsy validation study : Design, implementation, and development of analysis datasets. / Murray, Christopher J L; Lopez, Alan D.; Black, Robert E; Ahuja, Ramesh; Ali, Said M.; Baqui, Abdullah; Dandona, Lalit; Dantzer, Emily; Das, Vinita; Dhingra, Usha; Dutta, Arup; Fawzi, Wafaie; Flaxman, Abraham D.; Gómez, Sara; Hernández, Bernardo; Joshi, Rohina; Kalter, Henry; Kumar, Aarti; Kumar, Vishwajeet; Lozano, Rafael; Lucero, Marilla; Mehta, Saurabh; Neal, Bruce; Ohno, Summer L.; Prasad, Rajendra; Praveen, Devarsetty; Premji, Zul; Ramírez-Villalobos, Dolores; Remolador, Hazel; Riley, Ian; Romero, Minerva; Said, Mwanaidi; Sanvictores, Diozele; Sazawal, Sunil; Tallo, Veronica.

In: Population Health Metrics, Vol. 9, 27, 04.08.2011.

Research output: Contribution to journalArticle

Murray, CJL, Lopez, AD, Black, RE, Ahuja, R, Ali, SM, Baqui, A, Dandona, L, Dantzer, E, Das, V, Dhingra, U, Dutta, A, Fawzi, W, Flaxman, AD, Gómez, S, Hernández, B, Joshi, R, Kalter, H, Kumar, A, Kumar, V, Lozano, R, Lucero, M, Mehta, S, Neal, B, Ohno, SL, Prasad, R, Praveen, D, Premji, Z, Ramírez-Villalobos, D, Remolador, H, Riley, I, Romero, M, Said, M, Sanvictores, D, Sazawal, S & Tallo, V 2011, 'Population Health Metrics Research Consortium gold standard verbal autopsy validation study: Design, implementation, and development of analysis datasets', Population Health Metrics, vol. 9, 27. https://doi.org/10.1186/1478-7954-9-27
Murray, Christopher J L ; Lopez, Alan D. ; Black, Robert E ; Ahuja, Ramesh ; Ali, Said M. ; Baqui, Abdullah ; Dandona, Lalit ; Dantzer, Emily ; Das, Vinita ; Dhingra, Usha ; Dutta, Arup ; Fawzi, Wafaie ; Flaxman, Abraham D. ; Gómez, Sara ; Hernández, Bernardo ; Joshi, Rohina ; Kalter, Henry ; Kumar, Aarti ; Kumar, Vishwajeet ; Lozano, Rafael ; Lucero, Marilla ; Mehta, Saurabh ; Neal, Bruce ; Ohno, Summer L. ; Prasad, Rajendra ; Praveen, Devarsetty ; Premji, Zul ; Ramírez-Villalobos, Dolores ; Remolador, Hazel ; Riley, Ian ; Romero, Minerva ; Said, Mwanaidi ; Sanvictores, Diozele ; Sazawal, Sunil ; Tallo, Veronica. / Population Health Metrics Research Consortium gold standard verbal autopsy validation study : Design, implementation, and development of analysis datasets. In: Population Health Metrics. 2011 ; Vol. 9.
@article{67d11bab3ae4415097664f4a281eebc0,
title = "Population Health Metrics Research Consortium gold standard verbal autopsy validation study: Design, implementation, and development of analysis datasets",
abstract = "Background: Verbal autopsy methods are critically important for evaluating the leading causes of death in populations without adequate vital registration systems. With a myriad of analytical and data collection approaches, it is essential to create a high quality validation dataset from different populations to evaluate comparative method performance and make recommendations for future verbal autopsy implementation. This study was undertaken to compile a set of strictly defined gold standard deaths for which verbal autopsies were collected to validate the accuracy of different methods of verbal autopsy cause of death assignment.Methods: Data collection was implemented in six sites in four countries: Andhra Pradesh, India; Bohol, Philippines; Dar es Salaam, Tanzania; Mexico City, Mexico; Pemba Island, Tanzania; and Uttar Pradesh, India. The Population Health Metrics Research Consortium (PHMRC) developed stringent diagnostic criteria including laboratory, pathology, and medical imaging findings to identify gold standard deaths in health facilities as well as an enhanced verbal autopsy instrument based on World Health Organization (WHO) standards. A cause list was constructed based on the WHO Global Burden of Disease estimates of the leading causes of death, potential to identify unique signs and symptoms, and the likely existence of sufficient medical technology to ascertain gold standard cases. Blinded verbal autopsies were collected on all gold standard deaths.Results: Over 12,000 verbal autopsies on deaths with gold standard diagnoses were collected (7,836 adults, 2,075 children, 1,629 neonates, and 1,002 stillbirths). Difficulties in finding sufficient cases to meet gold standard criteria as well as problems with misclassification for certain causes meant that the target list of causes for analysis was reduced to 34 for adults, 21 for children, and 10 for neonates, excluding stillbirths. To ensure strict independence for the validation of methods and assessment of comparative performance, 500 test-train datasets were created from the universe of cases, covering a range of cause-specific compositions.Conclusions: This unique, robust validation dataset will allow scholars to evaluate the performance of different verbal autopsy analytic methods as well as instrument design. This dataset can be used to inform the implementation of verbal autopsies to more reliably ascertain cause of death in national health information systems.",
keywords = "Cause of death, Gold standard, India, Mexico, Philippines, Tanzania, VA, Validation, Verbal autopsy",
author = "Murray, {Christopher J L} and Lopez, {Alan D.} and Black, {Robert E} and Ramesh Ahuja and Ali, {Said M.} and Abdullah Baqui and Lalit Dandona and Emily Dantzer and Vinita Das and Usha Dhingra and Arup Dutta and Wafaie Fawzi and Flaxman, {Abraham D.} and Sara G{\'o}mez and Bernardo Hern{\'a}ndez and Rohina Joshi and Henry Kalter and Aarti Kumar and Vishwajeet Kumar and Rafael Lozano and Marilla Lucero and Saurabh Mehta and Bruce Neal and Ohno, {Summer L.} and Rajendra Prasad and Devarsetty Praveen and Zul Premji and Dolores Ram{\'i}rez-Villalobos and Hazel Remolador and Ian Riley and Minerva Romero and Mwanaidi Said and Diozele Sanvictores and Sunil Sazawal and Veronica Tallo",
year = "2011",
month = "8",
day = "4",
doi = "10.1186/1478-7954-9-27",
language = "English (US)",
volume = "9",
journal = "Population Health Metrics",
issn = "1478-7954",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Population Health Metrics Research Consortium gold standard verbal autopsy validation study

T2 - Design, implementation, and development of analysis datasets

AU - Murray, Christopher J L

AU - Lopez, Alan D.

AU - Black, Robert E

AU - Ahuja, Ramesh

AU - Ali, Said M.

AU - Baqui, Abdullah

AU - Dandona, Lalit

AU - Dantzer, Emily

AU - Das, Vinita

AU - Dhingra, Usha

AU - Dutta, Arup

AU - Fawzi, Wafaie

AU - Flaxman, Abraham D.

AU - Gómez, Sara

AU - Hernández, Bernardo

AU - Joshi, Rohina

AU - Kalter, Henry

AU - Kumar, Aarti

AU - Kumar, Vishwajeet

AU - Lozano, Rafael

AU - Lucero, Marilla

AU - Mehta, Saurabh

AU - Neal, Bruce

AU - Ohno, Summer L.

AU - Prasad, Rajendra

AU - Praveen, Devarsetty

AU - Premji, Zul

AU - Ramírez-Villalobos, Dolores

AU - Remolador, Hazel

AU - Riley, Ian

AU - Romero, Minerva

AU - Said, Mwanaidi

AU - Sanvictores, Diozele

AU - Sazawal, Sunil

AU - Tallo, Veronica

PY - 2011/8/4

Y1 - 2011/8/4

N2 - Background: Verbal autopsy methods are critically important for evaluating the leading causes of death in populations without adequate vital registration systems. With a myriad of analytical and data collection approaches, it is essential to create a high quality validation dataset from different populations to evaluate comparative method performance and make recommendations for future verbal autopsy implementation. This study was undertaken to compile a set of strictly defined gold standard deaths for which verbal autopsies were collected to validate the accuracy of different methods of verbal autopsy cause of death assignment.Methods: Data collection was implemented in six sites in four countries: Andhra Pradesh, India; Bohol, Philippines; Dar es Salaam, Tanzania; Mexico City, Mexico; Pemba Island, Tanzania; and Uttar Pradesh, India. The Population Health Metrics Research Consortium (PHMRC) developed stringent diagnostic criteria including laboratory, pathology, and medical imaging findings to identify gold standard deaths in health facilities as well as an enhanced verbal autopsy instrument based on World Health Organization (WHO) standards. A cause list was constructed based on the WHO Global Burden of Disease estimates of the leading causes of death, potential to identify unique signs and symptoms, and the likely existence of sufficient medical technology to ascertain gold standard cases. Blinded verbal autopsies were collected on all gold standard deaths.Results: Over 12,000 verbal autopsies on deaths with gold standard diagnoses were collected (7,836 adults, 2,075 children, 1,629 neonates, and 1,002 stillbirths). Difficulties in finding sufficient cases to meet gold standard criteria as well as problems with misclassification for certain causes meant that the target list of causes for analysis was reduced to 34 for adults, 21 for children, and 10 for neonates, excluding stillbirths. To ensure strict independence for the validation of methods and assessment of comparative performance, 500 test-train datasets were created from the universe of cases, covering a range of cause-specific compositions.Conclusions: This unique, robust validation dataset will allow scholars to evaluate the performance of different verbal autopsy analytic methods as well as instrument design. This dataset can be used to inform the implementation of verbal autopsies to more reliably ascertain cause of death in national health information systems.

AB - Background: Verbal autopsy methods are critically important for evaluating the leading causes of death in populations without adequate vital registration systems. With a myriad of analytical and data collection approaches, it is essential to create a high quality validation dataset from different populations to evaluate comparative method performance and make recommendations for future verbal autopsy implementation. This study was undertaken to compile a set of strictly defined gold standard deaths for which verbal autopsies were collected to validate the accuracy of different methods of verbal autopsy cause of death assignment.Methods: Data collection was implemented in six sites in four countries: Andhra Pradesh, India; Bohol, Philippines; Dar es Salaam, Tanzania; Mexico City, Mexico; Pemba Island, Tanzania; and Uttar Pradesh, India. The Population Health Metrics Research Consortium (PHMRC) developed stringent diagnostic criteria including laboratory, pathology, and medical imaging findings to identify gold standard deaths in health facilities as well as an enhanced verbal autopsy instrument based on World Health Organization (WHO) standards. A cause list was constructed based on the WHO Global Burden of Disease estimates of the leading causes of death, potential to identify unique signs and symptoms, and the likely existence of sufficient medical technology to ascertain gold standard cases. Blinded verbal autopsies were collected on all gold standard deaths.Results: Over 12,000 verbal autopsies on deaths with gold standard diagnoses were collected (7,836 adults, 2,075 children, 1,629 neonates, and 1,002 stillbirths). Difficulties in finding sufficient cases to meet gold standard criteria as well as problems with misclassification for certain causes meant that the target list of causes for analysis was reduced to 34 for adults, 21 for children, and 10 for neonates, excluding stillbirths. To ensure strict independence for the validation of methods and assessment of comparative performance, 500 test-train datasets were created from the universe of cases, covering a range of cause-specific compositions.Conclusions: This unique, robust validation dataset will allow scholars to evaluate the performance of different verbal autopsy analytic methods as well as instrument design. This dataset can be used to inform the implementation of verbal autopsies to more reliably ascertain cause of death in national health information systems.

KW - Cause of death

KW - Gold standard

KW - India

KW - Mexico

KW - Philippines

KW - Tanzania

KW - VA

KW - Validation

KW - Verbal autopsy

UR - http://www.scopus.com/inward/record.url?scp=79961118664&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79961118664&partnerID=8YFLogxK

U2 - 10.1186/1478-7954-9-27

DO - 10.1186/1478-7954-9-27

M3 - Article

C2 - 21816095

AN - SCOPUS:79961118664

VL - 9

JO - Population Health Metrics

JF - Population Health Metrics

SN - 1478-7954

M1 - 27

ER -