Measuring fertility through mobile-phone based household surveys: Methods, data quality, and lessons learned from PMA2020 surveys

Yoonjoung Choi, Qingfeng Li, Blake Zachary

Research output: Contribution to journalArticle

Abstract

BACKGROUND PMA2020 is a survey platform with resident enumerators using mobile phones. Instead of collecting full birth history, total fertility rates (TFR) have been measured with a limited number of questions on recent births. Employing new approaches provides opportunities to test and advance survey methods. OBJECTIVE This study aims to assess the quality of fertility data in PMA2020 surveys, focusing on bias introduced from the questionnaire and completeness and distribution of birth month and year, and to estimate TFR adjusted for identified data quality issues. METHODS To assess underestimation from the questionnaire, we simulated births that would be counted using the PMA2020 questionnaires compared to births identified from full birth history. We analyzed the latest Demographic and Health Surveys in ten countries where PMA2020 surveys have been implemented. We assessed the level of reporting completeness for birth month and year and heaping of birth month, analyzing 39 PMA2020 surveys. Finally, TFR were calculated and adjusted for biases introduced from the questionnaire and heaping in birth month. RESULTS Simple questions introduced minor bias from undercounting multiple births, which was expected and correctable. Meanwhile, incomplete reporting of birth month was relatively high, and the default value of January in data collection software systematically moved births with missing months out of the reference period. On average across the 39 surveys, TFR increased by 1.6% and 2.4%, adjusted for undercounted multiple births and heaping on January, respectively. CONTRIBUTION This study emphasizes the importance of enumerator training and provides critical insight in software programming in surveys using mobile technologies.

Original languageEnglish (US)
Pages (from-to)1663-1698
Number of pages36
JournalDemographic Research
Volume38
Issue number1
DOIs
StatePublished - May 23 2018

Fingerprint

data quality
household survey
fertility
fertility rate
questionnaire
trend
history
programming

ASJC Scopus subject areas

  • Demography

Cite this

Measuring fertility through mobile-phone based household surveys : Methods, data quality, and lessons learned from PMA2020 surveys. / Choi, Yoonjoung; Li, Qingfeng; Zachary, Blake.

In: Demographic Research, Vol. 38, No. 1, 23.05.2018, p. 1663-1698.

Research output: Contribution to journalArticle

@article{31dcfefbe5fe4c6fa72637919b182ce1,
title = "Measuring fertility through mobile-phone based household surveys: Methods, data quality, and lessons learned from PMA2020 surveys",
abstract = "BACKGROUND PMA2020 is a survey platform with resident enumerators using mobile phones. Instead of collecting full birth history, total fertility rates (TFR) have been measured with a limited number of questions on recent births. Employing new approaches provides opportunities to test and advance survey methods. OBJECTIVE This study aims to assess the quality of fertility data in PMA2020 surveys, focusing on bias introduced from the questionnaire and completeness and distribution of birth month and year, and to estimate TFR adjusted for identified data quality issues. METHODS To assess underestimation from the questionnaire, we simulated births that would be counted using the PMA2020 questionnaires compared to births identified from full birth history. We analyzed the latest Demographic and Health Surveys in ten countries where PMA2020 surveys have been implemented. We assessed the level of reporting completeness for birth month and year and heaping of birth month, analyzing 39 PMA2020 surveys. Finally, TFR were calculated and adjusted for biases introduced from the questionnaire and heaping in birth month. RESULTS Simple questions introduced minor bias from undercounting multiple births, which was expected and correctable. Meanwhile, incomplete reporting of birth month was relatively high, and the default value of January in data collection software systematically moved births with missing months out of the reference period. On average across the 39 surveys, TFR increased by 1.6{\%} and 2.4{\%}, adjusted for undercounted multiple births and heaping on January, respectively. CONTRIBUTION This study emphasizes the importance of enumerator training and provides critical insight in software programming in surveys using mobile technologies.",
author = "Yoonjoung Choi and Qingfeng Li and Blake Zachary",
year = "2018",
month = "5",
day = "23",
doi = "10.4054/DemRes.2018.38.55",
language = "English (US)",
volume = "38",
pages = "1663--1698",
journal = "Demographic Research",
issn = "1435-9871",
publisher = "Max-Planck Institute for Demographic Research/Max-Planck-institut fur Demografische Forschung",
number = "1",

}

TY - JOUR

T1 - Measuring fertility through mobile-phone based household surveys

T2 - Methods, data quality, and lessons learned from PMA2020 surveys

AU - Choi, Yoonjoung

AU - Li, Qingfeng

AU - Zachary, Blake

PY - 2018/5/23

Y1 - 2018/5/23

N2 - BACKGROUND PMA2020 is a survey platform with resident enumerators using mobile phones. Instead of collecting full birth history, total fertility rates (TFR) have been measured with a limited number of questions on recent births. Employing new approaches provides opportunities to test and advance survey methods. OBJECTIVE This study aims to assess the quality of fertility data in PMA2020 surveys, focusing on bias introduced from the questionnaire and completeness and distribution of birth month and year, and to estimate TFR adjusted for identified data quality issues. METHODS To assess underestimation from the questionnaire, we simulated births that would be counted using the PMA2020 questionnaires compared to births identified from full birth history. We analyzed the latest Demographic and Health Surveys in ten countries where PMA2020 surveys have been implemented. We assessed the level of reporting completeness for birth month and year and heaping of birth month, analyzing 39 PMA2020 surveys. Finally, TFR were calculated and adjusted for biases introduced from the questionnaire and heaping in birth month. RESULTS Simple questions introduced minor bias from undercounting multiple births, which was expected and correctable. Meanwhile, incomplete reporting of birth month was relatively high, and the default value of January in data collection software systematically moved births with missing months out of the reference period. On average across the 39 surveys, TFR increased by 1.6% and 2.4%, adjusted for undercounted multiple births and heaping on January, respectively. CONTRIBUTION This study emphasizes the importance of enumerator training and provides critical insight in software programming in surveys using mobile technologies.

AB - BACKGROUND PMA2020 is a survey platform with resident enumerators using mobile phones. Instead of collecting full birth history, total fertility rates (TFR) have been measured with a limited number of questions on recent births. Employing new approaches provides opportunities to test and advance survey methods. OBJECTIVE This study aims to assess the quality of fertility data in PMA2020 surveys, focusing on bias introduced from the questionnaire and completeness and distribution of birth month and year, and to estimate TFR adjusted for identified data quality issues. METHODS To assess underestimation from the questionnaire, we simulated births that would be counted using the PMA2020 questionnaires compared to births identified from full birth history. We analyzed the latest Demographic and Health Surveys in ten countries where PMA2020 surveys have been implemented. We assessed the level of reporting completeness for birth month and year and heaping of birth month, analyzing 39 PMA2020 surveys. Finally, TFR were calculated and adjusted for biases introduced from the questionnaire and heaping in birth month. RESULTS Simple questions introduced minor bias from undercounting multiple births, which was expected and correctable. Meanwhile, incomplete reporting of birth month was relatively high, and the default value of January in data collection software systematically moved births with missing months out of the reference period. On average across the 39 surveys, TFR increased by 1.6% and 2.4%, adjusted for undercounted multiple births and heaping on January, respectively. CONTRIBUTION This study emphasizes the importance of enumerator training and provides critical insight in software programming in surveys using mobile technologies.

UR - http://www.scopus.com/inward/record.url?scp=85047522988&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047522988&partnerID=8YFLogxK

U2 - 10.4054/DemRes.2018.38.55

DO - 10.4054/DemRes.2018.38.55

M3 - Article

AN - SCOPUS:85047522988

VL - 38

SP - 1663

EP - 1698

JO - Demographic Research

JF - Demographic Research

SN - 1435-9871

IS - 1

ER -