Can a List Experiment Improve Validity of Abortion Measurement?

Research output: Contribution to journalArticle

Abstract

Although induced abortion is common, measurement issues have long made this area of research challenging. The current analysis applies an indirect method known as the list experiment to try to improve survey-based measurement of induced abortion. We added a double list experiment to a population-based survey of reproductive age women in Rajasthan, India and compared resulting abortion estimates to those we obtained via direct questioning in the same sample. We then evaluated list experiment assumptions. The final sample completing the survey consisted of 6,035 women. Overall, 1.8 percent of the women reported a past abortion via the list experiment questions, whereas 3.5 percent reported an abortion via the direct questions, and this difference was statistically significant. As such, the list experiment failed to produce more valid estimates of this sensitive behavior on a population-based survey of reproductive age women in Rajasthan, India. One explanation for the poor list experiment performance is our finding that key assumptions of the methodology were violated. Women may have mentally enumerated the treatment list items differently from the way they enumerated control list items. Further research is required to determine whether researchers can learn enough about how the list experiment performs in different contexts to effectively and consistently leverage its potential benefits to improve measurement of induced abortion.

Original languageEnglish (US)
Pages (from-to)43-61
Number of pages19
JournalStudies in family planning
Volume50
Issue number1
DOIs
StatePublished - Mar 1 2019

Fingerprint

abortion
experiment
India
methodology
performance

ASJC Scopus subject areas

  • Demography
  • Social Sciences (miscellaneous)

Cite this

Can a List Experiment Improve Validity of Abortion Measurement? / Bell, Suzanne O.; Bishai, David.

In: Studies in family planning, Vol. 50, No. 1, 01.03.2019, p. 43-61.

Research output: Contribution to journalArticle

@article{877f24a7d3b54511b8bf8bf89f75eb57,
title = "Can a List Experiment Improve Validity of Abortion Measurement?",
abstract = "Although induced abortion is common, measurement issues have long made this area of research challenging. The current analysis applies an indirect method known as the list experiment to try to improve survey-based measurement of induced abortion. We added a double list experiment to a population-based survey of reproductive age women in Rajasthan, India and compared resulting abortion estimates to those we obtained via direct questioning in the same sample. We then evaluated list experiment assumptions. The final sample completing the survey consisted of 6,035 women. Overall, 1.8 percent of the women reported a past abortion via the list experiment questions, whereas 3.5 percent reported an abortion via the direct questions, and this difference was statistically significant. As such, the list experiment failed to produce more valid estimates of this sensitive behavior on a population-based survey of reproductive age women in Rajasthan, India. One explanation for the poor list experiment performance is our finding that key assumptions of the methodology were violated. Women may have mentally enumerated the treatment list items differently from the way they enumerated control list items. Further research is required to determine whether researchers can learn enough about how the list experiment performs in different contexts to effectively and consistently leverage its potential benefits to improve measurement of induced abortion.",
author = "Bell, {Suzanne O.} and David Bishai",
year = "2019",
month = "3",
day = "1",
doi = "10.1111/sifp.12082",
language = "English (US)",
volume = "50",
pages = "43--61",
journal = "Studies in Familiy Planning",
issn = "0039-3665",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Can a List Experiment Improve Validity of Abortion Measurement?

AU - Bell, Suzanne O.

AU - Bishai, David

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Although induced abortion is common, measurement issues have long made this area of research challenging. The current analysis applies an indirect method known as the list experiment to try to improve survey-based measurement of induced abortion. We added a double list experiment to a population-based survey of reproductive age women in Rajasthan, India and compared resulting abortion estimates to those we obtained via direct questioning in the same sample. We then evaluated list experiment assumptions. The final sample completing the survey consisted of 6,035 women. Overall, 1.8 percent of the women reported a past abortion via the list experiment questions, whereas 3.5 percent reported an abortion via the direct questions, and this difference was statistically significant. As such, the list experiment failed to produce more valid estimates of this sensitive behavior on a population-based survey of reproductive age women in Rajasthan, India. One explanation for the poor list experiment performance is our finding that key assumptions of the methodology were violated. Women may have mentally enumerated the treatment list items differently from the way they enumerated control list items. Further research is required to determine whether researchers can learn enough about how the list experiment performs in different contexts to effectively and consistently leverage its potential benefits to improve measurement of induced abortion.

AB - Although induced abortion is common, measurement issues have long made this area of research challenging. The current analysis applies an indirect method known as the list experiment to try to improve survey-based measurement of induced abortion. We added a double list experiment to a population-based survey of reproductive age women in Rajasthan, India and compared resulting abortion estimates to those we obtained via direct questioning in the same sample. We then evaluated list experiment assumptions. The final sample completing the survey consisted of 6,035 women. Overall, 1.8 percent of the women reported a past abortion via the list experiment questions, whereas 3.5 percent reported an abortion via the direct questions, and this difference was statistically significant. As such, the list experiment failed to produce more valid estimates of this sensitive behavior on a population-based survey of reproductive age women in Rajasthan, India. One explanation for the poor list experiment performance is our finding that key assumptions of the methodology were violated. Women may have mentally enumerated the treatment list items differently from the way they enumerated control list items. Further research is required to determine whether researchers can learn enough about how the list experiment performs in different contexts to effectively and consistently leverage its potential benefits to improve measurement of induced abortion.

UR - http://www.scopus.com/inward/record.url?scp=85060601822&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060601822&partnerID=8YFLogxK

U2 - 10.1111/sifp.12082

DO - 10.1111/sifp.12082

M3 - Article

C2 - 30675727

AN - SCOPUS:85060601822

VL - 50

SP - 43

EP - 61

JO - Studies in Familiy Planning

JF - Studies in Familiy Planning

SN - 0039-3665

IS - 1

ER -