Using data to improve programs: Assessment of a data quality and use intervention package for integrated community case management in Malawi

Elizabeth Hazel, Emmanuel Chimbalanga, Tiyese Chimuna, Humphreys Nsona, Angella Mtimuni, Ernest Kaludzu, Kate Gilroy, Tanya Guentherg

Research output: Contribution to journalArticle

Abstract

Health Surveillance Assistants (HSAs) have been providing integrated community case management (iCCM) for sick children in Malawi since 2008. HSAs report monthly iCCM program data but, at the time of this study, little of it was being used for service improvement. Additionally, HSAs and facility health workers did not have the tools to compile and visualize the data they collected to make evidence-based program decisions. From 2012 to 2013, we worked with Ministry of Health staff and partners to develop and pilot a program in Dowa and Kasungu districts to improve data quality and use at the health worker level. We developed and distributed wall chart templates to display and visualize data, provided training to 426 HSAs and supervisors on data analysis using the templates, and engaged health workers in program improvement plans as part of a data quality and use (DQU) package. We assessed the package through baseline and endline surveys of the HSAs and facility and district staff in the study areas, focusing specifically on availability of reporting forms, completeness of the forms, and consistency of the data between different levels of the health system as measured through results verification ratio (RVR). We found evidence of significant improvements in reporting consistency for suspected pneumonia illness (from overreporting cases at baseline [RVR=0.82] to no reporting inconsistency at endline [RVR=1.0]; P=.02). Other non-significant improvements were measured for fever illness and gender of the patient. Use of the data-display wall charts was high; almost all HSAs and three-fourths of the health facilities had completed all months since January 2013. Some participants reported the wall charts helped them use data for program improvement, such as to inform community health education activities and to better track stock-outs. Since this study, the DQU package has been scaled up in Malawi and expanded to 2 other countries. Unfortunately, without the sustained support and supervision provided in this project, use of the tools in the Malawi scale-up is lower than during the pilot period. Nevertheless, this pilot project shows community and facility health workers can use data to improve programs at the local level given the opportunity to access and visualize the data along with supervision support.

Original languageEnglish (US)
Pages (from-to)355-366
Number of pages12
JournalGlobal Health Science and Practice
Volume5
Issue number3
DOIs
StatePublished - Sep 2017

Fingerprint

Malawi
Case Management
Health
Data Display
Health Facilities
Health Status
Time and Motion Studies
Data Accuracy
Health Education
Pneumonia
Fever

ASJC Scopus subject areas

  • Health Policy
  • Public Health, Environmental and Occupational Health

Cite this

Using data to improve programs : Assessment of a data quality and use intervention package for integrated community case management in Malawi. / Hazel, Elizabeth; Chimbalanga, Emmanuel; Chimuna, Tiyese; Nsona, Humphreys; Mtimuni, Angella; Kaludzu, Ernest; Gilroy, Kate; Guentherg, Tanya.

In: Global Health Science and Practice, Vol. 5, No. 3, 09.2017, p. 355-366.

Research output: Contribution to journalArticle

Hazel, Elizabeth ; Chimbalanga, Emmanuel ; Chimuna, Tiyese ; Nsona, Humphreys ; Mtimuni, Angella ; Kaludzu, Ernest ; Gilroy, Kate ; Guentherg, Tanya. / Using data to improve programs : Assessment of a data quality and use intervention package for integrated community case management in Malawi. In: Global Health Science and Practice. 2017 ; Vol. 5, No. 3. pp. 355-366.
@article{4679dc2618bb4ea3b32e1f56df53b837,
title = "Using data to improve programs: Assessment of a data quality and use intervention package for integrated community case management in Malawi",
abstract = "Health Surveillance Assistants (HSAs) have been providing integrated community case management (iCCM) for sick children in Malawi since 2008. HSAs report monthly iCCM program data but, at the time of this study, little of it was being used for service improvement. Additionally, HSAs and facility health workers did not have the tools to compile and visualize the data they collected to make evidence-based program decisions. From 2012 to 2013, we worked with Ministry of Health staff and partners to develop and pilot a program in Dowa and Kasungu districts to improve data quality and use at the health worker level. We developed and distributed wall chart templates to display and visualize data, provided training to 426 HSAs and supervisors on data analysis using the templates, and engaged health workers in program improvement plans as part of a data quality and use (DQU) package. We assessed the package through baseline and endline surveys of the HSAs and facility and district staff in the study areas, focusing specifically on availability of reporting forms, completeness of the forms, and consistency of the data between different levels of the health system as measured through results verification ratio (RVR). We found evidence of significant improvements in reporting consistency for suspected pneumonia illness (from overreporting cases at baseline [RVR=0.82] to no reporting inconsistency at endline [RVR=1.0]; P=.02). Other non-significant improvements were measured for fever illness and gender of the patient. Use of the data-display wall charts was high; almost all HSAs and three-fourths of the health facilities had completed all months since January 2013. Some participants reported the wall charts helped them use data for program improvement, such as to inform community health education activities and to better track stock-outs. Since this study, the DQU package has been scaled up in Malawi and expanded to 2 other countries. Unfortunately, without the sustained support and supervision provided in this project, use of the tools in the Malawi scale-up is lower than during the pilot period. Nevertheless, this pilot project shows community and facility health workers can use data to improve programs at the local level given the opportunity to access and visualize the data along with supervision support.",
author = "Elizabeth Hazel and Emmanuel Chimbalanga and Tiyese Chimuna and Humphreys Nsona and Angella Mtimuni and Ernest Kaludzu and Kate Gilroy and Tanya Guentherg",
year = "2017",
month = "9",
doi = "10.9745/GHSP-D-17-00103",
language = "English (US)",
volume = "5",
pages = "355--366",
journal = "Global health, science and practice",
issn = "2169-575X",
publisher = "U.S. Agency for International Development",
number = "3",

}

TY - JOUR

T1 - Using data to improve programs

T2 - Assessment of a data quality and use intervention package for integrated community case management in Malawi

AU - Hazel, Elizabeth

AU - Chimbalanga, Emmanuel

AU - Chimuna, Tiyese

AU - Nsona, Humphreys

AU - Mtimuni, Angella

AU - Kaludzu, Ernest

AU - Gilroy, Kate

AU - Guentherg, Tanya

PY - 2017/9

Y1 - 2017/9

N2 - Health Surveillance Assistants (HSAs) have been providing integrated community case management (iCCM) for sick children in Malawi since 2008. HSAs report monthly iCCM program data but, at the time of this study, little of it was being used for service improvement. Additionally, HSAs and facility health workers did not have the tools to compile and visualize the data they collected to make evidence-based program decisions. From 2012 to 2013, we worked with Ministry of Health staff and partners to develop and pilot a program in Dowa and Kasungu districts to improve data quality and use at the health worker level. We developed and distributed wall chart templates to display and visualize data, provided training to 426 HSAs and supervisors on data analysis using the templates, and engaged health workers in program improvement plans as part of a data quality and use (DQU) package. We assessed the package through baseline and endline surveys of the HSAs and facility and district staff in the study areas, focusing specifically on availability of reporting forms, completeness of the forms, and consistency of the data between different levels of the health system as measured through results verification ratio (RVR). We found evidence of significant improvements in reporting consistency for suspected pneumonia illness (from overreporting cases at baseline [RVR=0.82] to no reporting inconsistency at endline [RVR=1.0]; P=.02). Other non-significant improvements were measured for fever illness and gender of the patient. Use of the data-display wall charts was high; almost all HSAs and three-fourths of the health facilities had completed all months since January 2013. Some participants reported the wall charts helped them use data for program improvement, such as to inform community health education activities and to better track stock-outs. Since this study, the DQU package has been scaled up in Malawi and expanded to 2 other countries. Unfortunately, without the sustained support and supervision provided in this project, use of the tools in the Malawi scale-up is lower than during the pilot period. Nevertheless, this pilot project shows community and facility health workers can use data to improve programs at the local level given the opportunity to access and visualize the data along with supervision support.

AB - Health Surveillance Assistants (HSAs) have been providing integrated community case management (iCCM) for sick children in Malawi since 2008. HSAs report monthly iCCM program data but, at the time of this study, little of it was being used for service improvement. Additionally, HSAs and facility health workers did not have the tools to compile and visualize the data they collected to make evidence-based program decisions. From 2012 to 2013, we worked with Ministry of Health staff and partners to develop and pilot a program in Dowa and Kasungu districts to improve data quality and use at the health worker level. We developed and distributed wall chart templates to display and visualize data, provided training to 426 HSAs and supervisors on data analysis using the templates, and engaged health workers in program improvement plans as part of a data quality and use (DQU) package. We assessed the package through baseline and endline surveys of the HSAs and facility and district staff in the study areas, focusing specifically on availability of reporting forms, completeness of the forms, and consistency of the data between different levels of the health system as measured through results verification ratio (RVR). We found evidence of significant improvements in reporting consistency for suspected pneumonia illness (from overreporting cases at baseline [RVR=0.82] to no reporting inconsistency at endline [RVR=1.0]; P=.02). Other non-significant improvements were measured for fever illness and gender of the patient. Use of the data-display wall charts was high; almost all HSAs and three-fourths of the health facilities had completed all months since January 2013. Some participants reported the wall charts helped them use data for program improvement, such as to inform community health education activities and to better track stock-outs. Since this study, the DQU package has been scaled up in Malawi and expanded to 2 other countries. Unfortunately, without the sustained support and supervision provided in this project, use of the tools in the Malawi scale-up is lower than during the pilot period. Nevertheless, this pilot project shows community and facility health workers can use data to improve programs at the local level given the opportunity to access and visualize the data along with supervision support.

UR - http://www.scopus.com/inward/record.url?scp=85034579412&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034579412&partnerID=8YFLogxK

U2 - 10.9745/GHSP-D-17-00103

DO - 10.9745/GHSP-D-17-00103

M3 - Article

C2 - 28963172

AN - SCOPUS:85034579412

VL - 5

SP - 355

EP - 366

JO - Global health, science and practice

JF - Global health, science and practice

SN - 2169-575X

IS - 3

ER -