Measuring Coverage in MNCH: Design, Implementation, and Interpretation Challenges Associated with Tracking Vaccination Coverage Using Household Surveys

English version České info

Vaccination coverage is an important public health indicator that is measured using administrative reports and/or surveys. The measurement of vaccination coverage in low- and middle-income countries using surveys is susceptible to numerous challenges. These challenges include selection bias and information bias, which cannot be solved by increasing the sample size, and the precision of the coverage estimate, which is determined by the survey sample size and sampling method. Selection bias can result from an inaccurate sampling frame or inappropriate field procedures and, since populations likely to be missed in a vaccination coverage survey are also likely to be missed by vaccination teams, most often inflates coverage estimates. Importantly, the large multi-purpose household surveys that are often used to measure vaccination coverage have invested substantial effort to reduce selection bias. Information bias occurs when a child's vaccination status is misclassified due to mistakes on his or her vaccination record, in data transcription, in the way survey questions are presented, or in the guardian's recall of vaccination for children without a written record. There has been substantial reliance on the guardian's recall in recent surveys, and, worryingly, information bias may become more likely in the future as immunization schedules become more complex and variable. Finally, some surveys assess immunity directly using serological assays. Sero-surveys are important for assessing public health risk, but currently are unable to validate coverage estimates directly. To improve vaccination coverage estimates based on surveys, we recommend that recording tools and practices should be improved and that surveys should incorporate best practices for design, implementation, and analysis.

Vyšlo v časopise: Measuring Coverage in MNCH: Design, Implementation, and Interpretation Challenges Associated with Tracking Vaccination Coverage Using Household Surveys. PLoS Med 10(5): e32767. doi:10.1371/journal.pmed.1001404
Kategorie: Review
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pmed.1001404

Souhrn

Zdroje

1. Hadler SC, Dietz V, Okwo-Bele JM, Cutts FT (2008) Vaccination programs in developing countries. In: Plotkin SA, Orenstein WA, editors. Vaccines, 5th edition. Philadelphia: Saunders.

2. Brenzel L, Measham A, Naimoli J, Batson A, Bredenkamp C, et al.. (2009) Taking stock: World Bank experience with results-based financing (RBF) for health. Washington: The World Bank. Available: http://www.rbfhealth.org/rbfhealth/library/doc/taking-stock-world-bank-experience-results-based-financing-rbf-health. Accessed 29 August 2012.

3. Millenium Challenge Corporation (2011) Report on the criteria and methodology for determining the eligibility of candidate countries for Millennium Challenge Account assistance in fiscal year 2012. Available: https://www.mcc.gov/documents/reports/report-2011001066201-fy12-selection-criteria.pdf. Accessed 29 August 2012.

4. GAVI Alliance (2012) Country eligibility policy. Available: http://www.gavialliance.org/about/governance/programme-policies/country-eligibility/. Accessed 29 August 2012.

5. LimSS, SteinDB, CharrowA, MurrayCJL (2008) Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet 372: 2031–2046.

6. MurrayCJL, ShengeliaB, GuptaN, MoussaviS, TandonA, et al. (2003) Validity of reported vaccination coverage in 45 countries. Lancet 362: 1022–1027.

7. Bosch-CapblanchX, RonveauxO, DoyleV, RemediosV, BchirA (2009) Accuracy and quality of immunization information systems in forty-one low income countries. Trop Med Int Health 14: 2–10.

8. BurtonT, NeilM, Okwo-BeleJM, SalamaP, WardlawT (2009) Measurement of immunisation coverage. Lancet 373: 210–211.

9. DietzV, VenczelL, IzurietaH, StrohG, ZellER, et al. (2004) Assessing and monitoring vaccination coverage levels: lessons from the Americas. Rev Panam Salud Publica 16: 432–442.

10. HullB, DeyA, MahajanD, MenziesR, McIntyrePB (2011) Immunisation coverage annual report, 2009. Commun Dis Intell Q Rep 35: 132–148.

11. RonveauxO, ArrietaF, CurtoS, LauraniH, Danovaro-HollidayM (2009) Assessment of the quality of immunization data produced by the national individual registration system in Uruguay, 2006. Rev Panam Salud Publica 26: 153–160.

12. LuhmKR, CardosoMRA, WaldmanEA (2011) Vaccination coverage among children under two years of age based on electronic immunization registry in Southern Brazil. Rev Saude Publica 45: 90–98.

13. CrowcroftNS (2009) Action on immunisation: no data, no action. Arch Dis Child 94: 829–830.

14. PATH (2012) Rethinking the vaccine supply chain. Available: http://www.path.org/projects/project-optimize. Accessed 29 August 2012.

15. BurtonA, MonaschR, LautenbachB, Gacic-DoboM, NeillM, et al. (2009) WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ 87: 535–541.

16. MEASURE DHS Demographic and Health Surveys. Available: http://www.measuredhs.com/. Accessed 1 June 2012.

17. UNICEF. Statistics and Monitoring: Multiple Indicator Cluster Survey. Available: http://www.unicef.org/statistics/index_24302.html. Accessed 29 June 2012.

18. HanciogluA, ArnoldF (2013) Measuring coverage in MNCH: Tracking progress in health for women and children using DHS and MICS household surveys. PLoS Med 10: e1001391 doi:10.1371/journal.pmed.1001391.

19. HendersonRH, SundaresanT (1982) Cluster sampling to assess immunization coverage: a review of experience with a simplified sampling method. Bull World Health Organ 60: 253–260.

20. World Health Organization (1991) Facilitator guide for the EPI coverage survey. Available: http://www.who.int/immunization_monitoring/routine/Facilitator_guide_EPI_coverage_survey.pdf. Accessed 3 January 2013.

21. World Health Organization (2005) Immunization coverage cluster survey—reference manual. Available: http://whqlibdoc.who.int/hq/2005/WHO_IVB_04.23.pdf. Accessed 29 October 2012.

22. GraisRF, RoseAMC, GuthmannJP (2007) Don't spin the pen: two alternative methods for second-stage sampling in urban cluster surveys. Emerg Themes Epidemiol 4: 8.

23. LumanET, WorkuA, BerhaneY, MartinR, CairnsL (2007) Comparison of two survey methodologies to assess vaccination coverage. Int J Epidemiol 36: 633–641.

24. MilliganP, AlphaN, BennettS (2004) Comparison of two cluster sampling methods for health surveys in developing countries. Int J Epidemiol 33: 469–476.

25. MyattM, FelekeT, SadlerK, CollinsS (2005) A field trial of a survey method for estimating the coverage of selective feeding programmes. Bull World Health Organ 83: 20–26.

26. TurnerAG, MagnaniRJ, ShuaibM (1996) A not quite as quick but much cleaner alternative to the Expanded Programme on Immunization (EPI) cluster survey design. Int J Epidemiol 25: 198–203.

27. World Health Organization (2012) Sample design and procedures for hepatitis B immunization surveys: a companion to the WHO cluster survey reference manual. Available: http://whqlibdoc.who.int/hq/2011/WHO_IVB_11.12_eng.pdf. Accessed 29 August 2012.

28. CotterB, BremerV, StrohG, MsambichakaK, MabuzaneE, et al. (2003) Assessment of neonatal tetanus elimination in an African setting by lot quality assurance cluster sampling (LQA-CS). Epidemiol Infect 130: 221–226.

29. PezzoliL, PinedaS, HalkyerP, CrespoG, AndrewsN, et al. (2009) Cluster-sample surveys and lot quality assurance sampling to evaluate yellow fever immunisation coverage following a national campaign, Bolivia, 2007. Trop Med Int Health 14: 355–361.

30. KimSH, PezzoliL, YacoubaH, CoulibalyT, DjingareyMH, et al. (2012) Whom and where are we not vaccinating? Coverage after the introduction of a new conjugate vaccine against group A meningococcus in Niger in 2010. PLoS ONE 7: e29116 doi:10.1371/journal.pone.0029116.

31. World Health Organization (2012) Assessing vaccination coverage levels using clustered Lot Quality Assurance Sampling: field manual—version edited for the Global Polio Eradication Initiative (GPEI). Available: http://www.polioeradication.org/Portals/0/Document/Research/OPVDelivery/LQAS.pdf. Accessed 29 August 2012.

32. JahnA, FloydS, MwinukaV, MwafilasoJ, MwagombaD, et al. (2008) Ascertainment of childhood vaccination histories in northern Malawi. Trop Med Int Health 13: 129–138.

33. CuttsFT, SmithPG, ColomboS, MannG, AscherioA, et al. (1990) Field evaluation of measles vaccine efficacy in Mozambique. Am J Epidemiol 131: 349–355.

34. World Health Organization (2012) World immunization week 2012. Available: http://www.who.int/immunization/newsroom/events/immunization_week/en/index.html. Accessed 15 May 2012.

35. GareaballahET, LoevinsohnBP (1989) The accuracy of mother's reports about their children's vaccination status. Bull World Health Organ 67: 669–674.

36. LangstenR, HillK (1998) The accuracy of mothers' reports of child vaccination: evidence from rural Egypt. Soc Sci Med 46: 1205–1212.

37. ValadezJJ, WeldLH (1992) Maternal recall error of child vaccination status in a developing nation. Am J Public Health 82: 120–122.

38. ClarkA, SandersonC (2009) Timing of children's vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet 373: 1543–1549.

39. DayanGH, ShawKM, BaughmanAL, OrellanaLC, ForlenzaR, et al. (2006) Assessment of delay in age-appropriate vaccination using survival analysis. Am J Epidemiol 163: 561–570.

40. LumanET, BarkerLE, ShawKM, McCauleyMM, BuehlerJW, et al. (2005) Timeliness of childhood vaccinations in the United States. JAMA 293: 1204–1211.

41. BabiryeJN, EngebretsenIMS, MakumbiF, FadnesLT, WamaniH, et al. (2012) Timeliness of childhood vaccinations in Kampala Uganda: a community-based cross-sectional study. PLoS ONE 7: e35432 doi:10.1371/journal.pone.0035432.

42. EiseleT, RhodaDA, CuttsFT, KeatingJ, RenR, et al. (2013) Measuring coverage in MNCH: Total survey error and the interpretation of intervention coverage estimates from household surveys. PLoS Med 10: e1001386 doi:10.1371/journal.pmed.1001386.

43. BennettS, RadalowiczA, VellaV, TomkinsA (1994) A computer simulation of household sampling schemes for health surveys in developing countries. Int J Epidemiol 23: 1282–1291.

44. LemeshowS, TserkovnyiAG, TullochJL, DowdJE, LwangaSK, et al. (1985) A computer simulation of the EPI survey strategy. Int J Epidemiol 14: 473–481.

45. Brown J, Monasch R, Bicego G, Burton A, Boerma JT (2002) An assessment of the quality of national child immunization coverage estimates in population-based surveys. Chapel Hill (North Carolina): MEASURE Evaluation, Carolina Population Center, University of North Carolina at Chapel Hill. Available: http://www.cpc.unc.edu/measure/publications/wp-02-53/at_download/document. Accessed 29 August 2012.

46. Little RJA, Rubin DB (2002) Statistical analysis with missing data. Hoboken (New Jersey): John Wiley & Sons.

47. Schafer JL (1997) Analysis of incomplete multivariate data. Boca Raton (Florida): Chapman & Hall/CRC.

48. Rutstein SO, Rojas G (2006) Guide to DHS statistics. Calverton (Maryland): Demographic and Health Surveys, ORC Macro.

49. Bosch-CapblanchX, BanerjeeK, BurtonA (2012) Unvaccinated children in years of increasing coverage: how many and who are they? Evidence from 96 low- and middle-income countries. Trop Med Int Health 17: 697–710.

50. de QuadrosCA, OliveJM, HershBS, StrassburgMA, HendersonDA, et al. (1996) Measles elimination in the Americas. Evolving strategies. JAMA 275: 224–229.

51. SimonsE, FerrariM, FricksJ, WannemuehlerK, AnandA, et al. (2012) Assessment of the 2010 global measles mortality reduction goal: results from a model of surveillance data. Lancet 379: 2173–2178.

52. OrensteinWA, BernierRH, DonderoTJ, HinmanAR, MarksJS, et al. (1985) Field evaluation of vaccine efficacy. Bull World Health Organ 63: 1055–1068 Available: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2536484/pdf/bullwho00089-0084.pdf. Accessed 29 August 2012.

53. BhartiN, TatemAJ, FerrariMJ, GraisRF, DjiboA, et al. (2011) Explaining seasonal fluctuations of measles in Niger using nighttime lights imagery. Science 334: 1424–1427.

54. BrownDW (2012) Child immunization cards: essential yet underutilized in national immunization programmes. Open Vaccine J 5: 1–7.

55. World Health Organization (2011) India: WHO and UNICEF estimates of immunization coverage: 2011 revision. Available: http://www.who.int/immunization_monitoring/data/ind.pdf. Accessed 29 June 2012.

56. World Health Organization (2011) Nigeria: WHO and UNICEF estimates of immunization coverage: 2011 revision. Available: http://www.who.int/immunization_monitoring/data/nga.pdf. Accessed 29 August 2012.

57. World Health Organization (2006) Tetanus vaccine WHO position paper. Wkly Epidemiol Rec 85: 197–208.

58. IzurietaH, VenczelL, DietzV, TambiniG, BarrezuetaO, et al. (2003) Monitoring measles eradication in the region of the Americas: critical activities and tools. J Infect Dis 187: S133–S139.

59. CuttsF, HallA (2004) Vaccines for neonatal viral infections: hepatitis B vaccine. Expert Rev Vaccines 3: 349–352 Accessed 29 August 2012.

60. TapiaMD, PasettiMF, CuberosL, SowSO, DoumbiaMN, et al. (2006) Measurement of tetanus antitoxin in oral fluid: a tool to conduct serosurveys. Pediatr Infect Dis J 25: 819–825.

61. FortuinM, MaineN, MendyM, HallA, GeorgeM, et al. (1995) Measles, polio and tetanus toxoid antibody levels in Gambian children aged 3 to 4 years following routine vaccination. Trans R Soc Trop Med Hyg 89: 326–329.

62. NigatuW, NokesD, EnquselassieF, BrownD, CohenB, et al. (1999) Detection of measles specific IgG in oral fluid using an FITC/anti-FITC IgG capture enzyme linked immunosorbent assay (GACELISA). J Virol Methods 83: 135–144.

63. NigatuW, SamuelD, CohenB, CumberlandP, LemmaE, et al. (2008) Evaluation of a measles vaccine campaign in Ethiopia using oral-fluid antibody surveys. Vaccine 26: 4769–4774.

64. Ahmed S, Ali D, Bisharat L, Hill A, LaFond A, et al.. (2009) Evaluation of UNICEF Multiple Indicator Cluster Surveys round 3 (MICS3) final report. Boston (Massachusetts): John Snow. Available: http://www.unicef.org/evaldatabase/files/MICS.pdf. Accessed 29 August 2012.

65. RheingansR, AtherlyD, AndersonJ (2012) Distributional impact of rotavirus vaccination in 25 GAVI countries: estimating disparities in benefits and cost-effectiveness. Vaccine 30 (Suppl 1) A15– A23 Available: http://ac.els-cdn.com/S0264410X12000333/1-s2.0-S0264410X12000333-main.pdf?_tid=41e1f1f9a28236cbe2409273fa8fecc4&acdnat=1340737914_ce1e78df52b569cf4a045350c373885c. Accessed 29 August 2012.

66. RhodaDA, FernandezSA, FitchDJ, LemeshowS (2010) LQAS: user beware. Int J Epidemiol 39: 60–68.

67. World Health Organization (2012) Table 2: summary of WHO position papers—recommended routine immunizations for children. Available: http://www.who.int/immunization/policy/Immunization_routine_table2.pdf. Accessed 23 July 2012.