Configuring Balanced Scorecards for Measuring Health System Performance: Evidence from 5 Years' Evaluation in Afghanistan

English version České info

Background:
In 2004, Afghanistan pioneered a balanced scorecard (BSC) performance system to manage the delivery of primary health care services. This study examines the trends of 29 key performance indicators over a 5-year period between 2004 and 2008.

Methods and Findings:
Independent evaluations of performance in six domains were conducted annually through 5,500 patient observations and exit interviews and 1,500 provider interviews in >600 facilities selected by stratified random sampling in each province. Generalized estimating equation (GEE) models were used to assess trends in BSC parameters. There was a progressive improvement in the national median scores scaled from 0–100 between 2004 and 2008 in all six domains: patient and community satisfaction of services (65.3–84.5, p<0.0001); provider satisfaction (65.4–79.2, p<0.01); capacity for service provision (47.4–76.4, p<0.0001); quality of services (40.5–67.4, p<0.0001); and overall vision for pro-poor and pro-female health services (52.0–52.6). The financial domain also showed improvement until 2007 (84.4–95.7, p<0.01), after which user fees were eliminated. By 2008, all provinces achieved the upper benchmark of national median set in 2004.

Conclusions:
The BSC has been successfully employed to assess and improve health service capacity and service delivery using performance benchmarking during the 5-year period. However, scorecard reconfigurations are needed to integrate effectiveness and efficiency measures and accommodate changes in health systems policy and strategy architecture to ensure its continued relevance and effectiveness as a comprehensive health system performance measure. The process of BSC design and implementation can serve as a valuable prototype for health policy planners managing performance in similar health care contexts.

: Please see later in the article for the Editors' Summary

Vyšlo v časopise: Configuring Balanced Scorecards for Measuring Health System Performance: Evidence from 5 Years' Evaluation in Afghanistan. PLoS Med 8(7): e32767. doi:10.1371/journal.pmed.1001066
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pmed.1001066

Souhrn

Zdroje

1. BelayT 2010 Building on early gains challenges and options for Afghanistan's health and nutrition sector. Washington (D.C.) World Bank

2. ReilleyBFrankTProchnowTPuertasGVan Der MeerJ 2004 Provision of health care in rural Afghanistan: needs and challenges. Am J Public Health 94 1686 1688

3. BartlettLAMawjiSWhiteheadSCrouseCDalilS 2005 Where giving birth is a forecast of death: maternal mortality in four districts of Afghanistan, 1999-2002. Lancet 365 864 870

4. UNICEF 2006 Best estimates of social indicators for children in Afghanistan 1990-2005. New York United Nations Children's Fund

5. WaldmanRStrongLWaliA December 2006 Afghanistan's health system since 2001: condition improved, prognosis cautiously optimistic. Kabul Afghanistan Research and Evaluation Unit: Briefing Paper Series

6. MOPH March 2003 A basic package of health services for Afghanistan. Kabul Islamic Transitional Government of Afghanistan

7. SavignyDdAdamT 2009 Systems thinking for health systems strengthening. Alliance for health policy and health systems strengthening. Geneva Alliance for Health Policy and Systems Research, World Health Organization

8. KaplanRSNortonDP 1996 The balanced scorecrad: translating strategy into action. Boston Harvard Business School Press

9. NivenPR 2003 Balanced scorecard step-by-step for government and nonprofit agencies. Hoboken (New Jersey) John Wiley & Sons

10. ZelmanWNPinkGHMatthiasCB 2003 Use of the balanced scorecard in health care. J Health Care Finance 29 1 16

11. InamdarNKaplanRSBowerM 2002 Applying the balanced scorecard in healthcare provider organizations. J Healthc Manag 47 179 195; discussion 195-176

12. KlassenAMillerAAndersonNShenJSchiaritiV 2010 Performance measurement and improvement frameworks in health, education and social services systems: a systematic review. Int J Qual Health C 22 44 69

13. PetersDHNoorAASinghLPKakarFKHansenPM 2007 A balanced scorecard for health services in Afghanistan. Bull World Health Organ 85 146 151

14. ten AsbroekAHArahOAGeelhoedJCustersTDelnoijDM 2004 Developing a national performance indicator framework for the Dutch health system. Int J Qual Health C 16 i65 71

15. ImpagliazzoCIppolitoAZoccoliP 2009 The balanced scorecard as a strategic management tool: its application in the regional public health system in Campania. Health Care Manag (Frederick) 28 44 54

16. RabbaniFJafriSMAbbasFShahMAzamSI 2010 Jan-Mar Designing a balanced scorecard for a tertiary care hospital in Pakistan: a modified Delphi group exercise. Int J Health Plann Manage 25 74 90

17. ChanGJParcoKBSihombingME 2010 Improving health services to displaced persons in Aceh, Indonesia: a balanced scorecard. Bull World Health Organ 88 709 712

18. HansenPMPetersDHNiayeshHSinghLPDwivediV 2008 Measuring and managing progress in the establishment of basic health services: the Afghanistan health sector balanced scorecard. Int J Health Plann Manage 23 107 117

19. Rabe-HeskethSSkrondalA 2005 Multilevel and longitudinal modeling using Stata. College Station (Texas) Stata Press

20. ArurAPetersDHansenPMashkoorMASteinhardtLC 2010 Contracting for health and curative care use in Afghanistan between 2004 and 2005. Health Policy Plan 25 135 144

21. EdwardADwivediVMustafaLHansenPMPetersDH 2009 Trends in the quality of health care for children aged less than 5 years in Afghanistan, 2004-2006. Bull World Health Organ 87 940 949

22. LozanoRSolizPGakidouEAbbott-KlafterJFeehanDM 2006 Benchmarking of performance of Mexican states with effective coverage. Lancet 368 1729 1741

23. AidemarkLG 2010 Cooperation and competition: balanced scorecard and hospital privatization. Int J Health Care Qual Assur Inc Leadersh Health Serv 23 730 748

24. RoweAKde SavignyDLanataCFVictoraCG 2005 How can we achieve and maintain high-quality performance of health workers in low-resource settings? Lancet 366 1026 1035

25. LogieDERowsonMNdagijeF 2008 Innovations in Rwanda's health system: looking to the future. Lancet 372 256 261

26. BulmerMWarwickDP 1993 Social research in developing countries: surveys and censuses in the Third World. London UCL Press

27. London T (May 2009) Making better investments at the base of the pyramid. Harv Bus Rev

28. The World Bank 2001 Filipino report card on pro-poor services. Environment and Social Development Unit, East Asia and Pacific Region Washington (D.C.) World Bank

29. GroeneOBrandtESchmidtWMoellerJ 2009 The balanced scorecard of acute settings: development process, definition of 20 strategic objectives and implementation. Int J Qual Health C 21 259 271

30. WeirEd'EntremontNStalkerSKurjiKRobinsonV 2009 Applying the balanced scorecard to local public health performance measurement: deliberations and decisions. BMC Public Health 9 127

31. RabbaniFJafriSMAbbasFPappasGBrommelsM 2007 Reviewing the application of the balanced scorecard with implications for low-income health settings. J Healthc Qual 29 21 34

32. SmithPMossialosEPapanicholasI 2009 Performance measurement for health system improvement. Experiences, challenges and prospects New York Cambridge University Press

33. ReichMRTakemiK 2009 G8 and strengthening of health systems: follow-up to the Toyako summit. Lancet 373 508 515