Implementation Research Needed

• Introduction
• Weak Health Systems in Poor Countries
• Implementation Research Has Been Neglected
• Gaps Between Knowledge and Action
• The Scope of Health Systems Research
• Building HSR Capacity
• The Next Steps
• References

Introduction

Because interventions directed at health improvement require, for optimal implementation, infrastructure, equipment, supplies, and competent personnel in adequate numbers, together with intersectoral actions to address the underlying determinants of health, the term "health systems" is increasingly used. Health systems can broadly be described as containing the following principal components: structures, equipment and supplies, policies (technical priorities, financing), people (their numbers, distribution, and skills mix), and processes (how people function within the system and in relation to other sectors). How these components articulate with one another and the communities in which they are based, their effectiveness, and opportunities for modification are also framed by the social and political context in which they have evolved.

This essay focuses on health systems research (HSR). It begins with an overview of the crisis in health, health systems, and HSR in low-income countries, with a special focus on Africa. Then, it discusses an issue that has come to be termed the "knowledge-implementation gap," focusing particularly on those types of HSR most concerned with implementation (Sidebar 1). Some of the key obstacles to correcting this gap are identified, and the essay concludes with some suggestions for actions that can be taken to increase the quantity and quality of HSR.

Weak Health Systems in Poor Countries

The gap in infant mortality and life expectancy between rich and poor countries is widening substantially. Sub-Saharan Africa is the starkest example of this growing divide. A combination of new and old infectious diseases (in particular HIV infection) and rising rates of injuries have resulted in the populations of countries such as Kenya, South Africa, Zambia, and Zimbabwe losing more than 10 years in life expectancy in a short period of time.² In many of these countries, this situation is exacerbated by public health services that have been seriously weakened by chronic underfunding and loss of personnel, with an accelerating "brain drain" that is reaching crisis proportions and raising ethical questions regarding recruitment by wealthy countries.^3,4 Health system dysfunction has been aggravated by ill-considered and inappropriate reforms in the health sector.⁵ A stark reflection of these weakened health systems was the stagnation in immunization rates over the 1990s for the six basic childhood vaccines in many poor countries, despite impressive increases in coverage during the 1980s, the availability of more and improved vaccines, and the subsequent intensive World Health Organization (WHO)-driven campaigns for the eradication of polio and measles.⁶

These challenges will require the implementation of policies that ameliorate the above underlying factors. Research can assist in achieving this but should stress health determinants, population health perspectives, HSR with a focus on implementation, and studies of the effectiveness of strategies designed to bring about equitable social and economic change.

Thus, the Mexico Statement from the Ministerial Summit on Health Research, which took place in Mexico City in November 2004, among other things calls on governments to allocate adequate funds to support HSR in order to address priority questions.⁷

Implementation Research Has Been Neglected

Health research of the types described above remains only a small fraction of global health research and a tiny proportion of expenditure on health in low-income settings. Recent estimates suggest that only about 0.017% of health expenditure in low- and middle-income countries (around US$134 million) is devoted to such research.⁸

In public health research, the focus has traditionally been predominantly on descriptive and analytic epidemiological research ("what," "why," "where," and "who"). There is growing funding for intervention research, particularly for drugs, vaccines, and other products that could benefit the poor through sources such as the Bill & Melinda Gates Foundation (www.gatesfoundation.org) and the European and Developing Country Clinical Trials Partnership (www.edctp.org). However, there is still little funding for, and, therefore, a relative dearth of implementation research, particularly in low-income settings (such research addresses the "how" of translating current research knowledge into practice within health and social systems).^9,10

Gaps Between Knowledge and Action

In developed countries, implementation research focuses particularly on how to promote the uptake of research findings -- for example, by evaluating a variety of strategies to enhance the use of clinical guidelines. A recent overview¹¹ suggests that different approaches might affect different behaviors. For example, reminders may be particularly appropriate for improving preventive behaviors such as immunization and screening, feedback on performance may be effective for rationalizing the ordering of diagnostic tests, and financial interventions may be effective in promoting more rational prescribing.

However, overall these effect sizes are modest, generally resulting in a less than 10% improvement in practice. Combinations of a number of interventions appear to be no more effective than single interventions, perhaps because we still do not understand which combinations work best in which circumstances.¹¹ A recent review suggests that some approaches, such as supportive supervision and audit with feedback, may be effective in low-income settings, but more research is needed -- not just on specific approaches to improving the quality of care, but also on the health systems environment that will sustain accessible and high-quality care over time.¹²

Health systems research remains marginalized and has been dominated in the past decade by cost-effectiveness studies that have been promoted by international institutions and incorporated by governments as components of their health sector reform and rationing policies. Such research needs to be complemented by a stronger focus on the development and functioning of health systems, using a combination of quantitative and qualitative methods, including the use of action research that involves practitioners in critical reflections on their own practice. In addition, detailed and comparative case studies of the results of long-term implementation of (especially complex) interventions are needed to identify those program and contextual factors that lead to success in health development. Health systems research has the powerful potential to bridge the implementation gap through testing and evaluating activities and systems while simultaneously enhancing the capacity of health staff to evaluate and improve their own performance.^13,14

However, gaps between knowledge and action persist, with serious consequences for health. For example, full use of existing interventions would cut the more than 10 million annual child deaths that occur globally by more than 60%.¹⁵ A high proportion of the half million or so maternal deaths that occur globally every year could also be prevented by promoting access to interventions and services of known efficacy.¹⁶ While these problems are seen at their most extreme in low-income countries, they are certainly not restricted to such settings. Studies in Europe and North America show that between 30% and 60% of patients do not receive effective treatment for common conditions such as asthma, heart failure, and high blood pressure.^17,18

The Scope of Health Systems Research

Since HSR constitutes a relatively new and underdeveloped field, it is important that its scope is defined and the factors inhibiting its development are identified and addressed. A WHO Task Force on HSR recently identified a number of topics for HSR (Sidebar 2) and made recommendations on how such research could be scaled up¹⁹ (more detailed descriptions of each topic and the rationale for addressing them are given in Reference 20).

Sidebar 3 gives an example of HSR that took place in the impoverished former Transkei "homeland" in South Africa. This example includes aspects of a number of the HSR topics listed in Sidebar 2, such as human resources for health at the district level and below; equitable, effective, and efficient health care; and effective approaches for intersectoral engagement in health.

In some circumstances, health system interventions can be evaluated using randomized trials -- particularly cluster trials, where the unit of randomization may be communities or health facilities. A recent example is a cluster trial of a participatory intervention with women's groups to improve maternal and neonatal mortality in Nepal.²¹ Many research questions, however, cannot be addressed by randomized trials -- for example, because they may be system-wide in scope. Other approaches need to be considered, such as controlled before-and-after studies and interrupted time-series analyses and process evaluations to better understand how and why interventions work or do not work as intended. Participatory action research, which is a family of research methodologies that pursue action (or change) and research (or understanding) at the same time,²² has the potential to both elucidate constraints to the success of interventions and improve the performance of health staff (as described in Sidebar 3).²³

Building HSR Capacity

Health systems research capacity is as yet limited in almost all countries. It is an interdisciplinary endeavor that demands not only technical expertise but also expertise in relating to and working with policymakers and other decision-makers in developing research agendas, conducting and interpreting research, and supporting action based on the findings. While training plays an important role in developing research capacity, expertise also has to be built "on the job," by doing research initially under supervision.

We need larger and more widely applicable research programs that compare policies and interventions in a range of settings, assess the impact of global factors, and build HSR capacity. These could all be more easily achieved through the development of multi-country collaborative HSR networks.

At a time when substantial sums are being made available for the purchase of efficacious interventions and the development of more effective drugs, vaccines, and other products, it is essential to channel more resources to address the preparedness of health systems for delivering these interventions.

The Next Steps

Educational and research institutions need to rapidly build capacity in this area of research, especially within the field of public health, since it is health systems that are the focus. These institutions need to be encouraged to do this by the creation of both financial and non-financial incentives. The latter come mainly from publication prestige (which, in some countries, is accompanied by financial reward to the institution or author) -- hence, it is urgent that journals, especially those with high impact factors, encourage submission of articles in this area, and (where they meet the required standards) facilitate their expeditious publication. Unlike research leading to the development of pharmaceuticals, vaccines, or other health-related products, HSR has no substantial sponsorship from the private sector. Research bodies and donors can thus play an important role by calling for and funding HSR, and especially implementation research; the derisory amounts currently being spent on HSR need to rapidly increase if the benefits of much existing and new knowledge are to be realized.

Advocacy for HSR in general, and implementation research specifically, also needs to be strengthened. Policymakers can play an important role, both by demanding such research and by ensuring that health-service managers and practitioners see the value of evidence regarding the effectiveness of their activities and even acquire some skills in HSR themselves. The ongoing evaluation of the Integrated Management of Childhood Illness program offers an indication of the potential benefits of evaluating a major international health program that aims to promote the uptake of high-quality care based on research evidence.^24,25 Such evaluations can both demonstrate the positive impacts of such programs and highlight aspects that require further development if their full benefits are to be achieved, such as low rates of referral among children with severe illness. Presently, civil society organizations and selected research alliances are taking a lead in advocating more research in this area.²⁶ But until mainstream research organizations actively promote such research, and policymakers demand that the implementation of interventions and programs is rigorously evaluated, the unconscionable gap between knowledge and its implementation will persist in the health field.

David Sanders is Professor and Director of the School of Public Health at the University of the Western Cape, Bellville, South Africa, and an honorary Professor at the London School of Hygiene and Tropical Medicine. Andy Haines is Director of the London School of Hygiene and Tropical Medicine. Correspondence should be addressed to David Sanders at dsanders@uwc.ac.za.

Editor's Note: Reprinted with permission from the Public Library of Science (www.plos.org). Original citation: Sanders D, Haines A. Implementation research is needed to achieve international health goals. PLoS Med 2006;3(6):e186. © 2006 Sanders and Haines.

References

1. United Nations Department of Economic and Social Affairs. Report on the World Social Situation. New York: UN Division for Social Policy and Development; 2005. (Accessed July 12, 2006.)

2. Sanders D, Dovlo D, Meeus W, Lehmann U. Public health in Africa. In: Beaglehole R, ed. Global Public Health: A New Era. Oxford: Oxford University Press; 2003.

3. Padarath A, Chamberlain C, McCoy D, et al. Health personnel in Southern Africa: Confronting maldistribution and brain drain. Equinet discussion paper number 4; 2003. (Accessed July 12, 2006.)

4. Sanders D, Lloyd B. Human resources: International context. In: Ijumba P, Barron P, eds. South African Health Review 2005. Durban: Health Systems Trust; 2005:76-87. (Accessed July 12, 2006.)

5. Gilson L, Mills A. Health sector reforms in sub-Saharan Africa: Lessons of the last 10 years. Health Policy. 1995;32(1-3):215-243.

6. Simms C, Rowson M, Peattie S. The Bitterest Pill of All: The Collapse of Africa's Health Systems. London: Medact; 2001. (Accessed July 12, 2006.)

7. Ministerial Summit on Health Research. The Mexico Statement on Health Research. Mexico City: Ministerial Summit on Health Research; 2004. (Accessed July 12, 2006.)

8. Alliance for Health Policy and Systems Research. Strengthening Health Systems in Developing Countries: The Promise of Research on Policy and Systems. Geneva: Alliance for Health Policy and Systems Research, 2004. (Accessed March 20, 2006.)

9. Chopra M, Sanders D. Asking "how?" rather than "what, why, where, and who?" BMJ. 2000;321:832.

10. de Zoysa I, Habicht JP, Pelto GH, Martines J. Research steps in the development and evaluation of public health interventions. Bull World Health Organ. 1998;76:127-133.

11. Grimshaw JM, Thomas RE, MacLennan G, et al. (2004) Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1-72.

12. Rowe AK, de Savigny D, Lanata CF, Victora CG. How can we achieve and maintain high quality performance of health workers in low-resource settings? Lancet. 2005;366:1606.

13. Ashworth A, Chopra M, McCoy D, et al. Effectiveness of the WHO guidelines for management of severe malnutrition in rural South African hospitals: Impact on case fatality and the influence of operational factors. Lancet. 2004;363:1110-1115.

14. Puoane T, Sanders D, Chopra M, et al. Evaluating the clinical management of severely malnourished children -- A study of two rural district hospitals. S Afr Med J. 2001;91:137-141.

15. Jones G, Stekettee RW, Black RE, Bhutta ZA, Morris SS and the Bellagio Child Survival Study Group. How many child deaths can we prevent this year? Lancet. 2003; 362(9377):65-71.

16. Wagstaff A, Claeson M. The Millennium Development Goals for Health: Rising to the Challenges. Washington DC: World Bank Publications; 2004.

17. Schuster M, McGlynn E, Brook R. How good is the quality of medical care in the United States? Milbank Q. 1998;76(4):517-563.

18. Freemantle N, Nazareth I, Eccles M, Wood J, Haines A. A randomised controlled trial of the effect of educational outreach by community pharmacists on prescribing in UK general practice. Br J Gen Pract. 2002:52(477):290-295.

19. Task Force on Health Systems Research. Informed choices for attaining the Millennium Development Goals: Towards an international cooperative agenda for health systems research. Lancet. 2004;364(9438):997-1003.

20. Task Force on Health Systems Research. The Millennium Development Goals Will Not Be Attained Without New Research Addressing Health System Constraints to Delivering Effective Interventions. Geneva: World Health Organization; 2005. (Accessed July 12, 2006.)

21. Manandhar D, Osrin D, Shrestha B, et al. Effect of a participatory intervention with women's groups on birth outcomes in Nepal: Cluster-randomised controlled trial. Lancet. 2004;364(9438):970-979.

22. Dick B. What is action research? Lismore (New South Wales): Southern Cross University; 1999. (Accessed July 12, 2006.)

23. Puoane T, Sanders D, Ashworth A, Chopra M, Strasser S. Improving the hospital management of malnourished children by participatory research. Int J Qual Health Care. 2004;16(1):31-40.

24. El Arifeen S, Blum LS, Hoque DM, et al. Integrated management of childhood illness (IMCI) in Bangladesh: Early findings from a clusterrandomised study. Lancet. 2004;364(9445):1595-1602.

25. Armstrong Schellenberg JR, Adam T, Mshinda H, et al. Effectiveness and cost of facility-based Integrated Management of Childhood Illness (IMCI) in Tanzania. Lancet. 2004;364(9445):1583-1594.

26. McCoy D, Sanders D, Baum F, Narayan T, Legge D. Pushing the international health research agenda towards equity and effectiveness. Lancet. 2004;364(9445):1630-1631.