POLICY AND PRACTICE

 

Making research matter: a civil society perspective on health research

 

Donner plus d'importance à la recherche : un point de vue de la société civile sur la recherche en santé

 

Dar más importancia a la investigación: papel de la sociedad civil en las investigaciones sanitarias

 

 

David SandersI,1; Ronald LabonteII; Fran BaumIII; Mickey ChopraI

ISchool of Public Health, University of the Western Cape, Bellville 7535, South Africa
IISaskatchewan Population Health and Evaluation Research Unit; Community Health and Epidemiology, University of Saskatchewan, Canada; and Faculty of Kinesiology and Health Studies, University of Regina, Canada
IIIDepartment of Public Health, Flinders University, Adelaide, Australia

 

 


ABSTRACT

Complex global public health challenges such as the rapidly widening health inequalities, and unprecedented emergencies such as the pandemic of human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS) demand a reappraisal of existing priorities in health policies, expenditure and research. Research can assist in mounting an effective response, but will require increased emphasis on health determinants at both the national and global levels, as well as health systems research and broad-based and effective public health initiatives. Civil society organizations (CSOs) are already at the forefront of such research. We suggest that there are at least three ways in which the participation of CSOs in research can be increased: namely, influencing commissioning and priority-setting; becoming involved in the review process and in conducting research; and through formal partnerships between communities and universities that link CSOs with academic researchers.

Keywords: Health services research; Delivery of health care; Nongovernmental organizations; Primary health care; Epidemiologic factors; Health priorities; Policy making; Social justice; Consumer participation; Evidence-based medicine (source: MeSH, INSERM).


RÉSUMÉ

Les défis complexes auxquels est confrontée la santé publique à l'échelle mondiale, tels que l'élargissement rapide des inégalités devant la santé et les urgences sans précédent comme la pandémie de VIH/SIDA, exigent une réévaluation des priorités actuelles des politiques, des dépenses et des recherches dans le domaine sanitaire. La recherche peut aider à mettre sur pied une réponse efficace, mais elle devra mettre davantage l'accent sur les déterminants sanitaires, tant au niveau national, que mondial, ainsi que sur les systèmes de santé et les initiatives de santé publique présentant une large assise et une grande efficacité. Les organisations de la société civile (OSC) sont déjà aux avants postes de telles recherches. L'article suggère qu'il existe au moins trois manières d'accroître la participation des OSC dans la recherche, à savoir influer sur l'attribution des projets et la fixation des priorités, participer au processus d'examen par les pairs et à la conduite de recherches et s'impliquer dans des partenariats formels entre les communautés et les universités, liant les OSC aux chercheurs universitaires.

Mots clés: Recherche en santé publique; Délivrance soins; Organisations non gouvernementales; Soins santé primaires; Facteurs épidémiologiques; Choix d'une politique; Justice sociale; Participation consommateurs; Médecine factuelle (source: MeSH, NLM).


RESUMEN

Los complejos desafíos de la salud pública mundial, como el rápido aumento de las desigualdades sanitarias, y la irrupción de emergencias sin precedentes como la pandemia de virus de inmunodeficiencia humana/síndrome de inmunodeficiencia adquirida (VIH/SIDA) exigen una reevaluación de las actuales prioridades de las políticas, los gastos y la investigación sanitarias. La investigación puede ayudar a articular respuestas eficaces, pero para ello hay que hacer más hincapié en los factores determinantes de la salud a nivel nacional y mundial, así como en las investigaciones sobre sistemas de salud y en las iniciativas de salud pública generales y eficaces. Las organizaciones de la sociedad civil (OSC) están ya a la vanguardia de esas investigaciones. Sugerimos que hay al menos tres opciones para ampliar la participación de las OSC en las investigaciones; a saber: su influencia en el encargo de trabajos y la fijación de prioridades; su implicación en el proceso de revisión y la realización de investigaciones; y el establecimiento de fórmulas formales de colaboración entre comunidades y universidades que vinculen a las OSC con los investigadores del ámbito académico.

Palabras clave: Investigación sobre servicios de salud; Prestación de atención de salud; Organizaciones no gubernamentales; Atención primaria de salud; Factores epidemiológicos; Formulación de políticas; Justicia social; Participación comunitaria; Medicina basada en evidencia (fuente: DeCS, BIREME).



 

 

Introduction

It has taken an epidemic of the magnitude of that of human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS) to prompt a re-examination of the policies and actions required to achieve health for all. This challenge will require interventions that ameliorate the underlying local and global social and environmental health determinants, ensure greater equity in access to sustainable health systems and assist in the rebuilding of public health capacity in poor countries and poor communities.

Research can assist in achieving these goals, but will require increased emphasis on global, national and local health determinants. It should stress population health perspectives, health systems research with a focus on implementation, and studies of the effectiveness of strategies designed to bring about progressive social and economic change. Civil society organizations (CSOs) can play an important role by influencing, generating or using such research. CSOs are already taking the lead in research investigating the broader determinants of health at the global and national levels. Examples of participatory research also show how engagement with CSOs can improve health systems. Experience demonstrates that research findings are more successfully implemented when they are part of campaigns involving mobilized groups of citizens.

There is a growing realization of the need for engagement with civil society. However, "civil society" is a problematic term. Broadly, it refers to social relationships and organizations outside either state (government) functions, or market-based relations that define people simply as "consumers" rather than more collectively, for example as citizens, neighbours or colleagues. In a narrower context, civil society includes organized groups concerned with public interests. For the purposes of the present study we have excluded organizations aimed at promoting private business interests. We see CSOs as a broad grouping that incorporates nongovernmental organizations (NGOs) and less formally organized groups that may be based in local communities such as youth groups or women's groups. This article, presents a "civil society perspective", and although it draws on the authors' combined 90 years of experience in working in and with CSOs, it should not be interpreted as the civil society perspective. The plurality of CSO interests precludes any such interpretation.

There are at least four different and non-exclusive ways in which civil society is involved in health research:

• as funders (primarily the charitable disease-based health organizations such as "heart and stroke" or "cancer" societies);

• as users (which raises the issue of the relevance of health research to CSOs);

• as generators (whether or not in some form of relationship with university-based researchers); and

• as subjects (the role of CSOs in affecting policy and broader social changes that improve health equity).

Any health research that gathers information from individuals or groups in the context of their daily lives is also providing a civil society perspective to that research. Increasingly, local communities, particularly indigenous or disadvantaged groups that have historically been treated as passive subjects in health research, are demanding more active forms of participation in all phases of the research cycle. Active participation, and more equitable relations between researchers and community members, sometimes described as "participatory action research" can increase the relevance of the research to CSOs. The ethical and power-relational issues of the relationships between communities and researchers are vitally important, but are outside the scope of this article.

Our principal concern in this article is with the second and third relationships, i.e. with CSOs as users or generators of research knowledge. We first discuss the global context within which health research must engage, and assess the currently dominant approach to health research. We then describe what we consider to be the priorities for health research of interest to civil society, and conclude with some suggestions for increasing such research.

 

The current context of health research

A key imperative for health research must be a sharper focus on both the growing divide in health and wealth between the world's rich and poor, and on the unacceptable gap between unprecedented knowledge about diseases and their control and the implementation of that knowledge, especially in poor countries. This situation demands directed and innovative research responses to analyse the causes of this situation and to point towards solutions at the global and local levels, both within and outside the health sector.

An analysis of disaggregated data for infant mortality and life expectancy shows that the gap between rich and poor countries is widening substantially. Sub-Saharan Africa is the most notable example of this growing divide. A combination of new and old infectious diseases — in particular HIV/AIDS — and rising rates of noncommunicable diseases have resulted in the populations of countries such as Kenya, South Africa, Zambia and Zimbabwe losing more than 10 years in life expectancy in a short period of time (1). In many of these countries this situation is exacerbated by public health systems that have all but collapsed as a result of chronic underfunding and loss of personnel, with an accelerating "brain drain" that is reaching crisis proportions and raising ethical questions regarding recruitment by the wealthy countries (2, 3). The problem of dysfunctional health systems has been aggravated by ill-considered and inappropriate reforms in the health sector (4). A stark reflection of the undermining of health systems is the dramatic fall in immunization rates for the six basic childhood vaccines in poor countries, despite the impressive increases in coverage during the 1980s and the subsequent intensive WHO-driven campaigns for the eradication of polio and measles (5).

The context for this scenario is economic globalization, characterized by the growing dominance of a global financial and trading system that is rapidly integrating poor countries into an increasingly monopolized world economy and is leading to greater disparities in wealth between and within countries. For instance, in 1999, 28 of the 48 countries in sub-Saharan Africa had an average per capita income of less than US$ 1 per day, compared with 19 of 36 countries in 1981 (1). These economic changes started with structural adjustment programmes (SAPs) in the 1980s. In many countries the SAPs resulted in significant restructuring in the public sector and reduced social provision. This had negative effects on education, health and social services for the poor, particularly in Africa (6).

To make matters worse, the level of overseas development assistance (ODA) decreased substantially during the past decade and has only recently begun to increase again. However, health assistance has never represented a large portion of ODA, averaging between 4% and 6% of total multilateral assistance (1975–1998: 5-year moving average) (7).

The HIV/AIDS pandemic in sub-Saharan Africa can be considered as much a product of the increased poverty and retrenched public health systems, as of the lack of knowledge about prevention or lack of access to antiretroviral drugs (8, 9). The situation is made worse by the increasing brain drain of health professionals, including health academics and researchers, from the public to the private sector and from Africa to wealthy nations (10).

On the basis of the above considerations, health research must give priority to:

• underlying health determinants (examining the causes of the increasingly unequal burden of ill-health between and within countries);

• health systems implementation, including individual service provision, community governance models, detailed case-studies of comprehensive primary health care and population-based approaches (to determine the factors that influence the success of interventions delivered under normal programme conditions and to measure their impact); and

• strategies of social change (analysing what forms of social mobilization — local, national or global — are best able to effect policy changes for improving underlying determinants and health systems).

We contend that these issues, and their social and political contexts, are the central concern for many CSOs, and it has often been research initiated by CSOs and their advocacy that first brought these concerns to political light. Examples of the research work of CSOs are listed in Table 1. CSOs do also lobby for more basic health research into disease treatment, e.g. for HIV/AIDS, cancer and neglected diseases. Even in treatment-focused campaigns, however, CSOs often draw attention to the problems of inadequate health systems or underlying health determinants.

 

 

Health research: its current focus and relevance

Health research of the three types described above still accounts for only a small fraction of global health research. When health research, as reflected in published articles, is classified, it is clear that the overwhelming emphasis, both in terms of funding and number of publications, is on fundamental and clinical research. In public health research, the focus is predominantly on descriptive and analytical epidemiological research (i.e. research to answer the questions: what, why, where and who?). Less emphasis is placed on efficacy research (testing interventions in a controlled situation) and hardly any on implementation research — the "how" of translating current research knowledge into practice within existing health and social systems (11–13).

Efficacy research has been strengthened recently by the Cochrane Collaboration, whose focus has mainly been on conducting systematic reviews of the evidence in support of (mostly clinical) interventions. However, the Cochrane Collaboration has tended to neglect the three types of research that we argue are important to CSOs, or that provide useful information to policy-makers. This neglect derives mainly from the Cochrane Collaboration's paradigm that values quantifiable outcomes measured under controlled conditions more highly than qualitative and process-oriented outcomes. Rogers (14) examined the implicit promises of fairness in evidence-based medicine (EBM); namely to avoid discrimination through objective processes, and to distribute effective treatments fairly. Her analysis indicated that even within industrialized countries, EBM turns attention away from the sociocultural factors that influence health and focuses on a narrow biomedical and individualist model. She is pessimistic about the potential of EBM taking on an equity agenda, pointing to the dominance of commercial forces in shaping the research agenda and underpinning the 10/90 gap in research (i.e. the fact that only 10% of global health research funds are allocated towards solving those problems responsible for 90% of the world's burden of disease). Involvement of civil society groups in the design of randomized controlled trials could play a part in making EBM more responsive to equity issues.

Health systems research remains marginalized and was dominated in the past decade by cost-effectiveness studies. Central to cost-effectiveness research is the analysis of clinical and public health interventions expressed in terms of DALYs (disability-adjusted life years) saved. This form of research has been used to construct clinical and public health "packages" of interventions that are now being promoted by international institutions and incorporated by governments as components of their health sector reform policies. These packages are almost uniformly supported by governments and criticisms of them tend to come from civil society groups such as the People's Health Movement. They point out that this cost-effectiveness analysis is applied only to interventions with direct and easily measurable outcomes and not to broader inputs such as water provision, which have both direct and indirect impacts on health. This approach conflicts with and undermines comprehensive primary health care, which insists that health systems combine health care with interventions that address the underlying determinants of poor health (15–17). The comprehensive primary health-care approach recognizes the importance of human processes (e.g. community participation), and caring in health development. These approaches are less easy to subject to cost-effectiveness analysis, and the momentum to assess their worth is most likely to come from civil society which does not have ready access to research funds. Detailed and comparative case-studies of the results of long-term implementation of comprehensive primary health care are needed to identify those programme and contextual factors that lead to success in health development. Such studies may be retrospective or prospective.

While not necessarily disregarding cost-effectiveness analysis, health systems research should focus primarily on the operational aspects of the development and functioning of health systems, using a combination of quantitative and qualitative methods and involving practitioners in critical reflections on their own practice. Health systems research has a powerful potential to bridge the implementation gap through testing and evaluating activities and systems while simultaneously enhancing the capacity of health staff to evaluate and improve their performance (18, 19). CSOs can play a key role in ensuring that health systems research reflects community concerns with equity and access as much as funders' concerns with cost-effectiveness.

There has been increasing attention paid in the literature to the problem of translating research findings (even those of appropriate research) in such a way as to have an effect on practices and policies (20). A number of authors have noted that lack of understanding by researchers of policy development and decision-making processes is a significant barrier to using research (21–23). Furthermore, practitioners and policy-makers often lack the skills to use research evidence and are under such time pressure that they have little opportunity to reflect on the value of research. Such is the significance of the problem that Lomas (21) concluded that deliberate processes were needed to encourage effective research transfer and suggested that CSOs should be involved in research processes from the outset.

 

Civil society organization-oriented health research

Reducing the 10/90 gap, which primarily affects poor countries, is a fundamental civil society priority for health research (24).

The lack of equity in funding research into the causes, consequences and interventions related to the greatest burden of disease has attracted both the attention of health researchers and CSO advocacy. But even if this inequity is redressed the question remains of what type of research will be funded. The recently announced "winners" in the Bill and Melinda Gates Foundation "Grand Challenges in Global Health" emphasized technological breakthroughs in neglected diseases (25), promoting research of the "fundamental discovery", "clinical" or "product development" type. But, although worthy, these grand "technological" challenges ignore the persisting grand "political" issues that must also be addressed. These political challenges are precisely those that relate to greater equity in access to underlying social and environmental health determinants and sustainable health systems, and to rebuilding the public health research capacity in poor countries (26).

Research on underlying determinants of health

It is important that research into underlying health determinants identifies risks not only in local and national contexts, but also in a global one (26); that is, research should link local phenomena to globalization processes that condition and constrain local possibilities. The national level is also important. National governments negotiate or agree to the rules of globalization (e.g. trade agreements and conditions for debt relief or development assistance). National governments, acting within the opportunities or constraints created by globalization processes, also make decisions regarding resource allocation that can dramatically affect equity in access to services and to underlying health determinants at local levels (27, 28) (Box 1).

CSOs, many of them global in scope, have been at the forefront of research on globalization processes, although not always with an explicit health focus (Table 1). In the course of such work, they often collaborate with academic researchers. Academic researchers, in turn, make frequent use of research reported by CSOs. These reports, though not necessarily as rigorous as a formal "systematic review", reflect a breadth uncommon in most university-based research. They usually have an explicit policy focus and are often developed specifically for advocacy campaigns. The same pattern is found in local research on health determinants.

Research on health systems implementation and intervention studies

Even in poor countries, the most significant predictors of population health are income, level of education and gender equity (29). For poor groups within countries, however, untreated illness is a major barrier to both income generation and education, while spending on medical care is a major reason why many families in poor countries fall into poverty (30). Indeed, publicly funded (cross-subsidized) health systems can contribute to reducing two important underlying health risks: poverty and income inequality. A study in the Canadian province of Manitoba found that the non-cash health benefits of its publicly funded health-care system, when monetized, decreased the post-tax and transfer income ratio (the distribution of income after taxation and direct welfare (money) transfers to eligible low-income individuals has been taken into account) between the top and bottom 10% of Canadian income groups by 20% (31).

Detailed case-studies, combining quantitative and qualitative methods, generally provide the information necessary to understand why health systems do or do not work well in providing care that is not only efficient, but also effective and equitable. Health systems research needs to shed more light on the importance of, and barriers to, primary health-care approaches that link health-care interventions to underlying health determinants, and hospital-based care to community contexts, engaging citizens and CSOs in the research process. In particular, research on the mechanisms of community governance is needed to determine which models allow for effective community management. Participatory research conducted through partnerships between academics and civil society groups has much promise as a means of harnessing local knowledge and laying the foundations for the application of the knowledge generated by research (32) (Box 2).

Research on strategies for policy change

There are two aspects to consider in research on strategies for policy change. The first aspect involves examining the role of CSOs in influencing policy change in a critical manner, including their roles at different levels of political organization. Poverty action groups and trade unions, for example, have often been influential in changing welfare and minimum wage policies in wealthy countries. Global CSOs, such as Health Action International and Médecins sans Frontières, have played important roles in campaigning for domestic and international policies to ensure access to essential drugs. But not all the efforts of CSOs are effective; significant debt relief or cancellation remains elusive despite the efforts of the Jubilee campaign (33). What strategies, with what buttressing by health research, would enable greater success in lobbying for "healthy public policies"? Another set of questions relates to the representativeness and accountability of many CSOs. Are CSOs effective in enabling ordinary citizens to voice their health concerns? Or are they becoming élite groups, in particular at the global level, operating with economic rationales similar to those of the institutions they are trying to influence (34). Finally, how strong are the links between CSOs working on local health equity issues and those working at national and global levels? And are these links influencing the effectiveness of the health advocacy work of CSOs at each of these levels?

A second aspect of social change research examines the conditions under which research evidence influences policy change. Policy-making is fundamentally about power and interests, and anecdotal experience suggests that research findings are used more successfully when they are part of campaigns involving mobilized groups of citizens.

 

Conclusion

Promoting participation and partnership of civil society in health research

There are three ways in which the participation of CSOs in research — as users or as generators — can be increased. These include: influencing commissioning and priority-setting; becoming involved in the review process and in research production by changing funding rules; and through formal partnerships between communities and universities that link CSOs with academic researchers. These are not alternatives; each offers important ways in which research outputs can be influenced to reflect more closely the interests of civil society.

Currently CSO voices have very little influence over the research priorities that are set. This may in part account for the near absence of research on the social and economic determinants of health or the political economy of health, and the emphasis on diseases prevalent among the affluent populations of industrialized countries.

Opening up processes of peer review to non-academics to allow them to comment on the relevance of research may improve the increasingly criticized process of peer review (35). CSOs in both wealthy and poor countries are underrepresented in the formal processes of generating new health research. Research funding "rules" could be adapted to encourage better representation, for instance by allowing remuneration of CSO staff. The increased interest of many research funders in supporting partnerships between communities and universities also has tremendous potential. The benefits of such "partnership research" depend greatly on the quality of the relationship between academic researchers and CSOs; for example, a shared vision, overlapping theories of social organization and transformation, and respect for differing knowledge claims ("scientific" and "lay"). A critical issue for poor countries, notably those in sub-Saharan Africa, is rebuilding their academic research capacity that has been weakened by chronic underfunding and the "brain drain": this presents a challenge to north/south "partnerships" with respect to research funding and institutional support.

CSOs are mainly committed to activist campaigns aimed at changing policy and less concerned with the "reward structure" of academic research, which respects methodological rigour, peer-reviewed publications and competition for grants. A partnership approach to the generation of health research allows both academic researchers and CSO advocates to excel in their respective areas without one being subordinate to the other. Such an approach might overcome some of the historical deficit in health research, best summed up by paraphrasing one of Marx's famous theses: "Most health researchers to date have only studied the world; the point, however, is to change it for the better."

 

Acknowledgements

Professor David Sanders and Professor Fran Baum are members of the Global Steering Group of the People's Health Movement.

Conflicts of interest: none declared.

 

References

1. Sanders D, Dovlo D, Meeus W, Lehmann U. Public health in Africa. In: Beaglehole R, editor. Global public health: a new era. Oxford: Oxford University Press; 2003. p.135-55.        

2. Padarath A, Chamberlain C, McCoy D, Ntuli A, Rowson M, Loewenson R. Health personnel in Southern Africa: confronting maldistribution and brain drain. Equinet Discussion Paper Number 4. 2003. Available from: URL: www.equinetafrica.org/policy        

3. Meeus W, Sanders D. Pull factors in the migration of health professionals. Inaugural Conference of Public Health Association of South Africa. Cape Town: Public Health Association of South Africa; 2003.        

4. Gilson L, Mills A. Health sector reform in sub-Saharan Africa: lessons of the last ten years. Health Policy 1995;32:215-43.        

5. Simms C, Rowson M, Peattie S. The bitterest pill of all: the collapse of Africa's health system. Save the Children Fund Briefing Report. London: Medact; 2001.        

6. Breman A, Shelton C. Structural adjustment and health: a literature review of the debate, its role-players and presented empirical evidence. Paper No. WG6:6. Cambridge (MA): Commission on Macroeconomics and Health; 2001. Available from: URL: http://www.cmhealth.org/docs/wg6_paper6.pdf        

7. OECD. Recent trends in official development assistance to health. Paris: Organisation for Economic Co-operation and Development; 2000.        

8. Sanders D, Sambo A. AIDS in Africa: the implications of economic recession and structural adjustment. Health Policy and Planning 1991;6:157-65.        

9. Basu S. AIDS, empire, and public health behaviorism. Global Policy Forum; 2003. Available from: URL: http://www.globalpolicy.org/socecon/develop/2003/0802public.htm        

10. Sadana R, Pang T. Health research systems: a framework for the future. Bulletin of the World Health Organization 2003;81:159.        

11. Health Research and Development. What issues after the 2001 Commission on Macroeconomics and Health? Arusha, Tanzania: Global Forum on Health Research; 2002.        

12. de Zoysa I, Habicht J-P, Pelto GH, Martines J. Research steps in the development and evaluation of public health interventions. Bulletin of the World Health Organization 1998;76:127-33.        

13. Chopra M, Sanders D. Asking "how?" rather than "what, why, where, and who?" BMJ 2000;321:832.        

14. Rogers WA. Evidence-based medicine and justice: a framework for looking at the impact of EBM upon vulnerable or disadvantaged groups. Journal of Medical Ethics 2004 30:141-5.        

15. The World Bank. Investing in health. Oxford: Oxford University Press; 1993.        

16. Hunt P. Economic, social and cultural rights: the right of everyone to the enjoyment of the highest attainable standard of physical and mental health. Report of the Special Rapporteur. Geneva: Commission on Human Rights; 2003.          E/CN.4/2003/58.

17. Chopra M, Sanders D, McCoy D, Cloete K. Implementation of primary health care – package or process? South African Medical Journal 1998;88:1563-5.        

18. Ashworth A, Chopra M, McCoy D, Sanders D, Jackson D, Karaolis N, et al. Effectiveness of the WHO guidelines for management of severe malnutrition in rural South African hospitals: impact on case fatality and the influence of operational factors. Lancet 2004;363:1110-5.        

19. Puoane T, Sanders D, Chopra M, Ashworth A, Strasser S, McCoy D, et al. Evaluating the clinical management of severely malnourished children — a study of two rural district hospitals. South African Medical Journal 2001;91:137-41.        

20. Speller V. The next great challenge — getting evidence into practice. International Union for Health Promotion and Education Supplement 2001;2:20-23.        

21. Lomas J. Beyond the sound of one hand clapping: A discussion document on improving health research dissemination and uptake. Sydney: Centre for Effective Healthcare, University of Sydney; 1997.        

22. Matthews S, Scrimgeour M. Dunbar T, Arnott A, Chamberlain A, Murakami-Gold L, et al. Promoting the use of health research. Links Monograph Series 4. Darwin: Co-operative Research Centre for Aboriginal and Tropical Health; 2002.        

23. Stocking B. Why research findings are not used by commissions and what can be done about it. Journal of Public Health Medicine 1995;17:380-2.        

24. The 10/90 report on health research 2000. Geneva: Global Forum for Health Research; 2000. Available from: URL: http://www.globalforumhealth.ch/report.htm        

25. Varmus H, Klausner R, Zerhouni E, Acharya T, Daar AS, Singer PA. Public health: grand challenges in global health. Science 2003;302:398-9.        

26. Labonte R, Spiegel J. Setting global health research priorities. BMJ 2003;326:722-3.        

27. Bassett M, Bijlmakers L, Sanders D. Experiencing structural adjustment in urban and rural households of Zimbabwe. In: Turshen M, editor. African women's health. Trenton (NJ): Africa World Press, Inc; 2000. p.167-91.        

28. Bijlmakers LA, Bassett M, Sanders D. Socioeconomic stress, health and child nutritional status in Zimbabwe at a time of economic structural adjustment – a three year longitudinal study. Uppsala: Nordiska Afrikainstitutet; 1998. p.127.        

29. Wagstaff A. Poverty and health. Commission on Macroeconomics and Health. 2001. Paper WG1:5. Available from: URL: http://www2.cid.harvard.edu/cidcmh/wg1_paper5.pdf.        

30. Commission on Macroeconomics and Health (CMH). Macroeconomics and health: investing in health for economic development. Geneva: World Health Organization; 2001.          Available from: URL: http://www3.who.int/whosis/cmh/cmh_report/
report.cfm?path=cmh,cmh_report&language=english

31. Mustard C, Barer M, Evans R, Horne J, Mayer T, Derksen S. Paying taxes and using health care services: the distributional consequences of tax financed universal health insurance in a Canadian Province. CSLS Conference on the State of Living Standards and the Quality of Life in Canada. Ottawa: Centre for the Study of Living Standards; 1998.        

32. de Koning K, Martin M. Participatory research in health: setting the context. In: Martin K, de Koning K, editors. Participatory research in health: issues and experiences. London: Zed Books; 1996. p. 1-18.        

33. Labonte R, Schrecker T, Sanders D, Meeus W. Fatal indifference: the G8, Africa and global health. Cape Town: University of Cape Town Press; 2004.        

34. Deacon B, Ollila E, Koivusalo M, Stubbs P. Global social governance: themes and prospects. Helsinki: Ministry of Foreign Affairs for Finland; 2003.        

35. Smith R. Peer review: reform or revolution? BMJ 1997;315:759-60.        

 

 

(Submitted: 5 January 2004 – Final version received: 23 June 2004 – Accepted: 1 July 2004)

 

 

1 Correspondence should be sent to Professor Sanders (email: dsanders@uwc.ac.za).

World Health Organization Genebra - Genebra - Switzerland
E-mail: bulletin@who.int