RESEARCH

Are skilled birth attendants really skilled? A measurement method, some disturbing results and a potential way forward

Les « accoucheurs/euses qualifiés/es » ont-ils/elles réellement les compétences pour pratiquer des accouchements ? Présentation d’une méthode de mesure de ces compétences, de certains résultats dérangeants et d’une voie de progression potentielle

¿Qué tan calificados están los asistentes de partería calificados? Un método de medición, algunos resultados preocupantes y un posible paso adelante

Steven A Harvey^{I, 1}; Yudy Carla Wong Blandón^II; Affette McCaw-Binns^III; Ivette Sandino^IV; Luis Urbina^II; César Rodríguez^II; Ivonne Gómez^II; Patricio Ayabaca^V; Sabou Djibrina^VI; the Nicaraguan maternal and neonatal health quality improvement group

^IQuality Assurance Project, University Research Co., LLC, 7200 Wisconsin Avenue, Suite 600, Bethesda, MD 20814, USA
^IIQuality Assurance Project, University Research Co., LLC, Managua, Nicaragua
^IIIDepartment of Community Health and Psychiatry, University of the West Indies, Mona, Jamaica
^IVUnited Nations Children’s Fund (UNICEF), Managua, Nicaragua
^VQuality Assurance Project, University Research Co., LLC, Quito, Ecuador
^VIQuality Assurance Project, University Research Co., LLC, Niamey, Niger

ABSTRACT

OBJECTIVE: Delivery by a skilled birth attendant (SBA) serves as an indicator of progress towards reducing maternal mortality worldwide – the fifth Millennium Development Goal. Though WHO tracks the proportion of women delivered by SBAs, we know little about their competence to manage common life-threatening obstetric complications. We assessed SBA competence in five high maternal mortality settings as a basis for initiating quality improvement.
METHODS: The WHO Integrated Management of Pregnancy and Childbirth (IMPAC) guidelines served as our competency standard. Evaluation included a written knowledge test, partograph (used to record all observations of a woman in labour) case studies and assessment of procedures demonstrated on anatomical models at five skills stations. We tested a purposive sample of 166 SBAs in Benin, Ecuador, Jamaica and Rwanda (Phase I). These initial results were used to refine the instruments, which were then used to evaluate 1358 SBAs throughout Nicaragua (Phase II).
FINDINGS: On average, Phase I participants were correct for 56% of the knowledge questions and 48% of the skills steps. Phase II participants were correct for 62% of the knowledge questions. Their average skills scores by area were: active management of the third stage of labour – 46%; manual removal of placenta – 52%; bimanual uterine compression – 46%; immediate newborn care – 71%; and neonatal resuscitation – 55%.
CONCLUSION: There is a wide gap between current evidence-based standards and provider competence to manage selected obstetric and neonatal complications. We discuss the significance of that gap, suggest approaches to close it and describe briefly current efforts to do so in Ecuador, Nicaragua and Niger.

RÉSUMÉ

OBJECTIF: Le taux d’accouchement par un accoucheur qualifié sert dans le monde entier d’indicateur des progrès réalisés dans la réduction de la mortalité maternelle (cinquième objectif du Millénaire pour le développement). Si l’OMS suit la proportion de femmes accouchées par des accoucheurs qualifiés, elle sait peu de choses sur la capacité de ces agents de santé à prendre en charge des complications obstétricales courantes potentiellement fatales. Nous avons évalué les compétences de ces accoucheurs dans cinq établissements présentant une forte mortalité maternelle, en tant que point de départ pour une amélioration de la qualité des prestations.
MÉTHODES: Les directives de la Prise en charge intégrée de la grossesse et de l’accouchement de l’OMS (PCIGA) nous ont servi de norme pour l’évaluation des compétences. Celle-ci a été réalisée sur la base d’un test de connaissances écrit, d’études de cas utilisant un partographe (appareil capable d’enregistrer l’ensemble des paramètres pour une femme en travail) et de la démonstration par les participants de différentes opérations sur des modèles anatomiques dans cinq postes d’évaluation des compétences. Nous avons testé cette évaluation sur un échantillon choisi à dessein de 166 accoucheurs qualifiés du Bénin, de l’ Equateur, de la Jamaïque et du Rwanda (phase I). Les résultats initiaux obtenus ont été utilisés pour perfectionner les instruments d’évaluation, qui ont ensuite été appliqués à 1358 accoucheurs qualifiés dans l’ensemble du Nicaragua (phase II).
RÉSULTATS: En moyenne, les participants à la phase I ont fourni une prestation correcte pour 56 % des questions de connaissances et pour 48 % des étapes de compétences. Les participants à la phase II ont répondu correctement à 62 % des questions de connaissances. En moyenne, leurs résultats en matière de compétences se répartissaient par domaines comme suit. Prise en charge active du troisième stade du travail : 46 %, retrait manuel du placenta : 52 %, compression utérine à deux mains : 46 %, soins immédiats au nouveau-né : 71 % et réanimation néonatale : 55 %.
CONSLUSION: Il existe un large écart entre les exigences de la norme actuelle reposant sur une base factuelle et la capacité des prestateurs à prendre en charge certaines complications obstétricales et néonatales. Nous examinons l’importance de cet écart, proposons des approches pour le combler et décrivons brièvement les efforts entrepris dans cette voie en Equateur, au Nicaragua et au Niger.

RESUMEN

OBJETIVO: La atención del parto por personal de salud calificado es un indicador que valora el progreso realizado para reducir la mortalidad materna a nivel mundial, y que se ve reflejado en el quinto Objetivo de Desarrollo del Milenio. Aunque la OMS sigue de cerca la proporción de mujeres que dan a luz atendidas por un personal calificado, es poco lo que sabemos sobre su competencia para manejar complicaciones obstétricas comunes potencialmente mortales. Evaluamos la competencia del personal calificado en cinco entornos de alta mortalidad materna como punto de partida para empezar a mejorar la calidad de la asistencia.
MÉTODOS: El grado de competencia se determinó empleando como referencia la guía de la OMS, Manejo integrado del embarazo y el parto (IMPAC). La evaluación incluyó un examen escrito sobre los conocimientos en la materia, estudios de casos del partograma (registro de variables durante la vigilancia del trabajo de parto) y una evaluación de la práctica demostrada con modelos anatómicos en cinco tipos de aptitudes. Se analizó una muestra intencionada de 166 asistentes calificados en Benin, el Ecuador, Jamaica y Ruanda (fase I). Con esos resultados iniciales se refinaron los instrumentos, que volvieron a ser utilizados para evaluar a 1358 personal calificado a través de Nicaragua (fase II).
RESULTADOS: En promedio, los participantes en la fase I contestaron correctamente el 56% de las preguntas sobre los conocimientos teóricos. Así mismo, desempeñaron correctamente el 48% de los pasos de las pruebas prácticas. Los participantes en la fase II respondieron correctamente al 62% de las preguntas teóricas. Sus puntuaciones promedias por área de práctica fueron las siguientes: manejo activo del tercer período del parto, 46%; extracción manual de la placenta, 52%; compresión uterina bimanual, 46%; atención inmediata al recién nacido, 71%; y reanimación neonatal, 55%.
CONCLUSIÓN: Existe una brecha importante entre las normas actuales basadas en la evidencia y las aptitudes del personal para manejar determinadas complicaciones obstétricas y neonatales. Tras analizar las implicaciones de esta brecha, se propone medidas para corregirlo y se describe brevemente las actividades que actualmente se lleva a cabo con ese fin en el Ecuador, Nicaragua y el Níger.

Introduction

Background

Each year obstetric complications kill over 500 000 women worldwide.^1,2 Skilled attendance during labour, delivery and in the early postpartum period could prevent many of these deaths, though establishing a causal link between skilled attendance and maternal survival remains problematic.^2–6 Still, the proportion of deliveries assisted by a skilled birth attendant (SBA) has become an indicator for measuring maternal mortality reduction, including the 75% reduction called for by the fifth Millennium Development Goal (MDG-5).^7,8

WHO defines an SBA as someone "trained to proficiency in the skills needed to manage normal (uncomplicated) pregnancies, childbirth and the immediate postnatal period, and in the identification, management and referral of complications in women and newborns".⁹ WHO uses household survey data to estimate the percentage of women delivered by an SBA in each country.¹⁰ (An explanation of the methodology for determining the percentage of women delivered by SBAs is available at: http://www.who.int/reproductive-health/global_monitoring/skilled_attendant.html#methodology. WHO’s most recent estimates of the proportion of women delivered by SBAs are available at: http://www.who.int/reproductive-health/global_monitoring/skilled_attendant_at_birth2006.pdf). Typically, these surveys ask women what type of health professional, if any, assisted at their most recent deliveries.^11–14 Most surveys report results by cadre: doctor, midwife, nurse, traditional birth attendant, relative and other. Some categorize doctors, midwives and nurses as health personnel to distinguish them from untrained attendants. Since surveys make no claim to ascertain provider skill, using survey data to estimate the proportion of SBA-assisted deliveries assumes that all health personnel qualify as SBAs.¹⁵ (In this paper, consistent with the International Confederation of Midwives definition, the term midwife or nurse-midwife means a provider who has graduated from a certified or accredited midwifery training course in the country of practice. These programmes vary in content and duration and may or may not include medical or nursing training beyond midwifery skills. Nurse refers to a provider who has completed nursing training that is not part of a certified or accredited midwifery programme, even when midwifery functions are performed.)¹⁵

But are skilled birth attendants really skilled? Do the health personnel enumerated by household surveys fit WHO’s definition? This question was the focus of our two-phase study. In Phase I, we developed and piloted evaluation instruments, then carried out small-scale competency assessments in four countries. In Phase II, shortcomings identified in Phase I were corrected and the revised instruments used to conduct a larger-scale assessment. The results contribute to ongoing competency-improvement efforts.

Methods

We evaluated 166 health providers in Benin, Ecuador, Jamaica and Rwanda during Phase I. In Phase II, we tested 1358 Nicaraguan providers. In each country, our aim was to evaluate the professionals responsible for most deliveries – those most likely to appear in WHO estimates. Like WHO, we excluded traditional birth attendants. Table 1 summarizes maternal health characteristics by country.

Instrument development

We defined competence as possessing skills and knowledge sufficient to comply with predefined clinical standards. In a multi-country setting, this presupposes standards accepted by all providers and sites. Since no such standards exist, we measured competence against WHO’s Integrated Management of Pregnancy and Childbirth (IMPAC) guidelines, an appropriate evidence-based yardstick.¹⁶

The three leading direct causes of maternal death are haemorrhage, pre-eclampsia and eclampsia, and sepsis.^17,18 We designed instruments to test competence related to prevention, diagnosis and management of these complications, plus management of uncomplicated labour and delivery. We evaluated knowledge with a written test and skills with anatomical models. We ruled out direct clinical observation for three reasons:

• Complications occur in approximately 15% of pregnancies and cannot be predicted.^19,20 It would be prohibitively time-consuming and expensive to observe each participant managing each complication.

• Ethics would compel intervention if a clinically experienced observer observed sub-standard care.

• In clinical settings, many factors affect performance. Without essential drugs, equipment or supplies, a highly competent provider might perform poorly. With competent assistants and all necessities at hand, a marginal provider might perform well. Since environment varies by facility, we elected to test competency in non-clinical venues where we could control for environmental factors.

The initial knowledge test was modelled on MotherCare, and Maternal and Neonatal Health Program (MNH) materials.^21,22 Additional sources included IMPAC guidelines, participating countries’ norms, and the Safe Motherhood Inter-Agency Group’s SBA competencies.^5,16,23,24 We adapted two MNH case studies in order to evaluate partograph skills. For initial skills testing, we adapted MNH structured observation checklists for neonatal resuscitation, manual removal of the placenta and bimanual uterine compression.²¹ We developed an intravenous (IV) insertion skills checklist. Senior clinicians used these checklists to assess each participant’s skill. To standardize observation criteria, we trained clinical observers using the following regimen:

1. The country study coordinator reviewed each checklist line-by-line with observers, clarifying any perceived ambiguities.

2. One observer performed the first procedure on an anatomical model. All others used the first checklist to rate the skill demonstrated in this mock evaluation.

3. Observers then compared checklists step-by-step to resolve differences. The coordinator served as final arbiter.

4. The group repeated steps 2 and 3, with different observers role-playing the evaluee, until 100% agreement was achieved.

Typically, observers achieved 100% consensus after four to five practice observations. The principal investigator (Steven Harvey) supervised training in Benin, Ecuador and Nicaragua. Co-investigators supervised training in Jamaica (Affette McCaw-Binns) and Rwanda (Sabou Djibrina).

We piloted the instruments in Ecuador in November 2001, then conducted small-scale evaluations in the Phase I countries from March to June 2002. Phase I participants needed much longer than anticipated to complete the evaluation. Many struggled with complex case-based questions in the knowledge test. For Phase II, we simplified the test language, eliminated case-based questions and adopted a format that was all multiple-choice. We added material from the American College of Nurse-Midwives (ACNM) life-saving skills curriculum and JHPIEGO guidelines for the assessment of skilled providers.^25,26 On expert advice, we replaced IV insertion, and mouth-to-mouth and nose resuscitation checklists with one focused on active management of the third stage of labour (AMTSL) and another on immediate newborn care.

In both phases, we relied on multiple rounds of expert review to establish construct and content validity for our instruments. Reviewers included obstetricians/gynaecologists, paediatricians and midwives at the international level and in each study country. To ensure accurate translation, we reviewed each instrument line-by-line with local clinicians before each evaluation. To assess obstetric skills, we used the Gaumard Advanced Childbirth Simulator S500; for neonatal skills we used the Simulaids Sani-Baby CPR mannequin in Phase I and the Gaumard S320 Airway Trainer Newborn in Phase II. Finally, we reduced partograph evaluation to one case.

Study sites and sample characteristics

In Phase I, we selected participants purposively to represent the full range of facilities where women give birth and the cadre(s) primarily responsible for attending facility-based births in each country. We included at least one national-level tertiary care facility, at least two district-level hospitals, and a mix of rural and urban facilities. All participants completed all evaluation activities.

For Phase II, we evaluated health personnel in 20 hospitals, at least 1 in each of Nicaragua’s 17 health areas. This included 3 teaching hospitals, 2 maternal and child hospitals, and 15 district hospitals. We also evaluated personnel from 43 primary health centres, at least 1 from every health area except Carazo, Managua, Masaya and Rivas. Phase II selection criteria required all participating facilities to be qualified basic or comprehensive emergency obstetric care (BEOC or CEOC) facilities and, in the case of primary facilities, located in a health area participating in some obstetric care improvement initiative.¹⁹ In the South Atlantic Autonomous Region (RAAS), we enrolled all BEOC facilities. Elsewhere facilities were selected by convenience, principally related to physical accessibility. UNICEF, CARE, the Pan American Health Organization (PAHO), the Quality Assurance Project (QAP) and the Nicaraguan Ministry of Health jointly determined the sampling strategy.

Phase II participants were evaluated by function. Obstetricians and gynaecologists, obstetrics and gynaecology residents, and general practitioners in gynaecology participated only in testing related to labour, delivery and obstetric complications. In Nicaragua, these cadres were not tested on paediatric skills as they work in higher-level facilities and provide no paediatric care. For the same reason, Nicaraguan paediatricians, paediatric residents and paediatric general practitioners participated only in activities related to immediate newborn care and neonatal resuscitation. Hospital emergency personnel and non-specialized medical and nursing personnel from peripheral facilities completed both components (Table 2, available at: http://www.who.int/bulletin/en/volumes/85/10/06-038455/en/index.html).

The study was reviewed for compliance with QAP ethics guidelines, designed to weigh potential risks and benefits, and ensure participant confidentiality, informed consent and host-country ethics review. Ministry of health ethics committees or their equivalent approved the protocol in each country. We obtained verbal consent from all study participants. To protect confidentiality, we observed the following measures:

• Participants were assigned study numbers; no names were recorded.

• Evaluators were prohibited from observing any participant with whom they had a supervisory relationship.

• Data were stored off-site in a location accessible only to study team members. Health facility managers and supervisors had no access.

• Results were reported in aggregate, mainly by district and cadre. Results were not disaggregated by facility when this might have exposed a participant’s identity.

Results

Table 3 summarizes Phase I results, which are reported in detail elsewhere.²⁷ The text describes Phase II results, presented by provider category in Table 4.

Knowledge test

Grouping all provider categories and all knowledge test versions (obstetric, paediatric, general), participants were correct on 62% of test questions (Table 4). By topic, results ranged from 80% correct for haemorrhage during pregnancy to 16% correct for infection prevention. By cadre, doctors were correct on 72% of questions overall, medical students 67%, professional nurses 57% and auxiliary nurses 51%. These differences were statistically significant (analysis of variance, ANOVA F = 265, P < 0.001), as were individual between-group differences (Bonferroni post hoc P 0.001 in all cases). Only five nurse-midwives (less than 0.5% of the sample) participated in Phase II as Nicaragua has stopped training this cadre.

Partograph case study

Doctors and medical students performed similarly on the partograph test, answering 65–70% of questions correctly. Professional and auxiliary nurses’ scores were lower: 42% and 33% respectively for written questions, and 19% and 10% for graphing. Differences were statistically significant (ANOVA F = 199, P < 0.001 for combined written and graphing scores). Doctors and medical students had statistically identical scores (Bonferroni post hoc P = 1). Differences between all other groups on all test components were significant (P 0.001).

Skills stations

AMTSL scores using the childbirth simulator ranged from 53% for doctors to 36% for auxiliary nurses. Doctors and medical students scored virtually identically (ANOVA Bonferroni post hoc P = 1). Nurses scored significantly lower than doctors (Bonferroni P < 0.001) and marginally lower than medical students (P = 0.09). Score differences between professional and auxiliary nurses were not significant (P = 0.49). Doctors correctly performed 53% of the steps for manual removal of the placenta; medical students 45% (t = 2.6, P = 0.009). Bimanual uterine compression scores were lower: 48% for doctors versus 37% for medical students (t = 3.2, P = 0.001). Since Nicaraguan norms prohibit nurses and auxiliary nurses from performing either procedure, they did not participate in these evaluations. Scores were higher and less varied for immediate newborn care, ranging from 76% for doctors to 64% for auxiliary nurses. There was no score difference between doctors and medical students or between professional and auxiliary nurses (Bonferroni P = 1, both cases), but professional and auxiliary nurses scored significantly lower than doctors and medical students (P < 0.05, all cases). Neonatal resuscitation scores followed the same pattern, ranging from 62% for doctors to 45% for auxiliary nurses.

With the exception of infection-prevention knowledge, Phase II scores correlate highly with professional profile: doctors scored highest, followed by medical students, professional nurses and auxiliary nurses. Professional nurses outscored medical students (but not doctors) on infection prevention, though no group exceeded 21%. The average score was 16%.

Discussion

While our results show significant variations in competency between different evaluation components and different cadres, the generally low scores are troubling. Different countries and cadres show different strengths and weaknesses, but several patterns emerge:

• Many participants scored poorly on basic questions related to infection prevention (hand-washing, proper handling of contaminated instruments, proper disposal of medical waste).

• In Nicaragua, intramuscular (IM) oxytocin use immediately after birth became a provisional standard in 2003, and AMTSL knowledge is high. In other countries, AMTSL was not routine at the time of the study. This may explain why many providers could not identify its components (IM oxytocin immediately after delivery of the foetus, controlled cord traction, uterine massage) and did not know that it should be practised universally.^28–30

• Many providers did not recognize the diastolic blood pressure level indicative of severe pre-eclampsia or identify the use of magnesium sulfate and rapid termination of the pregnancy as the preferred management strategies for this condition.

• Ability to correctly use and interpret the partograph was low.

• Skills scores generally were lower than knowledge scores. For example: the mean AMTSL knowledge score in Nicaragua was 74%; the mean skills score was 46%. Similarly, the mean Phase I knowledge score on management of postpartum haemorrhage was 63%; the skills scores for manual removal of the placenta and bimanual uterine compression – basic evidence-based interventions to control postpartum haemorrhage – were 41% and 22% respectively. This suggests that knowledge of a procedure is no guarantee that it can be performed correctly.

Though the pattern was less clear in Phase I, Phase II doctors and medical students generally scored higher than midwives, professional nurses and auxiliary nurses. Table 5 (available at: http://www.who.int/bulletin/en/volumes/85/10/06-038455/en/index.html) presents the pair-wise score differences for each assessment area by provider type. While predictable, this outcome may not be the most desirable for birthing women. In isolated rural settings where technology is limited and the nearest referral facility hours away, a woman is much more likely to be attended by a midwife or nurse than a doctor, so the basic life-saving skills of these cadres may be crucial when complications arise. Since Nicaragua no longer trains midwives and few remain in practice, a birthing woman there is most likely to be attended by a professional or auxiliary nurse in settings where no doctor is available. Even when doctors and technology are more accessible, nursing staff often attend most deliveries and perform routine tasks such as completing the partograph and monitoring for postpartum haemorrhage.

Limitations

Since the samples were non-random, we cannot be certain that they represent all professional health workers who attend births in the study countries. Further, we could not control for many potential confounders: differences in pre-service training, population health status, health system structure, national norms and practices, and inter-observer agreement between countries. The analysis here is bivariate. A multivariate analysis that controlled for health facility type, rural versus urban setting and work experience might yield different results. However, none of these factors seems likely to produce a downward bias in scores. If anything, the inclusion of tertiary care and teaching hospital personnel might inflate scores since these providers perform procedures more frequently and have access to better resources than rural clinicians.

The higher Nicaraguan scores may be attributable to several factors. Phase II instruments were shorter and simpler. In contrast to Phase I, we evaluated Phase II participants only on functions they actually perform. Finally, Nicaraguan participants were all assessed in Spanish, their native language. Beninese and Rwandan participants were assessed in French – a second language for some. But measurement error alone is unlikely to explain our results. In spite of these differences, there were remarkable consistencies between Phase I and Phase II results, suggesting serious cause for concern across a range of settings.

What is the significance of this gap between evidence-based standards and provider competence? One perspective holds that proposed international standards are simple and straightforward; anyone eligible to be designated as an SBA should be competent to implement them. It sends the wrong message if some providers are held to these norms but others are excused. This argument has particular logic in rural areas where highly trained providers often are unavailable. Another perspective holds that there is far from universal agreement on these best practices. Some national norms contradict some IMPAC guidelines or even prohibit their use. In urban areas where provider functions are more specialized, perhaps not everyone needs to be competent at everything. Thus, judging provider competency against standards to which their own health systems do not subscribe casts them in an unfairly negative light. These conflicting perspectives underscore the need to strengthen consensus on which practices maximize opportune identification and management of life-threatening complications and how best to implement them.

A central premise of maternal health programming holds that delivery by a skilled attendant and ready access to a BEOC or CEOC facility are fundamental to reducing maternal death.^3,19,31,32 In their recent contribution to the Lancet series on maternal survival, Campbell and Graham reiterate that health centre intrapartum care is the most promising strategy for reducing maternal mortality in time to achieve MDG-5.³³ Sufficient numbers of competent birth attendants are essential to this strategy. A health worker shortage is one important barrier, but inadequate competence among existing health workers may be equally important.⁸ Our findings appear to confirm this conclusion: a woman who delivers at a formal health facility assisted by a so-called "skilled" attendant cannot necessarily assume she will receive competent care.

A potential way forward

In light of our results, participating countries are now taking steps to close the competency gap. QAP, United Nations Population Fund (UNFPA) and the Ecuadorian Ministry of Health have teamed up to develop and implement an eight-session training programme focused on improving complication management. By the end of 2006, this group had trained 81 trainers and 74 clinicians in 5 provinces, plus 12 instructors at Quito’s midwifery school. Provincial trainers are scheduled to train a large number of provincial clinicians in 2007. Quito’s midwifery school is integrating this programme into its pre-service curriculum; other Ecuadorian midwifery and medical schools are considering its adoption. In Nicaragua, a similar effort is under way, coordinated by the Ministry of Health, QAP, UNICEF, CARE and PAHO. By December 2006, this initiative had trained 428 birth attendants in 14 of the country’s 17 health areas. In Niger, a comparable initiative which began in early 2006 had trained 239 providers in 28 of the country’s 37 reference facilities by the year’s end. Correct performance of AMTSL rose from 25% to 97% in participating facilities, affecting an average of 2369 births monthly. Projects in Bangladesh, Benin, Eritrea and Kenya have begun to integrate SBA competency evaluation into maternal health programming. QAP’s competency assessment instruments, along with a manual on how to conduct an assessment, can be downloaded from http://www.qaproject.org/strat/stratsafemotherhood.html/sbacomp.html.

Training, however, is only one part of the equation. No amount of training will lead to more hand-washing if health facilities lack soap and water. Health personnel cannot be expected to identify magnesium sulfate as the drug of choice for pre-eclampsia and eclampsia if it is unavailable – as it was in Benin during this study. Systemic problems require more comprehensive quality-improvement initiatives to address drug availability and distribution, equipment supply and maintenance, ineffective supervision, low morale and other problems that affect health services in many high maternal-mortality settings. However, while work continues to resolve systemic problems, much effort must be directed at raising basic competencies if health personnel are to attain the proficiency and fulfil the functions anticipated by WHO, the International Federation of Gynacology and Obstetrics (FIGO) and the International Confederation of Midwives (ICM) definition. Only then will SBAs be truly skilled and their deliveries become an accurate indicator of progress towards reducing maternal mortality.

Acknowledgements

Research activities were supported by QAP and the United States Agency for International Development (USAID). UNICEF and CARE provided additional funding for activities in Nicaragua. PAHO’s Nicaraguan office contributed to study design. In addition to the listed authors, members of the Nicaraguan maternal and neonatal health quality improvement group include Ivette Aráuz and Daysi Navarro (CARE), Wilmer Beteta, Roberto Jiménez, Ramiro López and Aurora Velásquez (Nicaraguan Ministry of Health), Alma Fabiola Morales (PAHO), Oscar Nuñez (QAP, Managua), Claudia Evens (USAID, Managua) and Claudia Granja (UNICEF).

We thank: MoH officials, health facility directors, participating health personnel, and field team members who made this study possible in each country. Also – P Annie Clark and Deborah Gordis (ACNM), Patricia Gomez and Barbara Deller (JHPIEGO), and Caryl Feldacker for their help in revising and updating study instruments; Sourou Gbangbade and Deanna Ashley for information on training and functions of health personnel in Benin and Jamaica respectively. Finally, we thank Beth Goodrich (QAP) for her assistance editing the manuscript.

Competing interests: None declared.

References

1. Hill K, AbouZhar C, Wardlaw T. Estimates of maternal mortality for 1995. Bull World Health Organ 2001;79:182-93.        

2. Maternal mortality in 2000: estimates developed by WHO, UNICEF and UNFPA. Geneva: World Health Organization; 2003.        

3. Thaddeus S, Maine D. Too far to walk: maternal mortality in context. Soc Sci Med 1994;38:1091-110.        

4. Liljestrand J. Strategies to reduce maternal mortality worldwide. Curr Opin Obstet Gynecol 2000;12:513-7.        

5. Graham WJ, Bell JS, Bullough CH. Can skilled attendance at delivery reduce maternal mortality in developing countries? In: De Brouwere V, Van Lerberghe W, editors. Safe motherhood strategies: a review of the evidence; Studies in Health Services Organisation and Policy, 17. Antwerp: ITG Press; 2001. pp. 97-130.        

6. Donnay F. Maternal survival in developing countries: What has been done, what can be achieved in the next decade? Int J Gynaecol Obstet 2000;70:89-97.        

7. AbouZahr C, Wardlaw T. Maternal mortality at the end of a decade: signs of progress? Bull World Health Organ 2001;79:561-8.        

8. Koblinsky M, Matthews Z, Hussein J, Mavalankar D, Mridha MK, Anwar I, et al. Going to scale with professional skilled care. Lancet 2006;368:1377-86.         

9. Making pregnancy safer: the critical role of the skilled attendant: a joint statement by WHO, ICM and FIGO. Geneva: WHO; 2004.        

10. WHO/UNFPA/UNICEF/World Bank. Reduction of maternal mortality: a joint statement. Geneva: WHO; 1999.        

11. Enquête Démographique et de Santé au Bénin, 2001. Calverton: Institut National de la Statistique et de l’Analyse Économique and ORC Macro; 2002.        

12. Encuesta Nicaragüense de demografía y salud 2001. Calverton: Instituto Nacional de Estadísticas y Censos (INEC) y ORC Macro; 2002.        

13. Enquête démographique et de santé, Rwanda 2000. Kigali and Calverton: Ministère de la Santé, Office National de la Population et ORC Macro; 2001.        

14. Ordoñez J, Stupp P, Monteith D, Ruiz A, Goodwin M, McCracken S, et al. ENDEMAIN 2004 (Encuesta demográfica y de salud materna e infantil): informe final. Quito: CEPAR; 2005.        

15. Progress since the World Summit for Children: a statistical review. New York: UNICEF; September 2001.        

16. WHO, UNFPA, UNICEF, World Bank. IMPAC - Managing complications in pregnancy and childbirth: a guide for midwives and doctors. Geneva: WHO; 2000.        

17. Walsh JA, Feifer CM, Measham AR, Gertler PJ. Maternal and perinatal health. In: Jamison DT, Mosley WH, Measham AR, Bobadilla JL, eds. Disease control priorities in developing countries. New York: Oxford University Press; 1993.        

18. Graham WJ, Cairns J, Bhattacharya S, Bullough CHW, Quayyum Z, Rogo K. Maternal and perinatal conditions. In: Jamison DT, Mosley WH, Measham AR, Bobadilla JL. Disease control priorities in developing countries. 2nd ed. New York: Oxford University Press; 2006. pp. 499-530 doi: 10.1596/978-0-821-36179-5/Chpt-26.        

19. Maine D, Wardlaw TM, Ward VM, McCarthy J, Birbaum A, Akalin MZ, et al. Guidelines for monitoring the availability and use of obstetric services. 2nd edn. New York: UNICEF, WHO, UNFPA; 1997.        

20. Say L, Pattinson RC, Gulmezoglu AM. WHO systematic review of maternal morbidity and mortality: the prevalence of severe acute maternal morbidity (near miss). Reprod Health 2004;1:3.        

21. Maternal and Neonatal Health Program. MNH Program: evaluation of MNH clinical training for service providers (DRAFT). Baltimore: JHPIEGO; October 2001.        

22. McDermott J, Beck D, Buffington ST, Annas J, Supratikto G, Prenggono D, et al. Two models of in-service training to improve midwifery skills: how well do they work? J Midwifery Womens Health 2001;46:217-25.        

23. Santé familiale Benin: politique normes et standards. Cotonou: Ministère de la Santé Publique du Benin, Direction de la Santé Familiale; 1998.        

24. Normas y procedimientos para la atención de la salud reproductiva. Quito: Ministerio de Salud Pública República del Ecuador; 1999.        

25. Marshall MA, Tebben Buffington S. Life-saving skills manual for midwives, 3rd ed. Silver Spring: American College of Nurse-Midwives; 1998.        

26. Maternal and neonatal health program. Guidelines for assessment of skilled providers after training in maternal and newborn healthcare. Baltimore: JHPIEGO; 2004.        

27. Harvey SA, Ayabaca P, Bucagu M, Djibrina S, Edson WN, Gbangbade S, et al. Skilled birth attendant competence: an initial assessment in four countries, and implications for the Safe Motherhood movement. Int J Gynaecol Obstet 2004;87:203-10.        

28. Festin MR, Lumbiganon P, Tolosa JE, Finney KA, Ba-Thike K, Chipato T, et al. International survey on variations in practice of the management of the third stage of labour. Bull World Health Organ 2003;81:286-91.        

29. Neilson JP. Evidence-based intrapartum care: evidence from the Cochrane Library. Int J Gynaecol Obstet 1998;63:S97-102.        

30. Shane B. Preventing postpartum hemorrhage: managing the third stage of labor. Maternal & neonatal health project Baltimore Outlook 2001;19.        

31. McCarthy J, Maine D. A framework for analyzing the determinants of maternal mortality. Stud Fam Plann 1992;23:23-33.        

32. Maine D, Rosenfield A. The Safe Motherhood Initiative: why has it stalled? Am J Public Health 1999;89:480-2.        

33. Campbell OM, Graham WJ. Strategies for reducing maternal mortality: getting on with what works. Lancet 2006;368:1284-99.        

(Submitted: 2 November 2006 – Final revised version received: 10 March 2007 – Accepted: 14 March 2007)

1 Correspondence to Steven A Harvey (e-mail: sharvey@urc-chs.com).