RESEARCH

Pneumonia case-finding in the RESPIRE Guatemala indoor air pollution trial: standardizing methods for resource-poor settings

Dépistage de la pneumonie dans le cadre d’une étude de la pollution de l’air intérieur menée au Guatemala (RESPIRE) : méthodes standardisées applicables dans les pays à faible revenu

Búsqueda de casos de neumonía en el ensayo sobre la contaminación del aire en interiores RESPIRE en Guatemala: normalizar los métodos para entornos con pocos recursos

Nigel Bruce^I,1; Martin Weber^II; Byron Arana^III; Anaite Diaz^III; Alisa Jenny^IV; Lisa Thompson^IV; John McCracken^V; Mukesh Dherani^I,1; Damaris Juarez^III; Sergio Ordonez^III; Robert Klein^VI; Kirk R Smith^IV

^IDivision of Public Health, Whelan Building, University of Liverpool, Liverpool L69 3GB, England
^IIDepartment of Child and Adolescent Health and Development, WHO, Geneva, Switzerland
^IIICenter for Health Studies, Universidad del Valle de Guatemala, Guatemala City, Guatemala
^IVEnvironmental Health Sciences, School of Public Health, University of California, Berkeley, CA, USA
^VHarvard School of Public Health, Harvard University, Boston, MA, USA
^VIRegional Office for Central America and Panama, Centers for Disease Control and Prevention (CDC-CAP), Guatemala City, Guatemala

ABSTRACT

OBJECTIVE: Trials of environmental risk factors and acute lower respiratory infections (ALRI) face a double challenge: implementing sufficiently sensitive and specific outcome assessments, and blinding. We evaluate methods used in the first randomized exposure study of pollution indoors and respiratory effects (RESPIRE): a controlled trial testing the impact of reduced indoor air pollution on ALRI, conducted among children < 18 months in rural Guatemala.
METHODS: Case-finding used weekly home visits by fieldworkers trained in integrated management of childhood illness methods to detect ALRI signs such as fast breathing. Blindness was maintained by referring cases to study physicians working from community centres. Investigations included oxygen saturation (SaO₂), respiratory syncytial virus (RSV) antigen test and chest X-ray (CXR).
FINDINGS: Fieldworkers referred > 90% of children meeting ALRI criteria, of whom about 70% attended a physician. Referrals for cough without respiratory signs and self-referrals contributed 19.0% and 17.9% of physician-diagnosed ALRI cases respectively. Intervention group attendance following ALRI referral was 7% higher than controls, a trend also seen in compliance with RSV tests and CXR. There was no evidence of bias by intervention status in fieldworker classification or physician diagnosis. Incidence of fieldworker ALRI (1.12 episodes/child/year) is consistent with high sensitivity and low specificity; incidence of physician-diagnosed ALRI (0.44 episodes/child/year) is consistent with comparable studies.
CONCLUSION: The combination of case-finding methods achieved good sensitivity and specificity, but intervention cases had greater likelihood of reaching the physician and being investigated. There was no evidence of bias in fieldworkers’ classifications despite lack of concealment at home visits. Pulse oximetry offers practical, objective severity assessment for field studies of ALRI.

RÉSUMÉ

OBJECTIF: Les études de l’influence de facteurs environnementaux sur les infections aigues des voies respiratoires basses (ALRI) se heurtent à une double difficulté, à savoir la mise en œuvre de méthodes d’évaluation des résultats suffisamment sensibles et spécifiques et le masquage des identités. Nous avons donc évalué les méthodes utilisées dans la première étude d’exposition randomisée des effets sur les voies respiratoires de la pollution intérieure RESPIRE (étude cas-témoins randomisée de l’impact d’une réduction de la pollution de l’air intérieur sur les infections aigues des voies respiratoires basses, menée sur des enfants de 18 mois au plus, en milieu rural au Guatemala).
MÉTHODES: Pour dépister ces maladies, on a eu recours à des visites à domicile par des agents de terrain formés aux méthodes de prise en charge intégrée des maladies de l’enfance permettant d’en détecter les signes, comme l’accélération du rythme respiratoire par exemple. La confidentialité a été maintenue en orientant les cas vers des médecins de l’étude travaillant dans des centres communautaires. Parmi les examens pratiqués figuraient notamment la détermination de la saturation artérielle en oxygène (SaO₂), un test de détection antigénique du virus respiratoire syncytial (VRS) et une radiographie thoracique.
RÉSULTATS: Les agents de terrain ont orienté vers un spécialiste plus de 90 % des enfants remplissant les critères de présence d’une ALRI, parmi lesquels 70 % ont consulté un médecin. Les orientations vers un spécialiste pour toux sans signe respiratoire et les consultations de spécialiste à l’initiative des sujets eux-mêmes ont représenté respectivement 19,0 % et 17,9 % des cas d’ALRI médicalement diagnostiqués. Les membres du groupe d’intervention étaient plus nombreux que les témoins (+ 7 %) à suivre la recommandation de consulter un spécialiste pour suspicion d’ALRI, tendance également observée dans la soumission au test de dépistage du VRS et à la radiographie thoracique. On n’a relevé aucun élément indiquant la présence d’un biais lié à la participation du sujet à l’intervention dans la classification par les agents de terrain ou le diagnostic par les médecins. L’incidence des ALRI détectées par des agents de terrain (1,12 épisode/enfant/an) était cohérente avec la forte sensibilité et la faible spécificité de cette méthode de dépistage. Celle des cas d’ALRI diagnostiqués par des médecins (0,44 épisode/enfant/an) était également cohérente avec celle obtenue dans des études comparables.
CONCLUSION: L’association des deux méthodes de dépistage a permis d’obtenir une sensibilité et une spécificité satisfaisantes, mais la probabilité d’être vu par un médecin et d’être examiné était plus forte pour les cas ayant bénéficié de l’intervention. Aucun élément n’indiquait la présence d’un biais dans la classification établie par les agents de terrain, en dépit du manque de confidentialité des visites à domicile. La sphygmo-oxymétrie offre un moyen pratique et objectif pour évaluer la gravité de la pathologie dans le cadre des études sur le terrain des ALRI.

RESUMEN

OBJETIVO: Los ensayos sobre los factores de riesgo ambientales y las infecciones agudas de las vías respiratorias inferiores (IAVRI) encaran un doble reto: la necesidad de implementar evaluaciones de resultados suficientemente sensibles y específicas, y la aplicación de métodos de enmascaramiento. Evaluamos los métodos utilizados en el primer estudio aleatorizado de la exposición a la contaminación del aire en interiores y sus efectos respiratorios (RESPIRE), un ensayo controlado realizado entre niños < 18 meses en zonas rurales de Guatemala para determinar el impacto de la reducción de ese tipo de contaminación en las IAVRI.
MÉTODOS: La localización de casos se hizo mediante visitas domiciliarias semanales realizadas por agentes sobre el terreno adiestrados en los métodos de la atención integrada a las enfermedades prevalentes de la infancia para detectar los signos de IAVRI, como por ejemplo una respiración rápida. El enmascaramiento se logró derivando los casos a médicos que trabajaban en centros comunitarios. Como parte del estudio se determinaron la saturación de oxígeno (SaO₂) y la presencia del virus sincitial respiratorio (VSR) y se hizo una radiografía de tórax (RXT).
RESULTADOS: Los trabajadores sobre el terreno derivaron a más
del 90% de los niños que cumplían los criterios de IAVRI, alrededor del 70% de los cuales fueron llevados al médico. Las derivaciones por tos sin signos respiratorios y las autoderivaciones representaron el 19,0% y el 17,9% de los casos de IAVRI diagnosticados por los médicos, respectivamente. Las visitas al médico en el grupo de intervención fueron un 7% más frecuentes que en el grupo de control, tendencia observada también en la realización de las pruebas del VSR y la RXT. No hubo ningún dato que indicara un posible sesgo por estado de intervención en la clasificación de los trabajadores sobre el terreno o el diagnóstico de los médicos. La incidencia de IAVRI basada en las evaluaciones de los trabajadores sobre el terreno (1,12 episodios/niño/año) refleja una alta sensibilidad y una baja especificidad; la incidencia de IAVRI diagnosticadas por los médicos (0,44 episodios/niño/año) es similar a la de otros estudios comparables.
CONCLUSIÓN: La combinación de métodos de búsqueda de casos permitió conseguir una buena sensibilidad y especificidad, pero los casos del grupo de intervención tenían más probabilidades de llegar al médico y ser estudiados. No se observó ningún indicio de sesgo en las clasificaciones de los trabajadores sobre el terreno pese a la falta de ocultación en las visitas domiciliarias. La oximetría de pulso permite evaluar de forma práctica y objetiva la gravedad del estado en los estudios de campo de las IAVRI.

Introduction

Acute lower respiratory infections (ALRI) are the single most important cause of death of children under 5 years, responsible annually for approximately 20% of the 10 million under-5 deaths globally.^1,2 Prevention strategies are required urgently, including control of risk factors. A growing body of evidence links household indoor air pollution from solid fuels with ALRI in developing countries: recent estimates suggest this may be responsible for nearly one million child ALRI deaths.³ However, these figures are based on relatively few observational studies with considerable variation in ALRI case-finding methods, indirect exposure assessment (using proxies such as fuel type) and risk of residual confounding.⁴ To address these limitations we conducted a community-based randomized controlled trial with improved chimney stoves in rural Guatemala.

Weaknesses in previous ALRI field studies, and the methodological issues common to trials of environmental interventions, highlighted three particular challenges for this study:

1. To ensure that few cases are missed. Frequent home visits by staff trained to recognize signs such as fast breathing can achieve high sensitivity for ALRI.⁵ It has been suggested that early treatment associated with more frequent visits may reduce cases of severe ALRI, but a recent review found no evidence of association between surveillance interval (less than 2 weeks) and incidence.^1,5

2. To ensure high specificity, as ALRI constitutes a minority (~10%) of all acute respiratory infections. Any impact of reduced exposure on ALRI incidence may be missed if ALRI cases are classified mistakenly with larger numbers of acute upper respiratory infections (AURI). To achieve specificity, all cases identified by fieldworkers should undergo physician examination and preferably chest X-ray (CXR).⁵

3. To take measures to make physicians’ assessments blind and incorporate objective outcome assessments, as it was not possible for subjects or staff visiting homes to be blind to their intervention status.

This report’s objectives are to describe these methods, evaluate the effectiveness of case-finding and identify any evidence of bias by intervention status. Analysis was carried out using Stata version 9.1.⁶ An annual ethical review was conducted by the Centers for Disease Control and Prevention (CDC) and the institutional review boards of the Universities of California (Berkeley), del Valle de Guatemala and Liverpool (UK).

Methods

Study area and population

Following extensive feasibility studies,^7–13 a rural area of San Marcos in western Guatemala was selected. The indigenous population speaks mainly a Mayan language, Mam, and some Spanish. Wood is the main household fuel, burned indoors on open fires. Key features of the study area are presented in Table 1.

Study design and ALRI case-finding

The study design was a randomized controlled trial comparing ALRI incidence in children < 18 months using the traditional three-stone fire (controls), with intervention homes using a flued wood stove (plancha):^7,14 534 homes with either children under 4 months or a pregnant woman were randomized, and planchas constructed in 269. Sample size was determined to detect a 25% change in ALRI incidence of 0.5 episodes per child per year, at 5% significance, 80% power. Surveillance began after 5 weeks when the planchas were ready, from which time 518 children were followed until the age of 18 months, withdrawal or death. ALRI case-finding was carried out at four levels:

1. Weekly household visits by fieldworkers trained in WHO integrated management of childhood illness (IMCI) methods.¹⁵

2. Study physicians, working in local community centres to maintain blindness, undertook clinical assessments of children referred by fieldworkers, or self-referred.

3. Extraction of information from hospital records.

4. Verbal autopsy to investigate all deaths.¹⁶

Household visits

Weekly home visits ran from December 2002 to December 2004. Each home was visited on the same day every week. If unavailable, one repeat visit was made on the Friday of the same week. From a total of 21 fieldworkers, 16 were recruited from local community leaders, midwives and health promoters; 14 of these were bilingual (Mam-Spanish) and eight (50%) were female. Fieldworkers were allocated equal numbers of plancha and control homes to visit each day.

The fieldworkers’ questionnaire was based closely on IMCI criteria¹⁵ and focus groups identified appropriate Mam terms. All fieldworkers underwent one-week IMCI training in symptom and sign recognition (including video for wheeze and stridor), and classification of children as well, sick but suitable for home treatment or requiring referral to study physician. Respiratory rate was measured over one minute using a timer (UNICEF) and repeated when over 60 in children < 2 months (repeat used).

One supervisor carried out repeat home visit assessments in 10% of homes, while a second supervisor directly observed 10% of home visits. Most repeat assessments agreed with the original findings but the child was re-examined when there were disagreements. All forms were reviewed after each day of fieldwork to identify and correct errors.

Not all weekly scheduled visits could be realized, mostly due to internal migration (Table 2). Although there was a slightly lower rate of completed visits to plancha homes, there were similar numbers of realized visits per child, children with no missed visits and dropouts.

A critical indicator of potential bias was how well fieldworkers adhered to the referral algorithm, by intervention status. No child with specific respiratory signs (raised respiratory rate, chest wall indrawing, stridor or wheezing) was classified as well, but approximately 8% (7.9% plancha, 8.8% control) of cases with raised respiratory rates were not referred, with similar findings for other respiratory signs. All non-referrals with fieldworker-assessed fast breathing had respiratory rates in the ranges considered normal for the next youngest age group (Table 3),¹⁵ suggesting that non-referral resulted from uncertainty about ages and thresholds for rapid breathing. Most of these referrals (81%) occurred in the first half of the study.

Fieldworker-assessed symptoms and signs were combined to produce four definitions of new ALRI cases (Table 4): 668 cases met the criteria for lower respiratory illness, plus stridor, a rate of 1.12 (95% confidence interval, CI: 1.03–1.20) episodes per child per year. No cases were classified as well, but 8.9% and 9.3% were classified as unwell and suitable for home treatment in plancha and control groups respectively.

Severe fieldworker-assessed cases (severe WHO pneumonia) were defined as new cases (including nine with non-severe ALRI the previous week) of lower respiratory illness, plus stridor, with chest indrawing and/or inability to drink or breastfeed. There were 72 of these cases, a rate of 0.12 (95% CI: 0.09–0.15) episodes per child per year.

It was expected that not all referred sick children would be taken to the study physician. Almost 80% of referrals for possible ALRI attended the physician before the next weekly visit (Table 4), consistently 3–5% higher in the plancha group (NS). About 70% of all children meeting referral criteria attended the physician before the next weekly visit, 5% more in the plancha group (NS).

Approximately two-thirds of all children with ALRI criteria completed consultations on the day of referral if referred or later that week (Table 4), 5–7% higher in the plancha group (16% for cases with wheeze only), 0.05 < P < 0.1 for outcomes including wheeze. Nearly all (96%) of plancha children referred with severe WHO pneumonia attended the physician, compared to 73% of controls (Fisher’s exact P = 0.02). For 295 visits where a child had ALRI signs but did not see the physician that week, 48 (16.3%) had signs of ALRI at the following weekly visit and 7 of these had severe WHO pneumonia; all 7 were in the control group (P = 0.03).

Fieldworkers also referred 1212 episodes of cough or difficulty breathing, but no specific respiratory sign: 842 (69.5%) attended, and 49 (5.8%) were diagnosed with pneumonia.

Clinical assessment by study physicians

Study physicians assessed children in community centres located up to 1 km from their homes. A standardized history and examination was developed from earlier studies.^17,18 Training sessions were held every one to two months at San Marcos Hospital in order to maintain consistent interpretation of clinical signs – each physician assessed children independently, then compared findings with other physicians and the resident paediatrician.

Six Guatemalan physicians were employed during the study: one (SO) worked almost throughout and four carried out the majority (94.6%) of consultations. A total of 1991 consultations among 467 study children were completed for illnesses other than minor skin and eye conditions (recorded separately). Five respiratory diagnoses were used: AURI; otitis media; laryngo-tracheo-bronchitis; pneumonia; and wheezing illness. Pneumonia was categorized as none, possible or definite, based on the physician’s clinical judgment, and new cases were defined as those following at least one weekly home visit without ALRI signs. With the exception of wheezing illness, respiratory diagnoses usually were applied exclusively (Table 5).

Physicians recorded 263 new episodes of pneumonia, a rate of 0.44 (95% CI: 0.39–0.49) episodes per child per year: 216 (82%) from fieldworker referrals, 47 (18%) from self-referrals. The incidence of fieldworker-assessed AURI was 3.44 episodes per child per year based on current respiratory symptoms, and 5.96 when "symptoms since last visit but now resolved" are included, thus between 7.8 and 13.5 times the physician-diagnosed pneumonia rate.

Intervention and control groups reported similar signs used in pneumonia diagnosis, apart from crepitations (Table 6). Using physician-diagnosed pneumonia as the reference, a raised respiratory rate had moderate sensitivity, but poor specificity and positive predictive value (PPV). Chest wall indrawing was recorded in 36% of pneumonia cases but few other cases so while sensitivity was low, specificity and PPV were high. Crepitations were recorded in well over 80% of pneumonias, and in almost no other diagnoses, thus having high sensitivity, specificity and PPV. A lower proportion of intervention pneumonia cases had crepitations recorded (P = 0.02).

Fieldworker classifications were compared against physician diagnoses: only 5.8% of referrals with cough or difficulty breathing but no specific lower respiratory signs were diagnosed with pneumonia, compared to 28.1% of non-severe ALRI referrals and 47.3% of severe ALRI referrals (P < 0.001).

Pulse oximetry

Low oxygen saturation is a complication of ALRI associated with increased mortality.^19,20 Study physicians used pulse oximetry to measure oxygen saturation (SaO₂) in all consultations. A Sims BCI Mini Corr was used initially, left on the foot for two to three minutes until the reading was stable. From November 2003, Nellcor N-20 oximeters were used. These were more reliable with distressed children, taking six readings on the foot at 30-second intervals (mean used).

To obtain typical SaO₂ levels at the study altitude (Table 1), 55 randomly selected study children were investigated by using the Nellcor N-20 and recording whether or not the child was well (reported by mother). Well children had mean SaO₂ of 93.2% (standard deviation, SD 3.0; 95% CI: 92.7–93.7), median 93.5% and range 82% to 98% (Table 7), consistent with other studies.¹⁹ Hypoxaemic pneumonia cases will be defined as SaO₂ > 2 SD below the mean for well children¹⁹: for this study, 93.2% – (2×3.0) = 87.2% (rounded to 87%).

Table 8 and Fig. 1 illustrate SaO₂ values for children with non-respiratory diagnoses, AURI, wheezing illness (without pneumonia), and pneumonia (possible, definite). Distributions for the diagnostic categories differ overall (Kruskal-Wallis P = 0.0001). Similar statistically significant differences are seen for readings from the Sims and Nellcor oximeters. Since SaO₂ was measured during the consultation, it is possible that diagnosis was influenced by the reading, although a substantial number of non-serious diagnoses (AURI, non-respiratory) had low values recorded, and vice-versa.

Direct antigen test for RSV

A substantial but widely varying proportion of ALRI cases are reported to be viral,²¹ although mixed viral and bacterial etiology also occurs.^21,22 Respiratory syncytial virus (RSV) is the predominant viral agent.^21,23 We are aware of only one study reporting on the risk of RSV ALRI associated with IAP finding a protective effect of exposure for severe hospitalized cases (OR = 0.31 for mothers’ cooking at least once daily, 95% CI: 0.14–0.7).²⁴ If reducing IAP does not reduce risk of RSV-related ALRI, failure to distinguish between viral and non-viral cases would mask any impact on bacterial cases. This has added significance because most ALRI deaths result from bacterial infection, probably due to their invasive nature.^21,25–27

An enzyme immunoassay test (Becton-Dickinson Directigen RSV) was performed on all children diagnosed with pneumonia (with parental consent), using naso-pharyngeal aspirate following infusion of 1 ml of normal saline. Kits include positive and negative test samples, used at the start and end of each batch. The product manual reports the sensitivity and specificity of this test to be 93–97% and 90–97% respectively.

RSV tests were completed for 236 (89.7%) of the 263 cases of physician-diagnosed pneumonia, but fewer control (87.1%) than intervention (93.6%) cases (0.05 < P < 0.1). Mean SaO₂ was 1.2% lower in cases receiving the test (NS).

Referral for chest X-ray

Initially, children diagnosed with pneumonia were referred to San Marcos Hospital for chest X-ray; from April 2004 a private clinic with better quality control was used. Due to apprehension about hospital, and barriers of travel time and cost, initially a substantial proportion of referrals did not attend. During the first six months, the study team worked to build trust and provided transport twice per week. There was less anxiety about attending the private clinic.

All CXRs used the antero-posterior view, and were conducted in 208 (79.1%) pneumonia cases, more intervention (82.3%) than control (76.3%) cases (NS). Median SaO₂ was similar in those who did and did not have a CXR. Acceptance varied over the study: lowest during the first year (70%) but rising to 90% during the second. Following training in standardized methods for pneumonia interpretation developed by WHO, two readers (MG, JB) assessed CXRs.^28,29 These were reported as: (1) normal; (2) minor changes; (3) major changes, pneumonia or bronchopneumonia, excluding 4 and 5 below; (4) lobar pneumonia or effusion; and (5) overlap between 4 and 5. Good agreement was achieved on five-way classification (Cohen’s kappa = 0.83), and 16 films with disagreement were resolved through consensus reading by two experienced WHO staff. A combination of categories 3, 4 and 5 are taken as radiological evidence of pneumonia. In an attempt to define outcome more strictly (specifically) as primary end-point pneumonia,²⁸ two additional readers reviewed all films (blind). However, agreement was unsatisfactory – all kappa values for pairs with new readers were < 0.4.

Hospital referral

Children requiring hospital admission were referred to San Marcos Hospital, with transport provided. Following discharge or death, hospital clinical information was added to study records. Two additional pneumonia cases admitted by self-referral were obtained from hospital records. CXRs were available, but neither SaO₂ nor RSV status.

Deaths

Deaths were investigated by verbal autopsy¹⁶ approximately six weeks after death. Interviews were conducted by the field project coordinator (AD) assisted by a bilingual field supervisor, and analysed blind by four WHO readers. During surveillance, 23 deaths occurred (37 per 1000 child years), of which 9 (39%) were due to pneumonia (14.9 per 1000 child years, 95% CI: 7.7–28.6). Verbal autopsies provided 6 additional pneumonia cases, yielding 271 cases in total (0.45 episodes/child/year, 95% CI: 0.40–0.50) and case fatality of 3.3%.

Discussion

The aim of the first stage of case-finding was high sensitivity. Although this cannot be calculated directly, the 47 self-referrals that resulted in a diagnosis of pneumonia provide some indication of false negatives. This must be viewed alongside the large number of cases of respiratory illness without lower respiratory signs referred by fieldworkers, which contributed 49 physician-diagnosed pneumonias. Overall, the weekly visits, referrals (ALRI and AURI) and self-referrals together probably delivered high sensitivity, a conclusion consistent with observed pneumonia rates. The finding that one-third of fieldworker-defined ALRI cases were diagnosed with pneumonia is consistent with the positive predictive value (PPV) expected from the incidence rates of upper and lower respiratory infections in this study and reported sensitivity and specificity of community case-finding.¹⁸ It was reassuring to find no evidence of bias by intervention status in the classification of children for referral.

Self-referrals to the physician did not compensate for the differential compliance with fieldworker referral by intervention status. There were more self-referrals for respiratory illness among plancha children, and slightly more of these cases were diagnosed with pneumonia in the intervention group (14.6% versus 13.0%, NS). This, combined with the higher referral compliance for respiratory illness in the plancha group, indicates that intervention cases had a consistently higher likelihood of attending the physician.

Our assessment of physician examinations focused on evidence of bias in the use of clinical signs for diagnosis. The lower proportion of pneumonia cases among intervention children with crepitations was notable. This may be an intervention outcome rather than bias, as diagnosing pneumonia more frequently among plancha children without crepitations seems counterintuitive if blinding of physicians had not been successful.

The investigations (pulse oximetry, RSV test, chest X-ray) were important for increasing specificity and objectivity in outcome assessment. Pulse oximetry was consistent with diagnosis and severity, and with other studies.¹⁹ RSV tests were carried out on almost 90% of pneumonias, but control cases had twice as many missed tests as plancha cases. The trend towards higher intervention group compliance was also seen for CXRs.

The nested case-finding allows a range of outcome definitions for analysis of risk estimates, the degree of blindness and objectivity increasing as more specific criteria are introduced (Table 9). Despite incomplete compliance with referral, the rate of physician-diagnosed pneumonia was close to that assumed for power calculation.

Conclusions

Although case-finding met the stated aims with reasonable success, there are several issues for analysis, in particular the differential compliance with referral and investigations. Although not large at any one level, this occurs at each stage of the process and will impact most on outcomes using RSV and CXR information. To address this, analyses will include risk estimates adjusted for missing data. The problem of differential compliance, combined with no apparent evidence of bias by intervention group in fieldworker classification in this study, might suggest that referral for physician assessment is not useful. However, it would seem wise to retain blinded clinical and objective (investigation-based) assessment in any trial where intervention concealment at home is not possible. Adding pulse oximetry to home visit ALRI assessment may be worthy of further investigation.

Acknowledgments

We thank Dr Alfredo Longo and Dr Sofía de León (San Marcos Hospital), Dr Carlos Santizo (Monte Sinai Clinic) and Dr Francisco Arredondo (Esperanza Hospital, Guatemala City) for their clinical assistance; Professor John Balmes and Dr Mike Gotway (University of California, San Francisco) for reading of chest X-rays; Dr Tim Clayton, London School of Hygiene and Tropical Medicine, for advice on data analysis. We appreciate the cooperation of our fieldworkers and participants, the Guatemala Ministry of Health, and funding from the US National Institute of Environmental Health Sciences (NIEHS), WHO and the AC Griffin Family Trust.

Competing interests: None declared.

References

1. Rudan I, Tomaskovic L, Boschi-Pinto C, Campbell H. Global estimate of the incidence of clinical pneumonia among children under five years of age. Bull World Health Organ 2004;82:895-903.        

2. Wardlaw T, Salama P, Johansson EW. Pneumonia: the leading killer of children. Lancet 2006;368:1048-50.        

3. Smith KR, Mehta S, Feuz M. Indoor air pollution from household use of solid fuels. In: Ezzati M, ed., Comparative quantification of health risks: global and regional burden of disease attributable to selected major risk factors. Geneva: WHO; 2004.        

4. Bruce N, Perez-Padilla R, Albalak R. Indoor air pollution in developing countries: a major environmental and public health challenge. Bull World Health Organ 2000;78:1078-92.        

5. Lanata CF, Rudan I, Boschi-Pinto C, Tomaskovic L, Cherian T, Weber M, et al. Methodological and quality issues in epidemiological studies of acute lower respiratory infections in children in developing countries. Int J Epidemiol 2004;33:1362-72.        

6. Stata [computer program]. 4905 Lakeway Drive, College Station, Texas 77845 USA: StataCorp; 2006.        

7. Albalak R, Bruce NG, McCracken JP, Smith KR. Indoor respirable particulate matter concentrations from an open fire, improved cookstove, and LPG/open fire combination in a rural Guatemalan community. Environ Sci Technol 2001;35:2650-5.        

8. Boy E, Bruce NG, Smith KR, Hernandez R. Fuel efficiency of an improved wood-burning stove in rural Guatemala: implications for health, environment and development. Energy for Sustainable Development 2000; 2:23-31. Available at: http://www.ieiglobal.org/ ESDvol4no2/ guatemala-stoveabstract.html        

9. McCracken JP, Smith KR. Emissions and efficiency of improved wood-burning cookstoves in highland Guatemala. Environ Int 1998;24:739-47.        

10. Naeher L, Smith KR, Leaderer B. Indoor and outdoor PM2.5 and CO in high- and low-density Guatemalan villages. J Expo Anal Environ Epidemiol 2000;10:544-51.        

11. Naeher LP, Smith KR, Leaderer B, Neufeld L, Mage D. Carbon monoxide as a tracer for assessing exposures to particulate matter in wood and gas cookstove households in highland Guatemala. Environ Sci Technol 2001; 35:575-81.        

12. Bruce N, McCracken J, Albalak R, Schei MA, Smith KR, Lopez V, et al. Impact of improved stoves, house construction and child location on levels of indoor air pollution and exposure in young Guatemalan children. J Expo Anal Environ Epidemiol 2004;14 Suppl 1:S26-33.        

13. Engle P, Hurtado E, Ruel M. Smoke exposure of women and young children in highland Guatemala: predictions and recall accuracy. Hum Organ 1998; 54:522-42.        

14. Naeher LP, Leaderer BP, Smith KR. Particulate matter and carbon monoxide in highland Guatemala: indoor and outdoor levels from traditional and improved wood stoves and gas stoves. Indoor Air 2000;10:200-5.        

15. Integrated management of childhood illness [online]. Geneva: WHO; 2006. Available at: http://www.who.int/ child-adolescent-health/publications/ IMCI/WHO_CHS_CAH_98.1.htm        

16. Anker M, Black RE, Coldham C, Kalter HD, Quigley MA, Ross D, et al. A standard verbal autopsy method for investigating causes of death in infants and children. Geneva: WHO; 1999 (WHO/CDS/CSR/ISR/99.4).        

17. Weber MW, Milligan P, Giadom B, Pate MA, Kwara A, Sadiq AD. Respiratory illness after severe respiratory syncytial virus disease in infancy. J Pediatr 1999;135:683-8.        

18. Weber MW, Mulholland EK, Jaffar S, Troedsson H, Gove S, Greenwood BM. Evaluation of an algorithm for the integrated management of childhood illness in an area with seasonal malaria in the Gambia. Bull World Health Organ 1997;75 Suppl 1:25-32.        

19. Lozano JM. Epidemiology of hypoxia in children with acute lower respiratory infection. Int J Tuberc Lung Dis 2001;5:496-504.        

20. Usen S, Weber M. Clinical signs of hypoxaemia in children with acute lower respiratory infection: indicators of oxygen therapy. Int J Tuberc Lung Dis 2001;5:505-10.        

21. Weber MW, Mulholland EK, Greenwood BM. Respiratory syncytial virus infection in tropical and developing countries. Trop Med Int Health 1998; 3:268-80.        

22. Weber MW, Dackour R, Usen S, Schneider G, Adegbola R, Cane P, et al. The clinical spectrum of respiratory syncytial virus disease in the Gambia. Pediatr Infect Dis J 1998;17:224-30.        

23. Robertson SE, Roca A, Alonso P, Simoes EA, Kartasasmita CB, Olaleye DO, et al. Respiratory syncytial virus infection: denominator-based studies in Indonesia, Mozambique, Nigeria and South Africa. Bull World Health Organ 2004;82:914-22.        

24. Weber MW, Milligan P, Hilton S, Lahai G, Whittle H, Mulholland EK, et al. Risk factors for severe respiratory syncytial virus infection leading to hospital admission in children in the western region of the Gambia. Int J Epidemiol 1999;28:157-62.        

25. Shann F, Barker J, Poore P. Clinical signs that predict death in children with severe pneumonia. Pediatr Infect Dis J 1989;8:852-5.        

26. Weber MW, Carlin JB, Gatchalian S, Lehmann D, Muhe L, Mulholland EK, et al. Predictors of neonatal sepsis in developing countries. Pediatr Infect Dis J 2003;22:711-7.        

27. Salih MAM, Herrmann B, Grandien M, El Hag MM, Yousif BE, Abdelbagi M, et al. Viral pathogens and clinical manifestations associated with acute lower respiratory tract infections in children of the Sudan. Clin Diagn Virol 1994; 2:201-9.        

28. Cherian T, Mulholland EK, Carlin JB, Ostensen H, Amin R, de Campo M, et al. Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Organ 2005; 83:353-9.        

29. Standardized interpretation of chest radiographs for the diagnosis of pneumonia in children. Geneva: WHO; 2001 (WHO/V7B/01.35).        

30. Low birthweight: country, regional and global estimates. New York: UNICEF; 2004.        

31. Boy E, Bruce NG, Delgado H. Birthweight and exposure to kitchen wood smoke during pregnancy. 2002. Environ Health Perspect 2002; 110:109-14.        

(Submitted: 22 August 2006 – Final revised version received: 12 January 2007 – Accepted: 7 February 2007)

1 Correspondence to Nigel Bruce (e-mail: ngb@liv.ac.uk).