Mapping priority areas for measles surveillance: stratifying reintroduction and transmission risk in Rio de Janeiro, Brazil

Elaboración de mapas de las áreas prioritarias para la vigilancia del sarampión: estratificación del riesgo de reintroducción y transmisión en Río de Janeiro (Brasil)

Mapeamento de áreas prioritárias para a vigilância do sarampo: estratificação do risco de reintrodução e transmissão no Rio de Janeiro, Brasil

Yasmin T. dos Santos Heitor L. Praça Alexandre San Pedro Larissa N.M. Reis Paula B. Conceição Gerusa Gibson About the authors

ABSTRACT

Objective.

To stratify areas at risk of measles transmission in the state of Rio de Janeiro, using the risk assessment tool developed by the World Health Organization and Centers for Disease Control and Prevention, with adaptations to the regional context.

Methods.

This ecological study used municipalities of Rio de Janeiro state as the units of analysis. The overall risk of measles transmission was evaluated based on the scores of indicators grouped into four categories: vaccination, threat assessment, quality of health care services, and living conditions. After summing and normalizing the scores for each category, weights were assigned to obtain the risk index. The 20%, 60%, and 90% centiles were used to establish cut-off points, classifying municipalities as low risk, medium risk, high risk, and very high risk. To evaluate the performance of the measles transmission risk index, a spatial overlay was performed with the cases reported in the epidemic period 2018–2020.

Results.

A progressive increase in incidence rates of measles cases was observed across municipalities, corresponding to escalating transmission risk in different strata. About 97% of measles cases occurred in municipalities classified as high or very high risk, primarily located in the state’s metropolitan region.

Conclusion.

Given the potential risk of measles transmission during the post-elimination period, our findings reinforce the importance of developing and implementing tools to identify priority areas for surveillance. The spatial overlay indicated the method’s effectiveness in identifying vulnerabilities associated with transmission other than low vaccine coverage, such as precarious living conditions and poor quality of health care services.

Keywords
Measles; risk assessment; incidence; epidemiological monitoring; Brazil

RESUMEN

Objetivo.

Estratificar las zonas que presentan riesgo de transmisión del sarampión en el estado de Río de Janeiro mediante la herramienta de evaluación del riesgo elaborada por la Organización Mundial de la Salud y los Centros para el Control y la Prevención de Enfermedades, con las debidas adaptaciones al contexto regional.

Métodos.

Para este estudio ecológico se tomaron como unidades de análisis los municipios del estado de Río de Janeiro. El riesgo general de transmisión del sarampión se evaluó mediante las puntuaciones de los indicadores agrupados en cuatro categorías: vacunación, evaluación de amenazas, calidad de los servicios de atención de salud y condiciones de vida. Después de sumar y estandarizar las puntuaciones de cada categoría, se aplicó una ponderación para obtener el índice de riesgo. Se usaron los percentiles 20, 60 y 90 como puntos de corte para clasificar los municipios como de riesgo bajo, mediano, alto y muy alto. Para evaluar el desempeño del índice de riesgo de transmisión del sarampión, se realizó una superposición espacial con los casos notificados en el periodo epidémico 2018-2020.

Resultados.

Se observó un aumento progresivo de las tasas de incidencia de casos de sarampión en todos los municipios, que correspondía a un incremento del riesgo de transmisión en los diferentes estratos. Alrededor del 97% de los casos de sarampión se produjeron en municipios clasificados como de riesgo alto o muy alto, ubicados en su mayor parte en la región metropolitana del estado.

Conclusión.

Dado el posible riesgo de transmisión del sarampión durante el periodo posterior a la eliminación, nuestros resultados destacan la importancia de diseñar y aplicar herramientas para determinar las zonas en las que la vigilancia debe ser prioritaria. La superposición espacial indicó la efectividad del método para detectar vulnerabilidades asociadas a la transmisión que se deben a factores distintos de la baja cobertura vacunal, como la precariedad de las condiciones de vida y la mala calidad de los servicios de atención de salud.

Palabras clave
Sarampión; medición de riesgo; incidencia; monitoreo epidemiológico; Brasil

RESUMO

Objetivo.

Estratificar as áreas com risco de transmissão de sarampo no estado do Rio de Janeiro, utilizando a ferramenta de avaliação de risco desenvolvida pela Organização Mundial da Saúde e pelos Centros de Controle e Prevenção de Doenças dos Estados Unidos, com adaptações para o contexto regional.

Métodos.

Estudo ecológico cujas unidades de análise foram municípios do estado do Rio de Janeiro. Avaliou-se o risco global de transmissão do sarampo com base nas pontuações de indicadores agrupados em quatro categorias: vacinação, avaliação de ameaças, qualidade dos serviços de saúde e condições de vida. Depois de somar e normalizar as pontuações em cada categoria, os dados foram ponderados para gerar o índice de risco. Os percentis de 20%, 60% e 90% foram usados como pontos de corte para classificar os municípios como de baixo, médio, alto e muito alto risco. Para avaliar o desempenho do índice do risco de transmissão do sarampo, foi feita uma análise de sobreposição espacial dos casos registrados no período epidêmico de 2018 a 2020.

Resultados.

Foi observado um aumento progressivo nas taxas de incidência do sarampo nos municípios, que correspondia ao risco crescente de transmissão em diferentes estratos. Cerca de 97% dos casos ocorreram em municípios classificados como de alto ou muito alto risco, situados principalmente na região metropolitana do estado.

Conclusão.

Dado o potencial risco de transmissão do sarampo durante o período pós-eliminação, nossos resultados reforçam a importância de desenvolver e implementar ferramentas para identificar áreas prioritárias para a vigilância. A análise de sobreposição espacial dos casos indicou a eficácia do método na identificação de vulnerabilidades associadas à transmissão que não uma baixa cobertura vacinal, como condições de vida precárias e má qualidade dos serviços de saúde.

Palavras-chave
Sarampo; medição de risco; incidência; monitoramento epidemiológico; Brasil

Despite the significant reduction in measles morbidity and mortality worldwide in the past decades, the recent resurgence of the disease at a global level underscores the need for sustainable investments in health care systems. These efforts are essential to achieve regional elimination goals for measles (11. Bidari S, Yang W. Global resurgence of measles in the vaccination era and influencing factors. Int J Infect Dis. 2024; 147:107189. https://doi.org/10.1016/j.ijid.2024.107189
https://doi.org/10.1016/j.ijid.2024.1071...
, 22. Patel MK, Goodson JL, Alexander JP, Kretsinger K, Sodha SV, Steulet C, et al. Progress toward regional measles elimination—worldwide, 2000–2018. MMWR Morb Mortal Wkly Rep. 2019;68(48):1105–11. https://doi.org/10.15585/mmwr.mm6848a1
https://doi.org/10.15585/mmwr.mm6848a1...
).

In Brazil, recent epidemics associated with difficulties in achieving vaccination coverage goals have reignited concerns about the risk of a resurgence of measles (33. Makarenko C, San Pedro A, Paiva NS, Souza-Santos R, Medronho A, Gibson G. Identification of risk areas and factors associated with the 2019 measles epidemic in the state of São Paulo. Cad Saude Publica. 2022;38 (10):e00039222. https://doi.org/10.1590/0102-311XPT039222
https://doi.org/10.1590/0102-311XPT03922...
, 44. Goldani LZ. Measles outbreak in Brazil. Braz J Infect Dis. 2018;22(5):358. https://doi.org/10.1016/j.bjid.2018.11.001
https://doi.org/10.1016/j.bjid.2018.11.0...
). In 2016, the elimination of the virus in the Region of the Americas was recognized by the World Health Organization’s (WHO’s) International Expert Committee on Monitoring and Verification of the Elimination of Measles, Rubella, and Congenital Rubella Syndrome (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
). However, since 2018, several countries in the Americas have reported measles epidemics. In Brazil, outbreaks were recorded in nine states, resulting in uninterrupted virus circulation for 12 months and the loss of the region’s certification of measles virus elimination (33. Makarenko C, San Pedro A, Paiva NS, Souza-Santos R, Medronho A, Gibson G. Identification of risk areas and factors associated with the 2019 measles epidemic in the state of São Paulo. Cad Saude Publica. 2022;38 (10):e00039222. https://doi.org/10.1590/0102-311XPT039222
https://doi.org/10.1590/0102-311XPT03922...
55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
).

Although successive declines in vaccination coverage are a main factor in the resurgence of measles, a range of socioeconomic and environmental factors contribute to the worsening of the situation. Income inequality, insufficient primary health care coverage, intense urbanization, and high household density all contribute to increased vulnerability to measles transmission. These conditions must be carefully considered when developing effective disease control policies (33. Makarenko C, San Pedro A, Paiva NS, Souza-Santos R, Medronho A, Gibson G. Identification of risk areas and factors associated with the 2019 measles epidemic in the state of São Paulo. Cad Saude Publica. 2022;38 (10):e00039222. https://doi.org/10.1590/0102-311XPT039222
https://doi.org/10.1590/0102-311XPT03922...
, 55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
).

In a coordinated effort to achieve regional measles elimination, WHO and the Centers for Disease Control and Prevention (CDC) developed a collaborative tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
). This tool is designed to monitor, guide, and sustain measles elimination efforts across the six WHO regions. By stratifying risk at subnational levels, the tool helps countries identify priority areas for measles surveillance, thus facilitating targeted actions for sustainable disease control (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
88. Harris JB, Badiane O, Lam E, Nicholson J, Oumar Ba I, Diallo A, et al. Application of the World Health Organization programmatic assessment tool for risk of measles virus transmission-lessons learned from a measles outbreak in Senegal. Risk Anal. 2016;36(9):1708–17. https://doi.org/10.1111/risa.12431
https://doi.org/10.1111/risa.12431...
).

Although stratification strategies are an inherent practice in surveillance services, global agencies and scientific studies have worked to develop new techniques and tools that can be incorporated into routine services with emphasis on various diseases, such as arboviruses (99. Vanlerberghe V, Gómez-Dantés H, Vazquez-Prokopec G, Alexander N, Manrique-Saide P, Coelho G, et al. Changing paradigms in Aedes control: considering the spatial heterogeneity of dengue transmission. Rev Panam Salud Publica. 2017;41:e16. https://doi.org/10.26633/RPSP.2017.16
https://doi.org/10.26633/RPSP.2017.16...
, 1010. Siqueira ASP, Praça HLF, Santos JPCD, Albuquerque HG, Pereira LV, Simões TC, et al. ArboAlvo: stratification method for territorial receptivity to urban arboviruses. Revista de Saúde Pública. 2022;56:e003546. https://doi.org/10.11606/s1518-8787.2022056003546
https://doi.org/10.11606/s1518-8787.2022...
), malaria (1111. World Health Organization. A framework for malaria elimination. Geneva: WHO; 2017 [cited: 2024 Oct 6]. Available from: https://iris.who.int/handle/10665/254761
https://iris.who.int/handle/10665/254761...
), and measles (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
, 66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
, 1212. Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
https://doi.org/10.26633/RPSP.2024.1...
).

In general, risk stratification methods aim to map areas most susceptible to the occurrence of a disease, on the assumption that these events are distributed heterogeneously in the territory, based on their determinants (1212. Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
https://doi.org/10.26633/RPSP.2024.1...
). The heterogeneous distribution of determinants in a territory presupposes the incorporation of surveillance strategies that allow the classification of these geographic areas according to different risk levels. Therefore, specific scenarios can be considered for which control actions can be tailored, ensuring greater effectiveness of results and rational use of resources (99. Vanlerberghe V, Gómez-Dantés H, Vazquez-Prokopec G, Alexander N, Manrique-Saide P, Coelho G, et al. Changing paradigms in Aedes control: considering the spatial heterogeneity of dengue transmission. Rev Panam Salud Publica. 2017;41:e16. https://doi.org/10.26633/RPSP.2017.16
https://doi.org/10.26633/RPSP.2017.16...
).

Despite the global resurgence of measles and the importance of identifying areas with a higher likelihood of introduction and spread of the disease, few studies have been done on the applicability of methods for stratifying areas at risk of transmission, as recommended by WHO (1212. Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
https://doi.org/10.26633/RPSP.2024.1...
).

Thus the objective of this study was to stratify areas at risk of measles reintroduction and transmission in the state of Rio de Janeiro, using the WHO/CDC risk assessment tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
), with adaptations to the regional context. Given the real risk of measles resurgence and sustained transmission in Brazil, this study is both timely and necessary, and offers the potential to implement risk analysis as a strategic tool for measles surveillance.

METHODS

Design and study area

This ecological study was conducted in the state of Rio de Janeiro using municipalities as the unit of analysis. The state is the third most populous in Brazil and is located in the south-eastern region of the country. It had an estimated population of 16 005 174 inhabitants in 2022 (1313. Instituto Brasileiro de Geografia e Estatística. Estimativas da população residente com data de referência. Rio de Janeiro;IBGE, 2022.), distributed over an area of 43 750 423 km². The state has 92 municipalities organized into nine health regions (1414. Fundação Centro Estadual de Estatísticas, Pesquisas e Formação de Servidores Públicos do Rio de Janeiro. Conteud [website]. Rio de Janeiro: CEPERJ; 2017 [cited: 2023 Jul 20]. Available from: http://www.ceperj.rj.gov.br/Conteudo.asp?ident=64. Acesso em: 20 jul. 2023.
http://www.ceperj.rj.gov.br/Conteudo.asp...
). About 73% of the state’s gross domestic product is concentrated in two metropolitan regions (Metropolitan I and II), with the capital Rio de Janeiro alone accounting for 46% of this total (1515. Davidovich F. Estado do Rio De Janeiro: O Urbano Metropolitano. Hipóteses e Questões. Geo UERJ. 2010;2(21):1–23. https://doi.org/10.12957/geouerj.2010.1474
https://doi.org/10.12957/geouerj.2010.14...
).

Rio de Janeiro state was selected due to the significant measles epidemic that occurred in 2019–2020. Furthermore, as one of the country’s leading tourist destinations, the state may be a hub for the introduction and spread of etiological agents, a risk further exacerbated by its high population density and pronounced social inequalities (1616. Instituto Brasileiro de Geografia e Estatística. Cidades e Estados [internet]. Rio de Janeiro: IBGE; 2024 [cited: 2024 Sep 23]. Available from: https://www.ibge.gov.br/cidades-e-estados.html
https://www.ibge.gov.br/cidades-e-estado...
).

Global programmatic risk assessment tool

The risk matrix is an important management tool used to identify the type a specific event and degree of threat it poses to a population (1717. Briones Gamboa F. La complejidad del riesgo: breve análisis transversal [The complexity of risk: brief cross-sectional analysis]. Rev Universidad Cristobal Colon. 2005;20:9–19.). It must be flexible and adaptable to the context in which it is used, where demographic, programmatic, and health condition data are combined for the risk analysis (1818. Gallegos D, Vergara N, Gatica L, Castillo C, Basaldúa A, Guerrero R, et al. Matriz de riesgo para estimar brotes importados de sarampión o rubéola aplicada a Chile [Risk matrix for estimating imported outbreaks of measles or rubella in Chile]. Rev Panam Salud Publica. 2017;41:e47. https://doi.org/10.26633/rpsp.2017.047
https://doi.org/10.26633/rpsp.2017.047...
). To combine efforts to eliminate measles and encourage the efficient use of resources, the measles risk assessment tool was developed by WHO and CDC to assess measles risk at a subnational level. The tool is based on the stratification of transmission risk areas and aims to guide countries in mapping priority locations, where programmatic weaknesses require intensified surveillance and control actions (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
).

In broad terms, the method classifies areas based on a score assigned to a set of indicators known to be associated with the risk of measles transmission, grouped into four main categories: surveillance quality; immunization program performance; population immunity; and threat assessment. The threat assessment category includes indicators that give a measure of the potential for importation and transmission of the measles virus within a population. The population immunity category includes indicators that aim to characterize the degree of measles immunity within the population. In the surveillance quality category, indicators are used to express, to some extent, the performance of case surveillance for rapid detection of the virus. In the program performance category, specific aspects of routine immunization programs are evaluated, as well as trends in measles vaccine coverage for the first and second doses (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
).

For each of these categories, a weight defined by expert consensus (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
) was assigned. Thus, for each unit of analysis (area), an overall score is obtained from the weighted average of the four dimensions, where the cut-off criteria for risk categories (low, medium, high, and very high) are defined at the 50th, 75th, and 90th centiles of the distribution. Areas identified as high or very high risk by the tool can, for example, be prioritized for reinforced surveillance actions, implementation of supplementary immunization measures to achieve higher vaccine coverage, and planning responses for measles outbreaks (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
).

Stratification of measles transmission risk areas

Based on the understanding of the biological, socioeconomic, and programmatic determinants of measles transmission listed in the WHO/CDC risk stratification tool and described in other publications, a matrix of municipal indicators for the state of Rio de Janeiro was proposed. In this matrix, the calculation methods, associated hypotheses, data source/information system, and respective bibliographic references were described. Initially, 29 indicators that relate to factors recognized as associated with the direct or indirect risk of measles transmission were proposed. Next, a search was conducted in publicly accessible databases, information systems, and government websites to collect data on municipal indicators and create a single database.

For the indicators for which data were available, a descriptive analysis was performed, including the calculation of measures of central tendency and dispersion, which aimed to identify those indicators with the highest variability within each category. Of the 29 indicators initially listed, 12 were retained in the matrix and classified according to the categories suggested in the WHO/CDC tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
), with some adaptations: vaccination coverage, threat assessment, quality of health services, and living conditions.

Data on epidemiology, live births, and immunization were obtained from the DATASUS website (1919. DATASUS [website]. Brasilia: Ministério da Saúde; 2024 [cited: 2023 Oct 8]. Available from: https://datasus.saude.gov.br/informacoes-de-saude-tabnet/
https://datasus.saude.gov.br/informacoes...
), while socioeconomic and population estimates were obtained from the Instituto Brasileiro de Geografia e Estatística (IBGE). Table 1 shows the 12 indicators by category, calculation method, associated hypotheses, data source, and relevant references.

TABLE 1.
Indicators for the risk of measles transmission used at the municipal level, Rio de Janeiro, 2023

Framework of risk categories, indicators, and scoring

A scoring criterion was applied to the indicators for each of the four categories using the WHO/CDC measles risk assessment tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
) as a reference. For those indicators that did not have a reference in the WHO/CDC tool, the scoring was based on measures of central tendency and dispersion. For each of the four categories, the risk of measles transmission was evaluated by summing the scores obtained for each of its indicators. The cut-off points for the indicators in the threat assessment and vaccination categories were based on the WHO/CDC measles risk assessment tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
), while the indicators in the quality of health services and living conditions categories had cut-off points based on the 20th, 60th, and 90th centiles of the distribution. The maximum score that a municipality could receive in the vaccination category was 8 points. In the threat assessment, quality of health services, and living conditions categories, the maximum scores were, respectively, 13, 4, and 8 points (Table 2).

TABLE 2.
Cut-off points and scores of the indicators by category

To make the categories comparable, normalization was performed based on the minimum and maximum values according to the formula: (Xi – XMin)/(XMax – XMin), where: Xi is the sum of the indicators in each category; XMin is the minimum observed value of the category distribution; and XMax is the maximum value of the indicator in the dimension. Once the categories were normalized, the measles transmission risk index was obtained through a weighted average by category, with the following weights assigned: vaccination (40%), threat assessment (30%), quality of health services (15%), and living conditions (15%).

In the vaccination category, which received the highest weight, the WHO/CDC measles risk assessment tool (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
) was used as a reference. In this category, the aim was to characterize population immunity and overall susceptibility to measles through the measles vaccination coverage indicator. Indirectly, this category also reflects the performance of immunization programs.

The other categories had their weights redistributed based on their relationship with measles, considering the context of the state of Rio de Janeiro. The threat assessment category in the tool proposed by WHO/CDC (66. Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
https://doi.org/10.1111/risa.12409...
) originally received a weight of 24%. In the present analysis, threat assessment received a weight of 30% due to its importance in virus transmission related to the movement of sick individuals. We combined indicators that potentially express a higher risk of importation and transmission of the measles virus in the area unit under analysis, such as demographic density and recorded cases in a neighboring municipality.

The surveillance quality category in the WHO/CDC tool had a weight of 20%. In our analysis, surveillance quality was replaced by quality of health services to which we assigned a weight of 15%. This category combined indicators that serve as markers of access to and quality of health services provided to the population, such as infant mortality and access to prenatal care. Consequently, municipalities with higher rates of infant mortality and reduced coverage of prenatal services tend to have lower overall coverage and quality of health care services, presenting a higher risk for the introduction and transmission of the measles virus.

The program performance category was weighted at 16% in the WHO/CDC tool. We replaced this category with the living conditions category, which we weighted at 15%.

Such changes in categories were incorporated into the study based on the understanding that measles determinants are not restricted solely to the quality of surveillance services and vaccination coverage, although these are crucial factors for interrupting transmission. In this case, living conditions and the quality of health services are fundamental aspects to ensure access to the resources necessary for maintaining the health of this population (Table 3).

TABLE 3.
Weighting of categories used for the calculation of measles transmission risk areas in the state of Rio de Janeiro, Brazil

Once the value of the measles transmission risk index was obtained for each municipality, the 20th, 60th, and 90th centiles were used to establish cut-off points and classify them as low risk, medium risk, high risk, or very high risk (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
). The classification result of the municipalities was visualized through a choropleth map. To evaluate the performance of the measles transmission risk index, a spatial overlay was performed with the cases reported during the subsequent epidemic period (2018–2020), provided by the Notifiable Diseases Information System (SINAN, Brazilian acronym). The spatial analyses were conducted using QGIS software, version 3.3.4, and the statistical analyses were performed using R software version 4.3.2.

Ethics

We used secondary data obtained from publicly available databases, aggregated in the form of indicators expressed at the municipality level, with no possibility of subject identification and no involvement of human subjects. The study was approved by the Research Ethics Committee of the Instituto de Estudos em Saúde Coletiva of the Universidade Federal do Rio de Janeiro, under protocol number CAAE 76661723.3.0000.5286.

RESULTS

The spatial analysis of the measles transmission risk index showed a higher concentration of municipalities with a very high risk in the Metropolitan region of the State of Rio de Janeiro, while the Serrana, north, and southern parts of the Médio Paraíba regions had a concentration of municipalities with a high risk.

When analyzing the spatial overlap of the risk index with the reported measles cases in the subsequent epidemic period, a progressive increase in incidence rates was seen as the transition was made from municipalities categorized as low risk to those classified as very high risk of transmission. The incidence rates by risk index categories varied considerably, ranging from 0.5 to 16.0 cases per 100 000 inhabitants (Figure 1 and Table 4).

FIGURE 1.
Spatial overlay of the measles transmission risk index and absolute frequency of measles cases during the epidemic period (2018–2020) in municipalities in the state of Rio de Janeiro, Brazil
TABLE 4.
Frequency of measles cases and measles incidence, by risk classification in the state of Rio de Janeiro, Brazil, 2018–2020

In the subsequent epidemic period (2018–2020), 97.3% of cases occurred in residents of municipalities classified as high or very high risk. Both risk classes are predominantly composed of municipalities located in the Metropolitan region. The high-risk class had the greatest number of cases due to the presence of the municipality of Rio de Janeiro, which had the most notifications during the period, followed by municipalities in the Serrana region, Baía de Ilha Grande, and the Northern region of the state.

The visual analysis of the spatial overlap of the risk index with the frequency of reported cases during the recent epidemic transmission period (2018–2020) in the state corroborates the findings. There was a concentration of cases in municipalities classified as high and very high risk, specifically in municipalities in the Metropolitan region (including Rio de Janeiro, Mesquita, São João do Meriti, Belford Roxo, Duque de Caxias, Magé, Japeri, Queimados, Nova Iguaçu, Niteroi, and São Gonçalo), as well as in the Serrana region, particularly in the municipalities of Petropolis and Nova Friburgo. Additionally, the municipality of Paraty, in the Médio Paraíba region, also stood out with a classification of very high risk and a relatively high frequency of cases (Figure 1).

DISCUSSION

Our findings indicate a relative spatial agreement between areas of high and very high risk of measles transmission and the occurrence of cases reported in the subsequent epidemic period (2018–2020). This demonstrates a good performance of the risk index in identifying vulnerabilities for measles transmission other than low vaccination coverage, such as precarious living conditions, low quality of health services, and the threat of importation of cases.

Given that the base tool is a general guideline recommended for countries in the six WHO regions, it is essential to adapt it according to the availability of data and the organization of local health care systems to reflect regional characteristics and ensure the instrument’s effectiveness (1212. Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
https://doi.org/10.26633/RPSP.2024.1...
).

In Brazil, the only known application of the WHO/CDC tool to date was in 2017 with data from 184 municipalities in the state of Ceará, in north-eastern Brazil (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
). In that study, the authors made adaptations by introducing the organizational structure category for public health response, which included indicators of coverage by the Family Health Strategy and by community health workers. Additionally, three categories were created: (i) impact, which gathered information on indicators of malnutrition and infant mortality; (ii) quality of immunization programs and epidemiological surveillance, which gathered information on indicators of vaccine coverage by doses, dropout rate, and notification rate of exanthematous diseases; and (iii) municipal characteristics, which gathered information on indicators of tourism, violence, urbanization, vulnerability, Human Development Index, and municipal resources spent on health. Thus, both the proposition and the criteria for selecting indicators that compose the risk index were adapted to characterize the state context (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
). The study further demonstrated that 94.7% of the cases during the 2013–2015 epidemic period in Ceará state occurred in municipalities classified as high or very high risk, a proportion slightly lower than the 97.3% observed in our study (55. Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
https://doi.org/10.26633/RPSP.2017.157...
).

In the Region of the Americas, another experience in analyzing the risk of measles transmission was a study in Chile, where the authors developed a risk matrix to assess the ongoing risk of outbreaks of measles and rubella associated with the importation of cases. However, the authors did not validate the method through spatial overlap of cases and incidence rates (1818. Gallegos D, Vergara N, Gatica L, Castillo C, Basaldúa A, Guerrero R, et al. Matriz de riesgo para estimar brotes importados de sarampión o rubéola aplicada a Chile [Risk matrix for estimating imported outbreaks of measles or rubella in Chile]. Rev Panam Salud Publica. 2017;41:e47. https://doi.org/10.26633/rpsp.2017.047
https://doi.org/10.26633/rpsp.2017.047...
). On the other hand, a study in Namibia evaluated the WHO risk assessment tool using data from a measles outbreak that occurred in 2009 (2626. Kriss JL, Harris JB, Stanescu A, Pistol A, Butu C, Goodson JL. Development of the World Health Organization measles programmatic risk assessment tool using experience from the 2009 measles outbreak in Namibia. Risk Anal. 2017;37(6):1072–81. https://doi.org/10.1111/risa.12544
https://doi.org/10.1111/risa.12544...
). In this study, the authors compared districts classified as high risk based on 2006–2008 data with the incidence of the disease during the 2009 outbreak. The authors concluded that districts classified as high or very high risk based on 2006–2008 data generally experienced higher measles incidence during the outbreak in 2009. This pattern was also observed in several districts categorized as medium or low risk (2626. Kriss JL, Harris JB, Stanescu A, Pistol A, Butu C, Goodson JL. Development of the World Health Organization measles programmatic risk assessment tool using experience from the 2009 measles outbreak in Namibia. Risk Anal. 2017;37(6):1072–81. https://doi.org/10.1111/risa.12544
https://doi.org/10.1111/risa.12544...
).

Recently, a systematic review of scientific publications on experiences in applying methods of stratification of measles transmission risk areas worldwide concluded that, despite the relevance of the topic, such experiences are still not well disseminated (1212. Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
https://doi.org/10.26633/RPSP.2024.1...
). This limitation restricts our ability to compare our findings with those of other studies conducted in countries that have successfully achieved measles elimination. Therefore, our study represents a new reference in the state of Rio de Janeiro, whose findings can support disease surveillance, either by identifying the priority municipalities at the regional level or by providing opportunities to discriminate, at the local level, the categories and indicators that contribute to the municipality’s higher risk classification. Furthermore, this analysis can support managers to develop actions aimed at addressing aspects of measles transmission other than immunization.

In our study, some indicators initially intended to be used in the four categories were not included in the final matrix due to the unavailability of data at the municipal level, such as those related to the flow of national and international tourists and intermunicipal mobility. This highlights the need for investment in the systematic production of secondary data to better qualify the processes of infectious disease transmission with adequate quality and coverage for this level of analysis. This aspect has been identified in other studies as a limiting factor for the application of methods for stratifying areas of measles transmission (77. Goel K, Naithani S, Bhatt D, Khera A, Sharapov UM, Kriss JL, et al. The World Health Organization measles programmatic risk assessment tool-pilot testing in India, 2014. Risk Anal. 2017;37(6):1063–71. https://doi.org/10.1111/risa.12615
https://doi.org/10.1111/risa.12615...
, 1818. Gallegos D, Vergara N, Gatica L, Castillo C, Basaldúa A, Guerrero R, et al. Matriz de riesgo para estimar brotes importados de sarampión o rubéola aplicada a Chile [Risk matrix for estimating imported outbreaks of measles or rubella in Chile]. Rev Panam Salud Publica. 2017;41:e47. https://doi.org/10.26633/rpsp.2017.047
https://doi.org/10.26633/rpsp.2017.047...
, 2626. Kriss JL, Harris JB, Stanescu A, Pistol A, Butu C, Goodson JL. Development of the World Health Organization measles programmatic risk assessment tool using experience from the 2009 measles outbreak in Namibia. Risk Anal. 2017;37(6):1072–81. https://doi.org/10.1111/risa.12544
https://doi.org/10.1111/risa.12544...
, 2727. Kriss JL, Stanescu A, Pistol A, Butu C, Goodson JL. The World Health Organization measles programmatic risk assessment tool-Romania, 2015. Risk Anal. 2017;37(6):1096–107. https://doi.org/10.1111/risa.12669
https://doi.org/10.1111/risa.12669...
).

Another limitation was the use of outdated population estimates as denominators for many of the indicators. Given the delay in conducting and releasing data from the Brazilian demographic census of 2022, intercensal estimates based on population growth between the censuses of 2000 and 2010 were used, which may have resulted in inaccuracies in the indicators. Similarly, it is important to consider the use of outdated indicators of living conditions which came from the 2010 census.

Finally, it should be again noted that this tool is not predictive and should be used to guide strategies in priority municipalities threatened by the emergence of the measles virus. In the face of inadequate vaccination coverage, aspects such as living conditions, quality of health services, and indicators of threat (population density and transmission in neighboring municipalities) should be considered in disease prevention and control strategies. In this regard, it is important to highlight the need for intersectoral and coordinated actions between the surveillance systems of border municipalities located in areas classified as high and very high risk, to guide planning efforts aimed at achieving and maintaining disease elimination goals.

Conclusion

The findings of our study reinforce the importance of developing and implementing tools for stratifying measles risk areas to highlight border regions requiring greater intermunicipal coordination for surveillance and achievement of elimination goals. The spatial overlap of high and very high-risk areas with cases from the subsequent period demonstrated the method’s effectiveness in identifying vulnerabilities associated with transmission other than low vaccine coverage, such as precarious living conditions, poor quality of health care services, and factors associated with importation of cases.

Disclaimer.

The authors hold sole responsibility for the views expressed in the manuscript, which may not necessarily reflect the opinion or policy of the Revista Panamericana de Salud Pública / Pan American Journal of Public Health and/or those of the Pan American Health Organization and the World Health Organization.

REFERENCES

  • 1.
    Bidari S, Yang W. Global resurgence of measles in the vaccination era and influencing factors. Int J Infect Dis. 2024; 147:107189. https://doi.org/10.1016/j.ijid.2024.107189
    » https://doi.org/10.1016/j.ijid.2024.107189
  • 2.
    Patel MK, Goodson JL, Alexander JP, Kretsinger K, Sodha SV, Steulet C, et al. Progress toward regional measles elimination—worldwide, 2000–2018. MMWR Morb Mortal Wkly Rep. 2019;68(48):1105–11. https://doi.org/10.15585/mmwr.mm6848a1
    » https://doi.org/10.15585/mmwr.mm6848a1
  • 3.
    Makarenko C, San Pedro A, Paiva NS, Souza-Santos R, Medronho A, Gibson G. Identification of risk areas and factors associated with the 2019 measles epidemic in the state of São Paulo. Cad Saude Publica. 2022;38 (10):e00039222. https://doi.org/10.1590/0102-311XPT039222
    » https://doi.org/10.1590/0102-311XPT039222
  • 4.
    Goldani LZ. Measles outbreak in Brazil. Braz J Infect Dis. 2018;22(5):358. https://doi.org/10.1016/j.bjid.2018.11.001
    » https://doi.org/10.1016/j.bjid.2018.11.001
  • 5.
    Lemos DRQ, Franco AR, Garcia MHO, Pastor D, Bravo-Alcantara P, Moraes JC, et al. Risk analysis for the reintroduction and transmission of measles in the post-elimination period in the Americas. Rev Panam Salud Publica. 2018;41:e157. https://doi.org/10.26633/RPSP.2017.157
    » https://doi.org/10.26633/RPSP.2017.157
  • 6.
    Lam E, Schluter WW, Masresha BG, Teleb N, Bravo-Alcántara P, Shefer A, et al. Development of a district-level programmatic assessment tool for the risk of measles virus transmission. Risk Anal. 2017;37(6):1052–62. https://doi.org/10.1111/risa.12409
    » https://doi.org/10.1111/risa.12409
  • 7.
    Goel K, Naithani S, Bhatt D, Khera A, Sharapov UM, Kriss JL, et al. The World Health Organization measles programmatic risk assessment tool-pilot testing in India, 2014. Risk Anal. 2017;37(6):1063–71. https://doi.org/10.1111/risa.12615
    » https://doi.org/10.1111/risa.12615
  • 8.
    Harris JB, Badiane O, Lam E, Nicholson J, Oumar Ba I, Diallo A, et al. Application of the World Health Organization programmatic assessment tool for risk of measles virus transmission-lessons learned from a measles outbreak in Senegal. Risk Anal. 2016;36(9):1708–17. https://doi.org/10.1111/risa.12431
    » https://doi.org/10.1111/risa.12431
  • 9.
    Vanlerberghe V, Gómez-Dantés H, Vazquez-Prokopec G, Alexander N, Manrique-Saide P, Coelho G, et al. Changing paradigms in Aedes control: considering the spatial heterogeneity of dengue transmission. Rev Panam Salud Publica. 2017;41:e16. https://doi.org/10.26633/RPSP.2017.16
    » https://doi.org/10.26633/RPSP.2017.16
  • 10.
    Siqueira ASP, Praça HLF, Santos JPCD, Albuquerque HG, Pereira LV, Simões TC, et al. ArboAlvo: stratification method for territorial receptivity to urban arboviruses. Revista de Saúde Pública. 2022;56:e003546. https://doi.org/10.11606/s1518-8787.2022056003546
    » https://doi.org/10.11606/s1518-8787.2022056003546
  • 11.
    World Health Organization. A framework for malaria elimination. Geneva: WHO; 2017 [cited: 2024 Oct 6]. Available from: https://iris.who.int/handle/10665/254761
    » https://iris.who.int/handle/10665/254761
  • 12.
    Conceição PB, San Pedro A, Praça HLF, dos Santos YT, Reis LNM TC, Gibson G. Estratificação de áreas de risco de transmissão de sarampo: uma revisão sistemática [Stratification of risk areas for measles transmission: a systematic review]. Rev Panam Salud Publica. 2024;48:e1 https://doi.org/10.26633/RPSP.2024.1
    » https://doi.org/10.26633/RPSP.2024.1
  • 13.
    Instituto Brasileiro de Geografia e Estatística. Estimativas da população residente com data de referência. Rio de Janeiro;IBGE, 2022.
  • 14.
    Fundação Centro Estadual de Estatísticas, Pesquisas e Formação de Servidores Públicos do Rio de Janeiro. Conteud [website]. Rio de Janeiro: CEPERJ; 2017 [cited: 2023 Jul 20]. Available from: http://www.ceperj.rj.gov.br/Conteudo.asp?ident=64 Acesso em: 20 jul. 2023.
    » http://www.ceperj.rj.gov.br/Conteudo.asp?ident=64
  • 15.
    Davidovich F. Estado do Rio De Janeiro: O Urbano Metropolitano. Hipóteses e Questões. Geo UERJ. 2010;2(21):1–23. https://doi.org/10.12957/geouerj.2010.1474
    » https://doi.org/10.12957/geouerj.2010.1474
  • 16.
    Instituto Brasileiro de Geografia e Estatística. Cidades e Estados [internet]. Rio de Janeiro: IBGE; 2024 [cited: 2024 Sep 23]. Available from: https://www.ibge.gov.br/cidades-e-estados.html
    » https://www.ibge.gov.br/cidades-e-estados.html
  • 17.
    Briones Gamboa F. La complejidad del riesgo: breve análisis transversal [The complexity of risk: brief cross-sectional analysis]. Rev Universidad Cristobal Colon. 2005;20:9–19.
  • 18.
    Gallegos D, Vergara N, Gatica L, Castillo C, Basaldúa A, Guerrero R, et al. Matriz de riesgo para estimar brotes importados de sarampión o rubéola aplicada a Chile [Risk matrix for estimating imported outbreaks of measles or rubella in Chile]. Rev Panam Salud Publica. 2017;41:e47. https://doi.org/10.26633/rpsp.2017.047
    » https://doi.org/10.26633/rpsp.2017.047
  • 19.
    DATASUS [website]. Brasilia: Ministério da Saúde; 2024 [cited: 2023 Oct 8]. Available from: https://datasus.saude.gov.br/informacoes-de-saude-tabnet/
    » https://datasus.saude.gov.br/informacoes-de-saude-tabnet/
  • 20.
    Costa Mda C, Mota EL, Paim JS, da Silva LM, Teixeira Mda G, Mendes CM. Mortalidade infantil no Brasil em períodos recentes de crise econômica [Infant mortality in Brazil during recent periods of economic crisis]. Rev Saude Publica. 2003;37(6):699–706. https://doi.org/10.1590/s0034-89102003000600003
    » https://doi.org/10.1590/s0034-89102003000600003
  • 21.
    Lo Ré MM, do Nascimento ACAS, da Fonseca MRCC. Caracterização da assistência pré-natal no Brasil segundo diferenças regionais e fatores associados às condições maternas [Characterization of prenatal care in Brazil according to regional differences and factors associated with maternal attributes]. Res Soc Devel. 2022;11(4):1–12. https://doi.org/10.33448/rsd-v11i4.27180
    » https://doi.org/10.33448/rsd-v11i4.27180
  • 22.
    Rosemberg F, Piza E. Analfabetismo, gênero e raça no Brasil [Illiteracy, gender and race in Brazil]. Rev USP. 1996;28:110–21. https://doi.org/10.11606/issn.2316-9036.v0i28p110-121
    » https://doi.org/10.11606/issn.2316-9036.v0i28p110-121
  • 23.
    Pinto JM, Brant LNN, Sampaio CE, Pascom AR. Um olhar sobre os indicadores de analfabetismo no Brasil [A look at illiteracy indicators in Brazil]. Rev Bras Estud Pedagog. 2000;81(199):511–24. https://doi.org/10.24109/2176-6681.rbep.81i199.971
    » https://doi.org/10.24109/2176-6681.rbep.81i199.971
  • 24.
    RazzolinI MTP, Günther WMR. Impactos na saúde das deficiências de acesso a água (Impacts on health of inadequate access to water). Saude Soc. 2008;17(1):21–32. https://doi.org/10.1590/S0104-12902008000100003
    » https://doi.org/10.1590/S0104-12902008000100003
  • 25.
    Nakamura E, Egry EY, Campos CM, Nichiata LY, Chiesa AM, Takahashi RF.. The potential of an instrument to identify social vulnerabilities and health needs: collective health knowledge and practices. Rev Lat Am Enfermagem. 2009;17(2):253–8. https://doi.org/10.1590/s0104-11692009000200018
    » https://doi.org/10.1590/s0104-11692009000200018
  • 26.
    Kriss JL, Harris JB, Stanescu A, Pistol A, Butu C, Goodson JL. Development of the World Health Organization measles programmatic risk assessment tool using experience from the 2009 measles outbreak in Namibia. Risk Anal. 2017;37(6):1072–81. https://doi.org/10.1111/risa.12544
    » https://doi.org/10.1111/risa.12544
  • 27.
    Kriss JL, Stanescu A, Pistol A, Butu C, Goodson JL. The World Health Organization measles programmatic risk assessment tool-Romania, 2015. Risk Anal. 2017;37(6):1096–107. https://doi.org/10.1111/risa.12669
    » https://doi.org/10.1111/risa.12669

Publication Dates

  • Publication in this collection
    20 Dec 2024
  • Date of issue
    2024

History

  • Received
    16 Sept 2024
  • Accepted
    26 Sept 2024
Organización Panamericana de la Salud Washington - Washington - United States
E-mail: contacto_rpsp@paho.org