Abstract

Objective:

To evaluate the measles epidemiological surveillance system, before and during the COVID-19 pandemic in Pernambuco, Brazil.

Methods:

This was a descriptive evaluation of the quality (duplicity; completeness; consistency), timeliness and usefulness attributed, classified as excellent ≥ 90.0%, regular ≥ 70.0% and < 90.0%, and poor (< 70.0%). Data from the Notifiable Health Conditions Information System and Laboratory Environment Management System were used, before (03/11/2018-03/10/2020) and during (03/11/2020-03/10/2022) the pandemic.

Results:

1,548 suspected measles cases were registered (1,469 before and 79 during the pandemic). In the two periods studied, there were 11 and 1 duplicate records, average completeness in filling out the variables was 99.2% and 95.7%, while average consistency was 96.7% and 97.5%, respectively. Timeliness (receipt of samples, 16.2% and 33.0%. Release of results, 1.3% and 1.3%) and usefulness (43.5% and 24.4%) were poor.

Conclusion:

Quality was classified as excellent in the periods studied, timeliness and usefulness were classified as poor, signaling non-compliance with the purpose of the system.

Keywords:
Health Evaluation; Epidemiological Monitoring; Measles; COVID-19; Communicable Diseases; Health Information System

Study contributions

Main results

The quality of data from the measles epidemiological surveillance system in Pernambuco was excellent, while its timeliness and usefulness were poor during both periods.

Implications for services

The limited timeliness and, therefore, the low usefulness of the measles epidemiological surveillance system must be discussed in the three government spheres of health service management, with the aim of training the professionals involved, as well as monitoring and evaluating the system.

Perspectives

Systematic monitoring and evaluation generates evidence that supports health service managers and workers in the timely identification of gaps that compromise the full fulfillment of the objectives proposed.

Keywords:
Health Evaluation; Epidemiological Monitoring; Measles; COVID-19; Communicable Diseases; Health Information System

Resumen

Objetivo:

Evaluar el sistema de vigilancia epidemiológica del sarampión, antes y durante la pandemia de covid-19 en Pernambuco, Brasil.

Métodos:

Evaluación descriptiva de los atributos calidad (duplicidad; exhaustividad; consistencia), oportunidad y utilidad, clasificados en óptimo ≥ 90,0%, regular ≥ 70,0% y < 90,0%, y malo (< 70,0%). Se utilizaron datos del Sistema de Información de Enfermedades de Declaración Obligatoria y Sistema de Gestión Ambiental de Laboratorio, antes (11/03/2018-10/03/2020) y durante la pandemia (11/03/2020-10/03/2022).

Resultados:

Se registraron 1.548 casos sospechosos de sarampión (1.469 antes y 79 durante la pandemia). En dos períodos estudiados hubo duplicidad de 11 y 1 registros, completitud en llenado de variables - medias de 99,2% y 95,7% - y consistencia - medias de 96,7% y 97,5% -, respectivamente. La puntualidad - recepción de muestra, 16,2% y 33,0%. Publicación de resultados, 1,3% y 1,3% - y utilidad - 43,5% y 24,4% - fueron malas.

Conclusión:

La calidad fue calificada como óptima pero la oportunidad y la utilidad, como malas, indicando incumplimiento del propósito del sistema.

Palabras clave:
Evaluación en Salud; Monitoreo Epidemiológico; Sarampión; COVID-19; Enfermedades Transmisibles; Sistema de Información en Salud

INTRODUCTION

Measles is a viral disease, with universal distribution, endemic in large urban conglomerates where vaccination coverage is not homogeneous.¹1. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Coordenação-Geral de Desenvolvimento da Epidemiologia em Serviços. Guia de Vigilância em Saúde: volume único [Internet]. 3. ed. Brasília: Ministério da Saúde; 2019 [citado 2021 Jan 26]. 740 p. Disponível em: Disponível em: https://bvsms.saude.gov.br/bvs/publicacoes/guia_vigilancia_saude_3ed.pdf .
https://bvsms.saude.gov.br/bvs/publicaco... ^),(22. Adamo G, Sturabotti G, Baccolini V, Soccio P, Prencipe GP, Bella A, et al. Regional reports for the subnational monitoring of measles elimination in Italy and the identification of local barriers to the attainment of the elimination goal. PLoS ONE. 2018;13(10):e0205147. doi: 10.1371/journal.pone.0205147.
https://doi.org/10.1371/journal.pone.020... Its prevention requires, in particular, 95% vaccination coverage, isolation of suspected/confirmed cases and selective immunization of contacts within 72 hours.¹1. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Coordenação-Geral de Desenvolvimento da Epidemiologia em Serviços. Guia de Vigilância em Saúde: volume único [Internet]. 3. ed. Brasília: Ministério da Saúde; 2019 [citado 2021 Jan 26]. 740 p. Disponível em: Disponível em: https://bvsms.saude.gov.br/bvs/publicacoes/guia_vigilancia_saude_3ed.pdf .
https://bvsms.saude.gov.br/bvs/publicaco...

In Brazil, measles has been a notifiable disease since 1968 and, with the creation of the national immunization program in 1975, the first national measles vaccination campaign in 1992, along with surveillance, cases and deaths decreased consistently until the certification of its elimination in 2016.³3. Secretaria da Saúde (São Paulo). Centro de Vigilância Epidemiológica “Prof. Alexandre Vranjac”. 8ª Campanha Nacional de Seguimento e de Vacinação dos Trabalhadores da Saúde contra o Sarampo [Internet]. São Paulo: Secretaria de Saúde; 2022 [citado 2022 Ago 19].14 p. Disponível em: Disponível em: https://www.saude.sp.gov.br/resources/cve-centro-de-vigilancia-epidemiologica/areas-de-vigilancia/imunizacao/2022/sarampo250322_campanha_seguimento_trabsaude.pdf
https://www.saude.sp.gov.br/resources/cv... ^),(44. Pan American Health Organization. Plan of Action for the Sustainability of Measles, Rubella, and Congenital Rubella Syndrome Elimination in the Americas 2018-2023 - 160th session of the Executive Committee [Internet]. Washington: Pan American Health Organization; 2017 [cited 2021 Jan 26]. 3 p. Available from: Available from: https://iris.paho.org/bitstream/handle/10665.2/34254/CE160-r2-e.pdf?sequence=1&isAllowed=y .
https://iris.paho.org/bitstream/handle/1... However, two years after that achievement, the virus began circulating again and 10,346 cases were confirmed in the Brazil, four of them in Pernambuco; 12 months later, transmission remained active and circulation was endemic.⁵5. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Boletim epidemiológico nº 12 - Vigilância epidemiológica do sarampo no Brasil - semanas epidemiológicas 1 a 9 de 2021[Internet]. Brasília: Ministério da Saúde; 2021 [citado 2022 Maio 16]. 15 p. Disponível em: Disponível em: https://www.gov.br/saude/pt-br/centrais-de-conteudo/publicacoes/boletins/boletins-epidemiologicos/edicoes/2021/boletim_epidemiologico_svs_12.pdf .
https://www.gov.br/saude/pt-br/centrais-...

With the reintroduction of the virus, epidemiological surveillance sought to immediately identify and report every suspected case on the Notifiable Health Conditions Information System (Sistema de Informação de Agravos de Notificação - SINAN), and establish appropriate control measures.⁵5. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Boletim epidemiológico nº 12 - Vigilância epidemiológica do sarampo no Brasil - semanas epidemiológicas 1 a 9 de 2021[Internet]. Brasília: Ministério da Saúde; 2021 [citado 2022 Maio 16]. 15 p. Disponível em: Disponível em: https://www.gov.br/saude/pt-br/centrais-de-conteudo/publicacoes/boletins/boletins-epidemiologicos/edicoes/2021/boletim_epidemiologico_svs_12.pdf .
https://www.gov.br/saude/pt-br/centrais-... SINAN system data is routinely generated by the epidemiological surveillance system, providing essential information for analyzing the population’s health situation, developing public policies, establishing priorities and proposing actions to address infections, diseases and related health problems, including epidemics.⁵5. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Boletim epidemiológico nº 12 - Vigilância epidemiológica do sarampo no Brasil - semanas epidemiológicas 1 a 9 de 2021[Internet]. Brasília: Ministério da Saúde; 2021 [citado 2022 Maio 16]. 15 p. Disponível em: Disponível em: https://www.gov.br/saude/pt-br/centrais-de-conteudo/publicacoes/boletins/boletins-epidemiologicos/edicoes/2021/boletim_epidemiologico_svs_12.pdf .
https://www.gov.br/saude/pt-br/centrais-... ^),(66. Maia DAB, Frias PG, Assunção RS, Vidal SA, Vanderlei LCM. Avaliação da implantação do Sistema de Informação de Agravos de Notificação em Pernambuco, 2014. Epidemiol Serv Saude. 2019;28(1):e2018187. doi: 10.5123/S1679-49742019000100002.
https://doi.org/10.5123/S1679-4974201900...

Given the relevance of measles and the effectiveness of measures to control it, studies have been carried out using data from the epidemiological surveillance system;⁵5. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Boletim epidemiológico nº 12 - Vigilância epidemiológica do sarampo no Brasil - semanas epidemiológicas 1 a 9 de 2021[Internet]. Brasília: Ministério da Saúde; 2021 [citado 2022 Maio 16]. 15 p. Disponível em: Disponível em: https://www.gov.br/saude/pt-br/centrais-de-conteudo/publicacoes/boletins/boletins-epidemiologicos/edicoes/2021/boletim_epidemiologico_svs_12.pdf .
https://www.gov.br/saude/pt-br/centrais-... ^),(77. Makarenko C, San Pedro A, Paiva NS, Santos JPC, Medronho RA, Gibson G. Ressurgimento do sarampo no Brasil: análise da epidemia de 2019 no estado de São Paulo. Rev Saude Publica. 2022;56:40. doi: 10.11606/s1518- 8787.2022056003805.
https://doi.org/10.11606/s1518- 8787.202... however, a complex national scenario, revealed cuts in public expenditure, especially in Primary Health Care, became even more so with the declaration of a public health emergency of international concern due to COVID-19.

This raised imperative issues for the surveillance system, given the concentration of efforts by central public health laboratories (Laboratórios Centrais de Saúde Pública - LACEN) to diagnose the pandemic virus. Furthermore, fake news spread by anti-vaccine groups has created further difficulties both for surveillance and for the Brazilian National Health System (Sistema Único de Saúde - SUS), making the population immunologically vulnerable⁸8. Silva GM, Sousa AAR, Almeida SMC, Sá IC, Barros FR, Sousa Filho JES, et al. Desafios da imunização contra COVID-19 na saúde pública: das fakenews à hesitação vacinal. Cien Saude Colet. 2023;28(3):739-48. doi: 10.1590/1413-81232023283.09862022.
https://doi.org/10.1590/1413-81232023283... ^),(99. Lima EJF. COVID-19 and Pediatrics: a look into the past and the future. Rev Bras Saude Mater Infant. 2022;22(4):731-4. doi: 10.1590/1806-9304202200040001.
https://doi.org/10.1590/1806-93042022000... and posing new challenges for disease prevention and control, particularly vaccine-preventable diseases.

Evaluations of the surveillance system in the period before and during the pandemic are essential to understand the implications of COVID-19 for the most diverse health problems. These evaluations can focus on system coverage,¹⁰10. Figueiroa BQ, Vanderlei LCM, Frias PG, Carvalho PI, Szwarcwald CL. Análise da cobertura do Sistema de Informações sobre Mortalidade em Olinda, Pernambuco, Brasil. Cad Saude Publica. 2013;29(3):475-84. doi: 10.1590/S0102-311X2013000300006.
https://doi.org/10.1590/S0102-311X201300... case underreporting and/or data quality and, especially, on certifying the reliability of the information made available¹¹11. Mendes MS, Oliveira ALS, Schindler HC. Evaluation of completeness, consistency and non-duplication of leprosy notification data on the Notifiable Health Conditions Information System, João Pessoa, Paraíba, Brazil: a descriptive study, 2001-2019. Epidemiol Serv Saude. 2023;32(2):e2022734. doi: 10.1590/S2237-96222023000200008.
https://doi.org/10.1590/S2237-9622202300... or even aspects of the completeness of the system.¹²12. Jacenko S, Blough S, Grant G, Tohme R, McFarland J, Hatcher C, et al. Lessons learnt from the applying the Centers for Disease Control and Prevention (CDC) evaluation framework to the measles incident management system response, USA, 2020-2021. BMJ Glob Health. 2023;8(3):e011861. doi:10.1136/bmjgh-2023-011861.
https://doi.org/10.1136/bmjgh-2023-01186... One of the most used models to evaluate the health information systems is that of the United States Centers for Disease Control and Prevention (CDC), the analysis criteria of which enable comparisons between different countries and health surveillance policies.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth...

The objective of this study was to evaluate the data quality, timeliness, and usefulness attributes of the measles epidemiological surveillance system, before and during the COVID-19 pandemic in the state of Pernambuco, Brazil.

METHODS

Design

A descriptive evaluation of the measles epidemiological surveillance system was performed, considering the selected attributes: data quality, timeliness and usefulness, according to the document entitled Updated Guidelines for Evaluating Public Health Surveillance Systems, published by the CDC.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth... The Guidelines discuss analysis of quantitative and qualitative characteristics relevant to a surveillance system, based on parameters and evaluation criteria for each attribute.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth...

Context

The evaluation in question related to the state of Pernambuco, located in Northeast Brazil, where the estimated population is 9,674,793 inhabitants, distributed over 184 municipalities (14 of them in the metropolitan region of the state capital Recife) covered by 12 Regional Health Departments (Gerências Regionais de Saúde - GERES),¹⁴14. Secretaria Estadual de Saúde (PE). Plano Estadual de Saúde 2020-2023 [Internet]. Recife: Secretaria Estadual de Saúde; 2019 [citado 2022 Jan 16]. 369 p. Disponível em: Disponível em: http://portal.saude.pe.gov.br/sites/portal.saude.pe.gov.br/files/plano_estadual_de_saude_2020_2023_0.pdf .
http://portal.saude.pe.gov.br/sites/port... which, in turn, are comprised of 2,750 active reporting health facilities. Furthermore, Pernambuco has a LACEN, the Dr. Milton Bezerra Sobral Central Public Health Laboratory, subordinated to the Pernambuco State Health Department Executive Secretariat for Health Surveillance and Primary Care. Pernambuco’s LACEN, located in the center of the capital Recife, coordinates the state’s network of public and private laboratories. It is responsible for laboratory analyses and is organized according to the importance of diseases and health conditions. Measles diagnosis is only carried out at the LACEN, which is responsible for regulating collection, packaging, conservation and transport of samples. The procedures to be adopted until the samples are received by the GERES are the responsibility of the municipalities of origin, although some closer to the capital send them directly to the LACEN. Samples from the GERES, or municipalities, are received by the LACEN every day of the week, but only during the daytime.

Participants and sample size

The study involved all measles cases resident in the state of Pernambuco, reported and recorded on the systems used. Reported cases of occurrence in the state among residents of from other Brazilian states were excluded. The data analyzed referred to two defined periods: before the COVID-19 pandemic, from March 11, 2018 to March 10, 2020; and during the pandemic, from March 11, 2020 to March 10, 2022.

Data source

As a data source, we used (i) the SINAN, the system responsible for collecting, transmitting and disseminating data for epidemiological surveillance, and (ii) the Laboratory Environment Management System of the Pernambuco Laboratory Network (Sistema Gerenciador de Ambiente Laboratorial da Rede Pernambucana de Laboratórios - GAL/RPELAB), the latter being coordinated by the LACEN. The GAL system contains laboratory information and allows integration with surveillance systems, allowing interoperability with the SINAN.¹⁵15. Paula Júnior FJ, Matta ASD, Jesus R, Guimarães RP, Souza LRO, Brant JL, et al. Sistema Gerenciador de Ambiente Laboratorial - GAL: avaliação de uma ferramenta para a vigilância sentinela de síndrome gripal, Brasil, 2011-2012. Epidemiol Serv Saude . 2017;26(2):339-48. doi: 10.5123/s1679-49742017000200011.
https://doi.org/10.5123/s1679-4974201700... ^),(1616. Ministério da Saúde (BR). Secretaria Executiva. Gerenciador de Ambiente Laboratorial (GAL) - Manual do Usuário - Versão 1.0.7 [Internet]. Brasília: Ministério da Saúde; [202?] [citado 2021 Maio 23]. 70 p. Disponível em: Disponível em: http://gal.datasus.gov.br/GAL/download/Manual_Operacao_Modulo_Usuario.pdf .
http://gal.datasus.gov.br/GAL/download/M... Data from the SINAN and GAL databases were accessed by the researchers in April 2022, at the Pernambuco State Health Department.

Definition of the attributes and variables used

The “data quality” attribute involves the completeness and validity of the data recorded on a surveillance system. Our analysis verified (i) duplicity, defined as the degree of repetition of the same reported case within the universe of records, (ii) completeness, defined as the degree of completeness of the variable analyzed, and (iii) consistency, the degree to which related variables present coherent and non-contradictory values.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth...

The “timeliness” attribute corresponds to the speed of the process between the surveillance system stages, evaluated in terms of availability of information on the health-related event, for planning and/or carrying out immediate disease prevention-control and control-intervention actions.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth... Timeliness was examined from two perspectives: timeliness of receiving the sample, which is the difference between the date of receipt of the sample and the date the case is reported, with samples received within one day being considered timely; and timeliness of release of the result, which is the difference between the date of release of the result and the date the case is reported, with results released within two days being considered timely.

The “usefulness” attribute means the ability to prevent and control measles and the implications of adverse events on public health, based on the criterion of fulfilling the objective of maintaining relevant control measures and monitoring the risk conditions of the disease, in the sense of eliminating it.¹³13. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN; Guidelines Working Group Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group [Internet]. MMWR Recomm Rep. 2001 [cited 2021 Jan 10];5(RR13):1-35. Available from: Available from: http://www.columbia.edu/itc/hs/pubhealth/p8475/readings/cdc-updated-guidelines.pdf .
http://www.columbia.edu/itc/hs/pubhealth... Selective immunization within 72 hours of contact was evaluated.

The variables considered in the study are defined below, according to attributes of the measles epidemiological surveillance system:

a) Duplicity

- patient’s name;

- date of birth;

- mother’s name; and

- SUS Card number.

b) Completeness

- health center;

- date of symptom onset;

- patient’s name;

- date of birth;

- age;

- sex;

- race/skin color;

- municipality of residence;

- date of investigation;

- suspected case vaccination coverage;

- rash onset date; and

- fever onset date.

c) Consistency

- age versus schooling;

- case reporting date versus symptom onset date;

- suspected case vaccination coverage versus date of last dose; and

- case reporting date versus result release date.

d) Timeliness

- of the receipt of the sample (sample receipt date and case reporting date); and

- of result release (result release date and case reporting date).

e) Usefulness (selective immunization performed within 72 hours).

Box 1 shows the matrix of indicators and parameters for evaluating the measles epidemiological surveillance system according to its “data quality”, “timeliness” and “usefulness” attributes.

Statistical methods

Absolute numbers and their proportions were used for each variable representing the attributes studied, in addition to the average completeness and consistency of the data.

We used the Microsoft® Office Excel 2011 pivot table for processing, data analysis and exclusion of duplicates, considering a duplicate record to be the same reported case or the same result, on the same day and for the same person. Once this checking was completed, we tabulated the aforementioned attributes.

Ethical aspects

The study project was submitted for analysis by the Instituto de Medicina Integral Prof. Fernando Figueira Ethics Committee for Research Involving Human Beings: Certificate of Submission for Ethical Appraisal (Certificado de Apresentação para Apreciação Ética - CAAE) No. 53821121000005201; Opinion No. 5.170.964, dated December 16, 2021.

RESULTS

In all, 1,548 suspected measles case were recorded in Pernambuco during the study period, 1,469 of which were before the COVID-19 pandemic and 79 during the pandemic period. Eleven (0.7%) duplicated reported cases, referring to the pre-pandemic period, and one (0.1%) duplicated reported case that occurred during the pandemic were excluded from the analysis, resulting in 1,536 records. Thus, duplicity was considered to be excellent before and during the pandemic.

The completeness of the 12 variables analyzed in the pre-pandemic period was considered to be excellent, while during the COVID-19 pandemic, 11 of the variables had excellent completeness. The “suspected case vaccination coverage” variable, related to clinical aspects, was poor, as only 41 (52.6%) suspected cases were had complete information (Table 1). As for consistency, still referring to the “data quality” attribute, of the four relationships studied, three were classified as excellent before and during the pandemic. The relationship between “suspected case vaccine coverage and date of last dose” was consistent, 578 (84.0%) consistent records were found for the pre-pandemic period and 36 (88.0%) during the pandemic, therefore being classified as regular (Table 2). Considering the cases of duplication observed and the estimated completeness and consistency averages, during the two periods studied, the measles epidemiological surveillance system was classified as being of excellent quality in terms of the data recorded.

There were 383 confirmed cases of measles (229 in the interior region of Pernambuco and 154 in the metropolitan region of Recife) before the pandemic, and three (one in the interior region and two in the metropolitan region) during the pandemic. Only 62 (16.2%) samples (42 from the metropolitan region and 20 from the interior) were considered to be timely before the pandemic, and one sample from the metropolitan region (33.0%) during the pandemic. Only five (1.3%) samples had their results released within up to two days after the cases were reported, in the pre-pandemic period, with timeliness being considered poor in both periods (Table 3).

With regard to the “usefulness” attribute of the measles epidemiological surveillance system, selective immunization was carried out in 889 (57.9%) of the cases under investigation, throughout the study period. However, only 653 (42.5%) occurred within 72 hours, this being the ideal time for controlling transmissibility; 634 (43.5%) in the pre-pandemic period and 19 (24.4%) during the COVID-19 pandemic. As such this attribute was considered to be poor before and during the pandemic (Table 4).

DISCUSSION

The evaluation of the three attributes of the measles epidemiological surveillance system - quality, timeliness and usefulness -, in both periods of the study, showed excellent data quality, with regard to duplicity, completeness in filling out variables and consistency of records; however, timeliness of receiving the samples and releasing the results proved to be poor, as did usefulness in preventing and controlling measles, since selective immunization was not carried out within the recommended time frame. These findings signaled that, from the perspective of fulfilling the system’s purpose, the control and elimination of measles in Brazil have faced concrete difficulties in achieving their objectives.

Among the limitations of the study are those inherent to the use of secondary data from the information systems accessed: underreporting, for example, produces biases, by underestimating the number of people with measles and their contacts. Furthermore, underreporting could have intensified in the context of COVID-19, due to operational losses caused by the pandemic: the complexity of analyzing the measles epidemiological surveillance system at the LACEN, associated with the prioritization of COVID-19, could have further affected the true measurement of the indicators. Another limitation of the study refers to the unavailability of studies on the quality, timeliness and usefulness of measles data, making comparison with other research difficult.

In both periods of the study, the variables presented the same final classification, despite the significant quantitative difference in suspected and confirmed cases - with the exception of the completeness of the variable regarding the filling out of information on suspected cases who were given vaccine against measles, the only variable classified as excellent in the period before the pandemic and poor during the pandemic. This was probably influenced by the negative effects of the pandemic on epidemiological surveillance and the health system.¹⁷17. Richards CL, Iademarco MF, Atkinson D, Pinner RW, Yoon P, Mac Kenzie WR, et al. Advances in public health surveillance and information dissemination at the centers for disease control and prevention. Public Health Rep. 2017;132(4):403-10. doi: 10.1177/0033354917709542.
https://doi.org/10.1177/0033354917709542... ^),(1818. Gold JAW, DeCuir J, Coyle JP, Duca LM, Adjemian J, Anderson KN, et al. COVID-19 Case Surveillance: Trends in Person-Level Case Data Completeness, United States, April 5-September 30, 2020. Public Health Rep. 2021;136(4):466-74. doi: 10.1177/00333549211006973.
https://doi.org/10.1177/0033354921100697... ⁾ Unlike the findings of our study, descriptive research carried out in João Pessoa, capital of the state of Paraíba, between 2001 and 2019, when addressing the completeness of reported cases of leprosy on the SINAN system, showed variations in filling out the variables, ranging from excellent to very poor, while consistency fluctuated from poor to excellent, thus making an adequate epidemiological analysis of the disease difficult.¹¹11. Mendes MS, Oliveira ALS, Schindler HC. Evaluation of completeness, consistency and non-duplication of leprosy notification data on the Notifiable Health Conditions Information System, João Pessoa, Paraíba, Brazil: a descriptive study, 2001-2019. Epidemiol Serv Saude. 2023;32(2):e2022734. doi: 10.1590/S2237-96222023000200008.
https://doi.org/10.1590/S2237-9622202300...

With the aim of minimizing problems arising from the low quality of SINAN data and keeping them at levels classified as excellent, analytical evaluation research into implementation of this system in Pernambuco, carried out in 2014, showed the relevance of monitoring its quality over short intervals.⁶6. Maia DAB, Frias PG, Assunção RS, Vidal SA, Vanderlei LCM. Avaliação da implantação do Sistema de Informação de Agravos de Notificação em Pernambuco, 2014. Epidemiol Serv Saude. 2019;28(1):e2018187. doi: 10.5123/S1679-49742019000100002.
https://doi.org/10.5123/S1679-4974201900... Data quality control routines, developed by Health Departments, certainly contribute to improved quality, as previously demonstrated.⁶6. Maia DAB, Frias PG, Assunção RS, Vidal SA, Vanderlei LCM. Avaliação da implantação do Sistema de Informação de Agravos de Notificação em Pernambuco, 2014. Epidemiol Serv Saude. 2019;28(1):e2018187. doi: 10.5123/S1679-49742019000100002.
https://doi.org/10.5123/S1679-4974201900... This quality control procedure, also found in research on another health condition, is possibly expressed in the results of the present study regarding duplicity.¹¹11. Mendes MS, Oliveira ALS, Schindler HC. Evaluation of completeness, consistency and non-duplication of leprosy notification data on the Notifiable Health Conditions Information System, João Pessoa, Paraíba, Brazil: a descriptive study, 2001-2019. Epidemiol Serv Saude. 2023;32(2):e2022734. doi: 10.1590/S2237-96222023000200008.
https://doi.org/10.1590/S2237-9622202300...

Ideally, epidemiological surveillance systems should support data acquisition, analysis and dissemination in a timely, flexible, measurable and scaleable manner - unlike the measles epidemiological surveillance system in Pernambuco, the timeliness of which was classified as poor. Many systems, such as the SINAN, depend on specific approaches for each health condition, inhibit efficiency and interoperability, insufficiently valuing user needs for data management, analysis, visualization and dissemination.¹1. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Coordenação-Geral de Desenvolvimento da Epidemiologia em Serviços. Guia de Vigilância em Saúde: volume único [Internet]. 3. ed. Brasília: Ministério da Saúde; 2019 [citado 2021 Jan 26]. 740 p. Disponível em: Disponível em: https://bvsms.saude.gov.br/bvs/publicacoes/guia_vigilancia_saude_3ed.pdf .
https://bvsms.saude.gov.br/bvs/publicaco... ^),(1919. Mullen L, Potter C, Gostin LO, Cicero A, Nuzzo JB. An analysis of international health regulations emergency committees and public health emergency of international concern designations. BMJ Glob Health. 2020;5(6):e002502. doi: 10.1136/ bmjgh-2020-002502.
https://doi.org/10.1136/ bmjgh-2020-0025... These problems become significantly worse during a pandemic, requiring greater adaptability for quick responses. In this situation, adequate infrastructures are required for epidemiological surveillance systems and health services, in order to strengthen them for data collection, processing and dissemination.²⁰20. Beltrami J, Wang G, Usman HR, Lin LS. Quality of HIV testing data before and after the implementation of a national data quality assessment and feedback system. J Public Health Manag Pract. 2017;23(3):269-75. doi: 10.1097/PHH.0000000000000376.
https://doi.org/10.1097/PHH.000000000000... ^),(2121. Sato APS, Boing AC, Almeida RLF, Xavier MO, Moreira RS, Martinez EZ, et al. Vacinação do sarampo no Brasil: onde estivemos e para onde vamos? Cien Saude Colet. 2023;28(2):351-62. doi: 10.1590/1413-81232023282.19172022.
https://doi.org/10.1590/1413-81232023282...

In this evaluation of the measles epidemiological surveillance system in Pernambuco, we found that a system with poor timeliness will have its usefulness impaired, in terms of responding to outbreaks in a timely and standardized manner,²²22. Rocha CAO, Santana GBA, Leal TC, Paiva JPS, Silva LF, Santos LG, et al. Impact of the COVID-19 pandemic on compulsory notification of meningitis during the first wave of the pandemic in Brazil: an ecological study using P-score. Sao Paulo Med J. 2022;140(2):305-9. doi: 10.1590/1516-3180.2021.0732.15092021.
https://doi.org/10.1590/1516-3180.2021.0... not achieving its objective of maintaining the elimination of measles through active, sensitive and appropriate surveillance.¹1. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Coordenação-Geral de Desenvolvimento da Epidemiologia em Serviços. Guia de Vigilância em Saúde: volume único [Internet]. 3. ed. Brasília: Ministério da Saúde; 2019 [citado 2021 Jan 26]. 740 p. Disponível em: Disponível em: https://bvsms.saude.gov.br/bvs/publicacoes/guia_vigilancia_saude_3ed.pdf .
https://bvsms.saude.gov.br/bvs/publicaco... ⁾ In the case studied, centralization of laboratory diagnosis of measles at the LACEN, located in the state capital, may have contributed to poor timeliness in receiving samples, considering the operational difficulties related to transport and receipt of samples, which only takes place during the day.

Improving an epidemiological surveillance system is not a simple task in countries of continental size, as was the case in the United States in 2014, when, after 25 years of outdated standards, the national notifiable diseases surveillance system brought together state governments, the CDC and epidemiologists, with the aim of modernizing it. Data in that country were made compatible and standardized; electronic messaging systems were created to transfer data in a timely manner. Two years later, only ten U.S. states (25% of the country’s population) were using the new standards.¹⁹19. Mullen L, Potter C, Gostin LO, Cicero A, Nuzzo JB. An analysis of international health regulations emergency committees and public health emergency of international concern designations. BMJ Glob Health. 2020;5(6):e002502. doi: 10.1136/ bmjgh-2020-002502.
https://doi.org/10.1136/ bmjgh-2020-0025...

The COVID-19 pandemic had repercussions on routine vaccination, with a considerable decrease in coverage of the first and second doses of the measles, mumps and rubella (MMR) vaccine, in Brazil and around the world.⁸8. Silva GM, Sousa AAR, Almeida SMC, Sá IC, Barros FR, Sousa Filho JES, et al. Desafios da imunização contra COVID-19 na saúde pública: das fakenews à hesitação vacinal. Cien Saude Colet. 2023;28(3):739-48. doi: 10.1590/1413-81232023283.09862022.
https://doi.org/10.1590/1413-81232023283... ^),(1212. Jacenko S, Blough S, Grant G, Tohme R, McFarland J, Hatcher C, et al. Lessons learnt from the applying the Centers for Disease Control and Prevention (CDC) evaluation framework to the measles incident management system response, USA, 2020-2021. BMJ Glob Health. 2023;8(3):e011861. doi:10.1136/bmjgh-2023-011861.
https://doi.org/10.1136/bmjgh-2023-01186... ^),(2323. Matos TS, Nascimento VA, Carmo RF, Fernandes TRMO, Souza CDF, Silva TFA. Impact of the COVID‐19 pandemic on the diagnosis of new leprosy cases in Northeastern Brazil, 2020. Int J Dermatol. 2021;60(8):1003-6. doi: 10.1111/ijd.15705.
https://doi.org/10.1111/ijd.15705... The negative effects of the pandemic emergency extended to the diagnosis of other diseases.¹⁷17. Richards CL, Iademarco MF, Atkinson D, Pinner RW, Yoon P, Mac Kenzie WR, et al. Advances in public health surveillance and information dissemination at the centers for disease control and prevention. Public Health Rep. 2017;132(4):403-10. doi: 10.1177/0033354917709542.
https://doi.org/10.1177/0033354917709542... ^),(1818. Gold JAW, DeCuir J, Coyle JP, Duca LM, Adjemian J, Anderson KN, et al. COVID-19 Case Surveillance: Trends in Person-Level Case Data Completeness, United States, April 5-September 30, 2020. Public Health Rep. 2021;136(4):466-74. doi: 10.1177/00333549211006973.
https://doi.org/10.1177/0033354921100697... ^),(2424. Souza CDF, Coutinho HS, Costa MM, Magalhães MAFM, Carmo RF. Impact of COVID-19 on TB diagnosis in Northeastern Brazil. Int J Tuberc Lung Dis. 2020;24(11):1220-2. doi: 10.5588/ijtld.20.0661.
https://doi.org/10.5588/ijtld.20.0661... ^)-(2626. Barbosa JPM, Lima RCD, Santos GBM, Lanna SD, Andrade MAC. Interseccionalidade e violência contra as mulheres em tempos de pandemia de covid-19: diálogos e possibilidades. Saude Soc. 2021;30(2):e200367. doi: 10.1590/S0104-12902021200367.
https://doi.org/10.1590/S0104-1290202120... In Brazil, meningitis, leprosy, tuberculosis, dengue fever and domestic violence even showed a decrease in compulsory reporting in 2020, due to the reduction in diagnoses or operational losses in surveillance programs, caused by the pandemic,¹⁷17. Richards CL, Iademarco MF, Atkinson D, Pinner RW, Yoon P, Mac Kenzie WR, et al. Advances in public health surveillance and information dissemination at the centers for disease control and prevention. Public Health Rep. 2017;132(4):403-10. doi: 10.1177/0033354917709542.
https://doi.org/10.1177/0033354917709542... ^),(1818. Gold JAW, DeCuir J, Coyle JP, Duca LM, Adjemian J, Anderson KN, et al. COVID-19 Case Surveillance: Trends in Person-Level Case Data Completeness, United States, April 5-September 30, 2020. Public Health Rep. 2021;136(4):466-74. doi: 10.1177/00333549211006973.
https://doi.org/10.1177/0033354921100697... ^),(2424. Souza CDF, Coutinho HS, Costa MM, Magalhães MAFM, Carmo RF. Impact of COVID-19 on TB diagnosis in Northeastern Brazil. Int J Tuberc Lung Dis. 2020;24(11):1220-2. doi: 10.5588/ijtld.20.0661.
https://doi.org/10.5588/ijtld.20.0661... ^)-(2626. Barbosa JPM, Lima RCD, Santos GBM, Lanna SD, Andrade MAC. Interseccionalidade e violência contra as mulheres em tempos de pandemia de covid-19: diálogos e possibilidades. Saude Soc. 2021;30(2):e200367. doi: 10.1590/S0104-12902021200367.
https://doi.org/10.1590/S0104-1290202120... ⁾ a fact which may possibly have been repeated in relation to reported suspected measles cases.

The high number of measles cases worldwide has the potential to trigger epidemics, which reaffirms the challenges of expanding vaccination coverage and enabling receptive and adequate epidemiological surveillance.⁷7. Makarenko C, San Pedro A, Paiva NS, Santos JPC, Medronho RA, Gibson G. Ressurgimento do sarampo no Brasil: análise da epidemia de 2019 no estado de São Paulo. Rev Saude Publica. 2022;56:40. doi: 10.11606/s1518- 8787.2022056003805.
https://doi.org/10.11606/s1518- 8787.202... ^),(1212. Jacenko S, Blough S, Grant G, Tohme R, McFarland J, Hatcher C, et al. Lessons learnt from the applying the Centers for Disease Control and Prevention (CDC) evaluation framework to the measles incident management system response, USA, 2020-2021. BMJ Glob Health. 2023;8(3):e011861. doi:10.1136/bmjgh-2023-011861.
https://doi.org/10.1136/bmjgh-2023-01186... ^),(2727. Faria SCRB, Moura ADA. Atuação de equipes da estratégia saúde da família frente à epidemia de sarampo em Fortaleza, Ceará, Brasil. Epidemiol Serv Saude. 2020;29(3):e2018208. doi: 10.5123/S1679-49742020000300001.
https://doi.org/10.5123/S1679-4974202000... ⁾ This reality is particularly relevant in Brazil, which had already been experiencing cases and hospitalizations due to measles associated with the massive presence of immigrants in the north of the country, associated with difficulty in accessing health services, low vaccination coverage and no vaccination card requirement, factors that have favored the spread of the disease.⁷7. Makarenko C, San Pedro A, Paiva NS, Santos JPC, Medronho RA, Gibson G. Ressurgimento do sarampo no Brasil: análise da epidemia de 2019 no estado de São Paulo. Rev Saude Publica. 2022;56:40. doi: 10.11606/s1518- 8787.2022056003805.
https://doi.org/10.11606/s1518- 8787.202... ^),(2323. Matos TS, Nascimento VA, Carmo RF, Fernandes TRMO, Souza CDF, Silva TFA. Impact of the COVID‐19 pandemic on the diagnosis of new leprosy cases in Northeastern Brazil, 2020. Int J Dermatol. 2021;60(8):1003-6. doi: 10.1111/ijd.15705.
https://doi.org/10.1111/ijd.15705...

We conclude that, despite the quality of the data analyzed being excellent, before and during the COVID-19 pandemic, the timeliness and usefulness of the surveillance system in question were poor, pointing to failure to fulfill its purpose. In view of these findings, it is recommended that discussions be held between the three governmental spheres of health service management, on structural aspects and work processes associated with the training of professionals involved, monitoring and evaluation activities, so as to be able to contribute to improving results and improving the measles epidemiological surveillance system in Pernambuco.

REFERENCES

Publication Dates

History