Early warning system using primary health care data in the post-COVID-19 pandemic era: Brazil nationwide case-study

Sistema de alerta precoce usando dados de saúde primária na era pós-pandemia de COVID-19: estudo de caso do Brasil

Sistema de alerta temprana utilizando datos de atención primaria de salud en la era pospandemia de COVID-19: estudio de caso de Brasil

Thiago Cerqueira-Silva Juliane F. Oliveira Vinicius de Araújo Oliveira Pilar Tavares Veras Florentino Alberto Sironi Gerson O. Penna Pablo Ivan Pereira Ramos Viviane S. Boaventura Manoel Barral-Netto Izabel Marcilio About the authors

Abstract:

Syndromic surveillance using primary health care (PHC) data is a valuable tool for early outbreak detection, as demonstrated by the potential to identify COVID-19 outbreaks. However, the potential of such an early warning system in the post-COVID-19 era remains largely unexplored. We analyzed PHC encounter counter of respiratory complaints registered in the database of the Brazilian Unified National Health System from October 2022 to July 2023. We applied EARS (variations C1/C2/C3) and EVI to estimate the weekly thresholds. An alarm was determined when the number of encounters exceeded the week-specific threshold. We used data on hospitalization due to respiratory disease to classify as anomalies the weeks in which the number of cases surpassed predetermined thresholds. We compared EARS and EVI efficacy in anticipating anomalies. A total of 119 anomalies were identified across 116 immediate regions during the study period. The EARS-C2 presented the highest early alarm rate, with 81/119 (68%) early alarms, and C1 the lowest, with 71 (60%) early alarms. The lowest true positivity was the EARS-C1 118/1,354 (8.7%) and the highest was EARS-C3 99/856 (11.6%). Routinely collected PHC data can be successfully used to detect respiratory disease outbreaks in Brazil. Syndromic surveillance enhances timeliness in surveillance strategies, albeit with lower specificity. A combined approach with other strategies is essential to strengthen accuracy, offering a proactive and effective public health response against future outbreaks.

Keywords:
COVID-19; Syndromic Surveillance; Respiratory Diseases

Resumo:

A vigilância sindrômica utilizando dados de atenção primária à saúde (APS) é uma ferramenta valiosa para a detecção precoce de surtos, conforme demonstrado no potencial de identificar surtos de COVID-19. No entanto, o potencial desse sistema de alerta antecipado na era pós-COVID-19 continua amplamente inexplorado. Foram analisadas as contagens de atendimentos na APS por queixas respiratórias registradas na base de dados do Sistema Único de Saúde de outubro de 2022 a julho de 2023. O EARS (variações C1/C2/C3) e o EVI foram aplicados para estimar os limiares semanais. Um alarme foi criado para quando o número de atendimentos excedesse o limite específico da semana. Dados de hospitalização por doença respiratória foram utilizados para classificar semanas em que o número de casos ultrapassou os limites predeterminados como anomalias. Comparamos a eficácia do EARS e do EVI na antecipação de anomalias. Um total de 119 anomalias foram identificadas em 116 regiões imediatas durante o período do estudo. O EARS-C2 apresentou a maior taxa de alarmes precoces, com 81 de 119 (68%) alarmes precoces, enquanto o C1 apresentou a menor, com 71 (60%) alarmes precoces. A menor taxa de verdadeiros positivos foi a EARS-C1 118/1.354 (8,7%) e a maior EARS-C3 99/856 (11,6%). Os dados de APS coletados rotineiramente podem ser usados com sucesso para detectar surtos de doenças respiratórias no Brasil. A vigilância sindrômica melhora a prontidão das estratégias de vigilância, embora com menor especificidade. Uma abordagem combinada com outras estratégias é essencial para fortalecer a precisão, oferecendo uma resposta proativa e eficaz de saúde pública contra futuros surtos.

Palavras-chave:
COVID-19; Vigilância Sindrômica; Doenças Respiratórias

Resumen:

La vigilancia sindrómica, que utiliza datos de la atención primaria de salud (APS), es una herramienta valiosa para la detección temprana de brotes, como lo demuestra el capacidad para identificar brotes de COVID-19. Sin embargo, el uso de este sistema de alerta temprana en la era posterior a la COVID-19 sigue en gran medida inexplorado. Se analizaron los conteos de atenciones en la APS por afecciones respiratorias registradas en la base de datos del Sistema Único de Salud desde octubre del 2022 hasta julio del 2023. Se aplicaron el EARS (rangos C1/C2/C3) y el EVI para estimar los umbrales semanales. Se emitió una alarma en caso de que el número de atenciones excediera el límite específico para la semana. Los datos de hospitalización por enfermedad respiratoria se utilizaron para clasificar como anómalas las semanas en las que el número de casos superó los umbrales predeterminados. Comparamos la eficacia del EARS y del EVI para anticipar anomalías. Durante el período del estudio se identificó un total de 119 anomalías en 116 regiones. El EARS-C2 presentó la tasa más alta de alarmas tempranas, con 81 de 119 (68%) alarmas tempranas, mientras que el C1 tuvo la más baja, con 71 (60%) alarmas tempranas. La tasa de positividad más baja fue la EARS-C1 118/1.354 (8,7%) y la más alta EARS-C3 99/856 (11,6%). Los datos de APS recopilados de forma rutinaria pueden utilizarse con éxito para detectar brotes de enfermedades respiratorias en Brasil. La vigilancia sindrómica aumenta la prontitud de las estrategias de vigilancia, aunque con menor especificidad. Un enfoque combinado con otras estrategias es esencial para fortalecer la precisión y proporcionar una respuesta de salud pública proactiva y eficaz contra futuros brotes.

Palabras-clave:
COVID-19; Vigilancia Sindrómica; Enfermedades Respiratorias

Introduction

The COVID-19 pandemic has underscored the importance of timely and accurate surveillance systems in detecting and responding to emerging infectious diseases 11. Morgan OW, Aguilera X, Ammon A, Amuasi J, Fall IS, Frieden T, et al. Disease surveillance for the COVID-19 era: time for bold changes. Lancet 2021; 397:2317-9.,22. Al Knawy B, Adil M, Crooks G, Rhee K, Bates D, Jokhdar H, et al. The Riyadh Declaration: the role of digital health in fighting pandemics. Lancet 2020; 396:1537-9.. Traditional surveillance methods, such as relying on laboratory-confirmed cases and hospital data, have timeliness, representativeness, and coverage limitations 33. Pilipiec P, Samsten I, Bota A. Surveillance of communicable diseases using social media: a systematic review. PLoS One 2023; 18:e0282101.,44. Ganser I, Thiébaut R, Buckeridge DL. Global variations in event-based surveillance for disease outbreak detection: time series analysis. JMIR Public Health Surveill 2022; 8:e36211.. Moreover, traditional surveillance systems do not prioritize early warning, and their usefulness for early detection of outbreaks has not been established 55. Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V; CDC Working Group. Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR Recomm Rep 2004; 53:1-11..

Syndromic surveillance systems were implemented to help provide situational awareness and inform patterns of illness distribution 66. Thomas MJ, Yoon PW, Collins JM, Davidson AJ, Mac Kenzie WR. Evaluation of syndromic surveillance systems in 6 US state and local health departments. J Public Health Manag Pract 2018; 24:235-40.,77. Colón-González FJ, Lake IR, Morbey RA, Elliot AJ, Pebody R, Smith GE. A methodological framework for the evaluation of syndromic surveillance systems: a case study of England. BMC Public Health 2018; 18:544.. Syndromic surveillance relies on a set of pre-defined diagnostic symptoms, which are available before laboratory pathogen identification, therefore adding timeliness and sensitivity to the surveillance system. In this sense, integrating primary health care (PHC) data into syndromic surveillance systems is regarded as a valuable source of information for early outbreak detection 88. Bagaria J, Jansen T, Marques DF, Hooiveld M, McMenamin J, Lusignan S, et al. Rapidly adapting primary care sentinel surveillance across seven countries in Europe for COVID-19 in the first half of 2020: strengths, challenges, and lessons learned. Euro Surveill 2022; 27:2100864.,99. Prado NMBL, Biscarde DGS, Pinto Junior EP, Santos HLPC, Mota SEC, Menezes ELC, et al. Primary care-based health surveillance actions in response to the COVID-19 pandemic: contributions to the debate. Ciênc Saúde Colet 2021; 26:2843-57..

The advancements in technology and the increasing availability of routinely collected health data highlight the importance of integrating digital health approaches to establish early warning systems for pandemic readiness and response 11. Morgan OW, Aguilera X, Ammon A, Amuasi J, Fall IS, Frieden T, et al. Disease surveillance for the COVID-19 era: time for bold changes. Lancet 2021; 397:2317-9.,22. Al Knawy B, Adil M, Crooks G, Rhee K, Bates D, Jokhdar H, et al. The Riyadh Declaration: the role of digital health in fighting pandemics. Lancet 2020; 396:1537-9.. The use of digital health in early warning enables the collection and analysis of diverse data streams. It represents a cost-effective solution by using data routinely gathered for healthcare and administrative purposes.

In the context of influenza-like illness (ILI), the importance of syndromic surveillance at the PHC level is particularly pronounced as the number of individuals with severe respiratory disease seeking emergency rooms is expected to rise a few weeks after a marked increase in mild cases seeking PHC assistance. Brazil, with its vast population and comprehensive publicly funded healthcare system 1010. Macinko J, Harris MJ, Rocha MG. Brazil's National Program for Improving Primary Care Access and Quality (PMAQ): fulfilling the potential of the world's largest payment for performance system in primary care. J Ambul Care Manage 2017; 40 Suppl 4:S4-11., provides an ideal setting to evaluate the potential of digital syndromic surveillance for anticipating ILI outbreaks. A previous study demonstrated the capabilities of using PHC data for the early detection of the COVID-19 first wave 1111. Cerqueira-Silva T, Marcilio I, de Araújo Oliveira V, Florentino PTV, Penna GO, Ramos PIP, et al. Early detection of respiratory disease outbreaks through primary healthcare data. J Glob Health 2023; 13:04124..

This study aims to evaluate the potential of digital syndromic surveillance using PHC data for respiratory diseases to establish an early warning system in the post-COVID-19 pandemic era.

Methods

Study design

We evaluated the capabilities of an early warning system based on the weekly updated national PHC database using data on hospitalizations due to respiratory diseases as a gold standard. The study period ranged from October 15, 2022 to July 29, 2023. All analyses were aggregated by the geographic immediate region according to the Brazilian Institute of Geography and Statistics (IBGE, acronym in Portuguese) 1111. Cerqueira-Silva T, Marcilio I, de Araújo Oliveira V, Florentino PTV, Penna GO, Ramos PIP, et al. Early detection of respiratory disease outbreaks through primary healthcare data. J Glob Health 2023; 13:04124..

Data source

PHC data: the Brazilian Health Information System for Primary Care (SISAB, acronym in Portuguese) contains data on all publicly funded PHC encounters in the country, coded by either the International Classification of Diseases - 10th revision (ICD-10) or the International Classification of Primary Care - 2nd edition (ICPC-2). The PHC system covers at least 75% of the population in Brazil 1212. Ministério da Saúde. e-Gestor AB. https://egestorab.saude.gov.br/paginas/acessoPublico/relatorios/relCoberturaAPSCadastro.xhtml (accessed on 29/Oct/2023).
https://egestorab.saude.gov.br/paginas/a...
. Data for PHC encounters were extracted from the SISAB database, obtained under the permission of the Brazilian Ministry of Health. We used weekly counts of every PHC encounter due to ILI from October 2022 to July 2023. We included 50 ICD-10 and ICPC-2 codes corresponding to conditions possibly related to ILI (Supplementary Material - Table S1; https://cadernos.ensp.fiocruz.br/static//arquivo/suppl-e00010024_6750.pdf).

Hospital information system: the Brazilian Hospital Information System (SIH, acronym in Portuguese) comprises information on all publicly funded hospitalizations in Brazil, coded by the ICD-10. Data were extracted from October 15, 2022 to July 29, 2023. We included 24 ICD-10 codes corresponding to respiratory conditions (Supplementary Material - Table S2; https://cadernos.ensp.fiocruz.br/static//arquivo/suppl-e00010024_6750.pdf).

Statistical methods

We compared two methods to determine the threshold for an early warning in the PHC time series: the Early Aberration Reporting System (EARS, variations C1/C2/C3) 1313. Zhu Y, Wang W, Atrubin D, Wu Y. Initial evaluation of the early aberration reporting system - Florida. MMWR Morb Mortal Wkly Rep 2005; 54 Suppl:123-30. and the Epidemic Volatility Index (EVI) 1414. Kostoulas P, Meletis E, Pateras K, Eusebi P, Kostoulas T, Furuya-Kanamori L, et al. The epidemic volatility index, a novel early warning tool for identifying new waves in an epidemic. Sci Rep 2021; 11:23775.. The stark differences observed in the PHC time series between the years pre- and post-COVID-19 resulted in a nonstable baseline; thus an early warning system in the post-COVID-19 era required anomaly detection methods suitable for working with very short time series. The EARS method was developed by the U. S. Centers for Disease Control and Prevention (CDC) to operate with short time series, requiring as little as three time points 1313. Zhu Y, Wang W, Atrubin D, Wu Y. Initial evaluation of the early aberration reporting system - Florida. MMWR Morb Mortal Wkly Rep 2005; 54 Suppl:123-30.. The EVI was developed by Kostoulas et al. 1414. Kostoulas P, Meletis E, Pateras K, Eusebi P, Kostoulas T, Furuya-Kanamori L, et al. The epidemic volatility index, a novel early warning tool for identifying new waves in an epidemic. Sci Rep 2021; 11:23775. based on calculating the rolling standard deviation for a time series of confirmed COVID-19 cases and can also be employed with a short time series.

We used an 8-week baseline for EARS and EVI, with a 0.05 threshold alpha for the EARS and a 0.1 threshold c for the EVI. The baseline of an 8-week period is calculated differently for the C1 and C2/C3 variations. In the case of C1, the baseline uses data from the weeks -1 to -8, while C2/C3 uses data from weeks -3 to -10 1515. Hutwagner L, Thompson W, Seeman GM, Treadwell T. The bioterrorism preparedness and response Early Aberration Reporting System (EARS). J Urban Health 2003; 80(2 Suppl 1):i89-i96.. In this scenario, we only start to determine thresholds for all methods in January 2023 (the 11th week after October 15, 2022).

Additionally, we conducted two sensitivity analyses: (1) changing the threshold alpha of 0.01 for EARS and c 0.2 for EVI to test the effect in specificity; and (2) using a 4-week baseline to test the effect in timeliness. An alarm in the PHC-based early warning system is established when the current number of encounters surpasses the week-specific threshold.

We defined an anomaly in the SIH time series by comparing the number of hospitalizations in the current week with the median number of hospitalizations per week in the study period. The thresholds for each immediate region were defined considering the median number of hospitalizations (Supplementary Material - Box S1; https://cadernos.ensp.fiocruz.br/static//arquivo/suppl-e00010024_6750.pdf). Anomalies separated by one week alone were merged into one single event. Anomalies lasting for only one week were discarded, this criterion was applied to distinguish genuine events from random variation.

We evaluated the PHC-based early warning performance using three metrics derived from Nekorchuk et al. 1616. Nekorchuk DM, Gebrehiwot T, Lake M, Awoke W, Mihretie A, Wimberly MC. Comparing malaria early detection methods in a declining transmission setting in northwestern Ethiopia. BMC Public Health 2021; 21:788.: (1) percent of events recorded, defined as the percent of anomalies in the SIH time series recorded by the PHC-based early warning; (2) percent of alarms associated with an anomaly (true positives): an alarm and anomaly were considered associated if the alarm was triggered any week during or up to three weeks prior to the anomaly; (3) percent of timely alarms: defined as an alarm up to three weeks prior to the first week of an anomaly. We conducted the analysis stratified by population size of the immediate region, categorized as small, medium, or large, as defined by the first and third quartiles. The weighted PHC coverage of each immediate region was calculated as the mean coverage of the municipalities comprising that region divided by the municipality population.

The statistical analysis was conducted using R software, version 4.3.1 (http://www.r-project.org), and the packages surveillance and EVI.

Ethics aspects

The study is based on secondary, aggregated, non-identified data, and was approved by the Research Ethics Committee of Oswaldo Cruz Foundation - Brasília Regional Office (CAAE: 61444122.0.0000.0040).

Results

Brazil has 510 immediate regions with populations ranging from 30,000 to 20 million inhabitants. The median population per region is 185,349 (interquartile range - IQR: 117,752; 324,635) (Figure 1). The weighted PHC coverage per immediate region ranged from 27% to 100%, with a median of 91% (IQR: 80; 97) (Figure 1).

Figure 1
Brazil’s immediate regions. From January to July, 2023.

The total number of PHC encounters steadily increased during the study period, peaking close to 10,000,000 encounters per week in June of 2023. The number of ILI-related encounters and hospitalizations due to respiratory causes also peaked around June 2023 (Figure 2).

Figure 2
Encounters in the primary health care (PHC) and hospitalizations due to acute respiratory causes (4-week moving average). Brazil, October 2022 to July 2023.

We identified 119 anomalies across 116 immediate regions in the SIH time series from January to July 2023, lasting from 2 to 11 weeks (Figures 1 and 3). The EARS-C2 presented the highest early alarm rate in the PHC time series, with 81/119 (68%) early alarms, and C1 presented the lowest, with 71 (60%) early alarms (Figure 4; Table 1); 52 (44%) anomalies were early detected across all three variations of EARS and EVI, and 15 anomalies (13%) were not detected in any method (Table 2). Most missed anomalies in all methods lasted only two weeks (Table 3). The true positivity was similar for all methods, ranging from 9% (EARS-C1) to 12% (EARS-C3) (Table 4).

Figure 3
Extent of anomalies stratified by population size.

Figure 4
Performance of the methods, considering the time (in weeks) of the first alarm in the primary health care (PHC) series in relation to the first week with an anomaly in the Brazilian Hospital Information System (SIH) series, overall and stratified by population size.

Table 1
Performance of the methods, considering the time (in weeks) of the first alarm in the primary health care (PHC) series in relation to the first week with an anomaly in the Brazilian Hospital Information System (SIH) series, overall and stratified by population size.

Table 2
Number of anomalies that multiple methods detected early or missed.

Table 3
Extent of missed anomalies by method.
Table 4
True positive rates per method.

In the stratified analysis by population size, immediate regions with small populations had the lowest early alarms rate, ranging from 48% to 64%, while regions with large populations had the highest rate, with values ranging 65%-76% (Figure 4). The true positivity rates were low across all strata, slightly better in large population regions, with values from 14 to 18% (Table 4).

The sensitivity analysis using the 0.01 threshold alpha for the EARS method and c 0.2 for EVI did not increase the true positive rate. However, the early detection rate decreased for all methods, ranging from 36% (C1) to 56% (C2) (Tables 5 and 6). The analysis using 4-week baseline improved the early detection rate for EARS (C2 and C3) and EVI, increasing from 68 to 72% (C2), 63 to 72% (C3), and 61 to 71% (EVI), and improved caught rate in the same methods. The true positive rate decreased by 1 or 2% in all methods (Tables 5 and 6).

Table 5
Performance of the methods in the two sensitivity analyses.
Table 6
True positive rates per method of the two sensitivity analyses.

Discussion

This study outcomes provide valuable insights into the longitudinal patterns of encounters due to respiratory causes in the PHC and the use of PHC data to develop an early warning system for respiratory disease outbreaks. We employed two methods for the early warning: EARS and EVI. Both methods showed capacity for early detection of respiratory disease outbreaks, with overall detection rate ranging 60%-68%. However, population size impacted the true positivity and early detection rate, with small population regions presenting the lowest number of true positives and early alarms.

The EARS and EVI methods offer flexibility for use in situations with limited historical data by relying on recent information for threshold setting. However, they exhibit a notable drawback: a decreased ability to accommodate seasonality, resulting in alarms often triggered during seasonal peaks. Methods able to adjust for seasonality, such as the improved Farrington method, tend to perform better in the true positive metric 1717. Bédubourg G, Le Strat Y. Evaluation and comparison of statistical methods for early temporal detection of outbreaks: a simulation-based study. PLoS One 2017; 12:e0181227.. The sustained high fluctuations of PHC encounters due to COVID-19 cases from 2020 to 2022, with misleading low numbers during lockdown periods, hinder the use of methods that require longer historical data as a baseline 1818. Bigoni A, Malik AM, Tasca R, Carrera MB, Schiesari LM, Gambardella DD, et al. Brazil's health system functionality amidst of the COVID-19 pandemic: an analysis of resilience. Lancet Reg Health Am 2022; 10:100222.,1919. World Health Organization. Second round of the national pulse survey on continuity of essential health services during the COVID-19 pandemic: January-March 2021. Interim report, 22 April 2021. https://iris.who.int/handle/10665/340937 (accessed on 24/Nov/2023).
https://iris.who.int/handle/10665/340937...
. Bédubourg & Le Strat 1717. Bédubourg G, Le Strat Y. Evaluation and comparison of statistical methods for early temporal detection of outbreaks: a simulation-based study. PLoS One 2017; 12:e0181227. compared 21 early warning methods using simulated datasets and found that the probability of detection of an outbreak ranged from 43.3% to 84.4%, and the false positive rate ranged from 0.7% to 59.9%. The EARS variations showed a probability of detection ranging from 54.2% to 68% and a false positive rate of 6.9% to 8.5%. Similar to our findings, the C2 EARS variation presented the best performance metrics. The authors concluded that no single method presented outbreak detection performances sufficient enough to provide reliable monitoring for a large surveillance system 1717. Bédubourg G, Le Strat Y. Evaluation and comparison of statistical methods for early temporal detection of outbreaks: a simulation-based study. PLoS One 2017; 12:e0181227.. Using real surveillance data, Nekorchuk et al. 1616. Nekorchuk DM, Gebrehiwot T, Lake M, Awoke W, Mihretie A, Wimberly MC. Comparing malaria early detection methods in a declining transmission setting in northwestern Ethiopia. BMC Public Health 2021; 21:788. compared three early warning methods for detecting malaria outbreaks. They found that the improved Farrington method showed the most effective results, as it could achieve the best trade-off on maximizing both sensitivity (> 70%) and specificity (> 70%). Similar to our study, when analyzing the three EARS variations, they found a high percentage of events caught (80% to 100%), with a moderate early detection rate (43% to 87%) and a low true positive rate (25% to 40%) 1616. Nekorchuk DM, Gebrehiwot T, Lake M, Awoke W, Mihretie A, Wimberly MC. Comparing malaria early detection methods in a declining transmission setting in northwestern Ethiopia. BMC Public Health 2021; 21:788..

In the context of an article on early warning systems, it is important to highlight the distinct advantages of integrating PHC data with conventional surveillance systems 88. Bagaria J, Jansen T, Marques DF, Hooiveld M, McMenamin J, Lusignan S, et al. Rapidly adapting primary care sentinel surveillance across seven countries in Europe for COVID-19 in the first half of 2020: strengths, challenges, and lessons learned. Euro Surveill 2022; 27:2100864.,99. Prado NMBL, Biscarde DGS, Pinto Junior EP, Santos HLPC, Mota SEC, Menezes ELC, et al. Primary care-based health surveillance actions in response to the COVID-19 pandemic: contributions to the debate. Ciênc Saúde Colet 2021; 26:2843-57.. This is particularly relevant in Brazil, where the granularity of PHC is exceptionally valuable. PHC extends its reach even to regions that lack more advanced healthcare facilities, reaching underserved rural and remote regions 1010. Macinko J, Harris MJ, Rocha MG. Brazil's National Program for Improving Primary Care Access and Quality (PMAQ): fulfilling the potential of the world's largest payment for performance system in primary care. J Ambul Care Manage 2017; 40 Suppl 4:S4-11.. The granularity of PHC plays a pivotal role in offering a timely window for detecting alarms by syndromic surveillance. It enables the early recognition of emerging health threats, even in areas with limited access to higher complexity healthcare infrastructure. This, in turn, allows for more rapid responses and proactive public health measures, ultimately enhancing the resilience of the healthcare system and safeguarding the well-being of vulnerable populations 2020. Macinko J, Harris MJ. Brazil's Family Health Strategy - delivering community-based primary care in a universal health system. N Engl J Med 2015; 372:2177-181..

The performance metrics shown here should be interpreted within the context of syndromic surveillance early alarms. It is generally accepted that syndromic surveillance provides high sensitivity but low specificity 66. Thomas MJ, Yoon PW, Collins JM, Davidson AJ, Mac Kenzie WR. Evaluation of syndromic surveillance systems in 6 US state and local health departments. J Public Health Manag Pract 2018; 24:235-40., and that the usefulness of early warning systems resides in indicating that an aberrant situation is occurring and should be investigated by health authorities 2121. Fricker Jr. RD, Hegler BL, Dunfee DA. Comparing syndromic surveillance detection methods: EARS' versus a CUSUM-based methodology. Stat Med 2008; 27:3407-29.. Different parameterizations of detection methods will yield different performances, and, in general, a trade-off between the power of detection, false positive rates, and early detection should be considered when choosing a particular method 1616. Nekorchuk DM, Gebrehiwot T, Lake M, Awoke W, Mihretie A, Wimberly MC. Comparing malaria early detection methods in a declining transmission setting in northwestern Ethiopia. BMC Public Health 2021; 21:788.,2222. Craig AT, Leong RNF, Donoghoe MW, Muscatello D, Mojica VJC, Octavo CJM. Comparison of statistical methods for the early detection of disease outbreaks in small population settings. IJID Reg 2023; 8:157-63.,2323. Enki DG, Garthwaite PH, Farrington CP, Noufaily A, Andrews NJ, Charlett A. Comparison of statistical algorithms for the detection of infectious disease outbreaks in large multiple surveillance systems. PLoS One 2016; 11:e0160759.. The choice of which method to use depends on the data availability and which detection characteristics are most important in a given situation 2424. Noufaily A, Morbey RA, Colón-González FJ, Elliot AJ, Smith GE, Lake IR, et al. Comparison of statistical algorithms for daily syndromic surveillance aberration detection. Bioinformatics 2019; 35:3110-8..

This study is part of the Alert-Early System for Outbreaks with Pandemic Potential (ÆSOP) 2525. Ramos PIP, Marcilio I, Bento AI, Penna GO, de Oliveira JF, Khouri R, et al. Combining digital and molecular approaches using health and alternate data sources in a next-generation surveillance system for anticipating outbreaks of pandemic potential. JMIR Public Health Surveill 2024; 10:e47673.. This system is intended to supplement traditional surveillance methods used by the Brazilian Ministry of Health, which are based on mandatory notification of suspected cases. Furthermore, our system relies on the use of existing information systems in order to achieve cost-effectiveness and avoid adding to the already overburdened health care system 2525. Ramos PIP, Marcilio I, Bento AI, Penna GO, de Oliveira JF, Khouri R, et al. Combining digital and molecular approaches using health and alternate data sources in a next-generation surveillance system for anticipating outbreaks of pandemic potential. JMIR Public Health Surveill 2024; 10:e47673.. In Brazil (2023), 89% of public healthcare institutions use electronic health record systems, with 61% using the Brazilian Ministry of Health system (Prontuário Eletrônico do Cidadão) 2626. Ministério da Saúde. Painéis de indicadores da APS. https://sisaps.saude.gov.br/painelsaps/situacao-prontuario (accessed on 04/Jun/2024).
https://sisaps.saude.gov.br/painelsaps/s...
. This scenario enables the quick transfer of data over a unified system. Given that the infrastructure for data collection and storage is already in place as part of the health-care routine, implementing the PHC-based warning system would be substantially less expensive than building new data-capture infrastructure. On the other hand, we anticipate that investing in training health surveillance personnel is critical for increasing capacity. Continuous education is required to maintain a qualified team capable of interpreting information from various sources and planning activities to validate warning signals at different administrative levels. A recent systematic review on the effectiveness of early warning systems indicated that syndromic surveillance is more proactive to detect outbreaks. However, it presented mixed results in terms of the accuracy of the outbreak detection 2727. Meckawy R, Stuckler D, Mehta A, Al-Ahdal T, Doebbeling BN. Effectiveness of early warning systems in the detection of infectious diseases outbreaks: a systematic review. BMC Public Health 2022; 22:2216..

Our study presents potential limitations. First, we relied on an algorithmic approach using reported hospitalizations due to acute respiratory causes to as a gold standard for defining outbreaks. Thus, respiratory diseases that do not progress to severe disease would not be considered an outbreak in this study, and the signal detected in the PHC data would be considered a false positive. Second, we could not link individual PHC encounters and SIH data, preventing us from estimating the percentage of individuals who first sought PHC before developing severe symptoms. Third, the PHC data encompass only encounters in the public health sector. This is a potential bias in settings with a higher percentage of usage of the private health sector. For instance, outbreak detection could be less timely if an outbreak started among the wealthier stratum of the population. Furthermore, we did not have access to laboratory data, which would have provided specificity to the early warning, favoring reaction and mitigation actions.

In conclusion, this study highlights the value of leveraging digital syndromic surveillance for the early detection of outbreaks. It offers valuable insights into using routinely collected PHC data for respiratory disease outbreak detection in Brazil. Working in this endeavor is crucial for enhancing surveillance accuracy and mitigating future outbreaks. This study contributes to the growing body of knowledge essential for addressing the complex challenges posed by infectious diseases, thus promoting a more proactive and effective public health response.

Acknowledgments

This study is part of the Alert-Early System of Outbreaks with Pandemic Potential (ÆSOP) program funded by Oswaldo Cruz Foundation (FIOCRUZ) and the Rockefeller Foundation (2023 PPI 007). Additional support was provided by the Bahia State Research Foundation (FAPESB; grant n. PNX0008/2014). M. Barral-Netto and V. S. Boaventura are research fellows from the Brazilian National Research Council (CNPq).

References

  • 1
    Morgan OW, Aguilera X, Ammon A, Amuasi J, Fall IS, Frieden T, et al. Disease surveillance for the COVID-19 era: time for bold changes. Lancet 2021; 397:2317-9.
  • 2
    Al Knawy B, Adil M, Crooks G, Rhee K, Bates D, Jokhdar H, et al. The Riyadh Declaration: the role of digital health in fighting pandemics. Lancet 2020; 396:1537-9.
  • 3
    Pilipiec P, Samsten I, Bota A. Surveillance of communicable diseases using social media: a systematic review. PLoS One 2023; 18:e0282101.
  • 4
    Ganser I, Thiébaut R, Buckeridge DL. Global variations in event-based surveillance for disease outbreak detection: time series analysis. JMIR Public Health Surveill 2022; 8:e36211.
  • 5
    Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V; CDC Working Group. Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR Recomm Rep 2004; 53:1-11.
  • 6
    Thomas MJ, Yoon PW, Collins JM, Davidson AJ, Mac Kenzie WR. Evaluation of syndromic surveillance systems in 6 US state and local health departments. J Public Health Manag Pract 2018; 24:235-40.
  • 7
    Colón-González FJ, Lake IR, Morbey RA, Elliot AJ, Pebody R, Smith GE. A methodological framework for the evaluation of syndromic surveillance systems: a case study of England. BMC Public Health 2018; 18:544.
  • 8
    Bagaria J, Jansen T, Marques DF, Hooiveld M, McMenamin J, Lusignan S, et al. Rapidly adapting primary care sentinel surveillance across seven countries in Europe for COVID-19 in the first half of 2020: strengths, challenges, and lessons learned. Euro Surveill 2022; 27:2100864.
  • 9
    Prado NMBL, Biscarde DGS, Pinto Junior EP, Santos HLPC, Mota SEC, Menezes ELC, et al. Primary care-based health surveillance actions in response to the COVID-19 pandemic: contributions to the debate. Ciênc Saúde Colet 2021; 26:2843-57.
  • 10
    Macinko J, Harris MJ, Rocha MG. Brazil's National Program for Improving Primary Care Access and Quality (PMAQ): fulfilling the potential of the world's largest payment for performance system in primary care. J Ambul Care Manage 2017; 40 Suppl 4:S4-11.
  • 11
    Cerqueira-Silva T, Marcilio I, de Araújo Oliveira V, Florentino PTV, Penna GO, Ramos PIP, et al. Early detection of respiratory disease outbreaks through primary healthcare data. J Glob Health 2023; 13:04124.
  • 12
    Ministério da Saúde. e-Gestor AB. https://egestorab.saude.gov.br/paginas/acessoPublico/relatorios/relCoberturaAPSCadastro.xhtml (accessed on 29/Oct/2023).
    » https://egestorab.saude.gov.br/paginas/acessoPublico/relatorios/relCoberturaAPSCadastro.xhtml
  • 13
    Zhu Y, Wang W, Atrubin D, Wu Y. Initial evaluation of the early aberration reporting system - Florida. MMWR Morb Mortal Wkly Rep 2005; 54 Suppl:123-30.
  • 14
    Kostoulas P, Meletis E, Pateras K, Eusebi P, Kostoulas T, Furuya-Kanamori L, et al. The epidemic volatility index, a novel early warning tool for identifying new waves in an epidemic. Sci Rep 2021; 11:23775.
  • 15
    Hutwagner L, Thompson W, Seeman GM, Treadwell T. The bioterrorism preparedness and response Early Aberration Reporting System (EARS). J Urban Health 2003; 80(2 Suppl 1):i89-i96.
  • 16
    Nekorchuk DM, Gebrehiwot T, Lake M, Awoke W, Mihretie A, Wimberly MC. Comparing malaria early detection methods in a declining transmission setting in northwestern Ethiopia. BMC Public Health 2021; 21:788.
  • 17
    Bédubourg G, Le Strat Y. Evaluation and comparison of statistical methods for early temporal detection of outbreaks: a simulation-based study. PLoS One 2017; 12:e0181227.
  • 18
    Bigoni A, Malik AM, Tasca R, Carrera MB, Schiesari LM, Gambardella DD, et al. Brazil's health system functionality amidst of the COVID-19 pandemic: an analysis of resilience. Lancet Reg Health Am 2022; 10:100222.
  • 19
    World Health Organization. Second round of the national pulse survey on continuity of essential health services during the COVID-19 pandemic: January-March 2021. Interim report, 22 April 2021. https://iris.who.int/handle/10665/340937 (accessed on 24/Nov/2023).
    » https://iris.who.int/handle/10665/340937
  • 20
    Macinko J, Harris MJ. Brazil's Family Health Strategy - delivering community-based primary care in a universal health system. N Engl J Med 2015; 372:2177-181.
  • 21
    Fricker Jr. RD, Hegler BL, Dunfee DA. Comparing syndromic surveillance detection methods: EARS' versus a CUSUM-based methodology. Stat Med 2008; 27:3407-29.
  • 22
    Craig AT, Leong RNF, Donoghoe MW, Muscatello D, Mojica VJC, Octavo CJM. Comparison of statistical methods for the early detection of disease outbreaks in small population settings. IJID Reg 2023; 8:157-63.
  • 23
    Enki DG, Garthwaite PH, Farrington CP, Noufaily A, Andrews NJ, Charlett A. Comparison of statistical algorithms for the detection of infectious disease outbreaks in large multiple surveillance systems. PLoS One 2016; 11:e0160759.
  • 24
    Noufaily A, Morbey RA, Colón-González FJ, Elliot AJ, Smith GE, Lake IR, et al. Comparison of statistical algorithms for daily syndromic surveillance aberration detection. Bioinformatics 2019; 35:3110-8.
  • 25
    Ramos PIP, Marcilio I, Bento AI, Penna GO, de Oliveira JF, Khouri R, et al. Combining digital and molecular approaches using health and alternate data sources in a next-generation surveillance system for anticipating outbreaks of pandemic potential. JMIR Public Health Surveill 2024; 10:e47673.
  • 26
    Ministério da Saúde. Painéis de indicadores da APS. https://sisaps.saude.gov.br/painelsaps/situacao-prontuario (accessed on 04/Jun/2024).
    » https://sisaps.saude.gov.br/painelsaps/situacao-prontuario
  • 27
    Meckawy R, Stuckler D, Mehta A, Al-Ahdal T, Doebbeling BN. Effectiveness of early warning systems in the detection of infectious diseases outbreaks: a systematic review. BMC Public Health 2022; 22:2216.

Publication Dates

  • Publication in this collection
    20 Dec 2024
  • Date of issue
    2024

History

  • Received
    19 Jan 2024
  • Reviewed
    10 June 2024
  • Accepted
    09 July 2024
Escola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz Rio de Janeiro - RJ - Brazil
E-mail: cadernos@ensp.fiocruz.br