Abstract:
This study addresses the State’s capacity to combat the COVID-19 pandemic and contributes to the literature on crisis management in health care. We analyzed whether the capacity level impacted the State response to COVID-19 in Brazilian healthcare regions in 2020 using a set of statistical analysis techniques and public health impact analysis, including propensity score matching (PSM). Results revealed that a low COVID-19 mortality was associated with participation in municipal health consortia, schooling level of municipal health managers and the resources allocated by the Brazilian National Program for Improvement of Access and Quality of Basic Care (PMAQ). Conversely, the number of intensive care units (ICU) and life-sustaining equipment available were associated with higher mortality, as locations with a larger population concentrated operational capacity to treat the most severe cases. In conclusion, the different levels of State capacity in health regions led to different outcomes in combating the pandemic. This reinforces the importance of discussing State capacity and crisis management, since the COVID-19 confrontation in Brazil related to the level of existing resources concerning health system capacity, bureaucratic capacity and participation in consortia for sharing inputs and ensuring the provision of health services to the population.
Keywords:
COVID-19; Public Administration; Public Policy
Resumo:
Este estudo aborda a capacidade do Estado em lidar com a pandemia da COVID-19, bem como contribuir com a literatura sobre gestão de crises no setor da saúde. Analisamos se o nível de capacidade do Estado teve impacto na resposta à COVID-19 nas regiões de saúde brasileiras em 2020. O estudo utiliza um conjunto de técnicas de análise estatística e análise de impacto na saúde pública, incluindo o método de pareamento por escore de propensão (PSM). Os achados revelaram que o menor número de óbitos por COVID-19 esteve associado à participação em consórcios intermunicipais de saúde, ao nível de escolaridade dos gestores municipais de saúde e aos recursos repassados por meio do Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica (PMAQ). Por outro lado, o número de unidades de terapia intensiva (UTI) e de equipamentos para manutenção da vida associou-se a um maior número de óbitos, uma vez que locais populacionais maiores concentraram capacidade operacional para atender os casos mais graves. Conclui-se, portanto, que os diferentes níveis de capacitação implementados pelo Estado nas regiões de saúde brasileiras levaram a resultados distintos no enfrentamento da pandemia. Isso reforça a importância da discussão sobre a capacitação implementada pelo Estado e a gestão de crises, destacando que o resultado do enfrentamento da COVID-19 no Brasil esteve relacionado ao nível de recursos existentes, principalmente em termos de capacidade do sistema de saúde, capacidade burocrática e associação em consórcios para compartilhar insumos e garantir a prestação de serviços de saúde à população.
Palavras-chave:
COVID-19; Administração Pública; Política Pública
Resumen:
Este estudio aborda la capacidad del Estado para hacer frente a la pandemia del COVID-19 y busca contribuir a la literatura sobre gestión de crisis en el sector salud. Se analizó si el nivel de capacidad del Estado tuvo un impacto en la respuesta al COVID-19 en las regiones sanitarias brasileñas en 2020. Este estudio utilizó un conjunto de técnicas de análisis estadísticos y análisis de impacto en la salud pública, incluido el método de pareamiento por puntaje de propensión (PSM). Los hallazgos muestran que el menor número de muertes por el COVID-19 se asoció con la participación en consorcios intermunicipales de salud, el nivel de educación de los gestores municipales de salud y los recursos transferidos por el Programa Nacional de Mejoría y Acceso de la Calidad de la Atención Básica (PMAQ). Por otro lado, la cantidad de unidades de cuidados intensivos (UCI) y de equipos de soporte vital estuvo asociada a un mayor número de muertes, ya que los lugares con mayor población concentraron la capacidad operativa para tratar los casos más graves. Se concluye que los diferentes niveles de capacitación implementados por el Estado en las regiones sanitarias brasileñas llevaron a diferentes resultados para hacer frente a la pandemia. Esto refuerza la importancia de la discusión sobre la capacitación implementada por el Estado y la gestión de crisis, destacando que la respuesta al COVID-19 en Brasil estuvo relacionada con el nivel de recursos existentes, especialmente con relación a la capacidad del sistema de salud, la capacidad burocrática y la asociación en consorcios para compartir insumos y garantizar la prestación de servicios sanitarios a la población.
Palabras-clave:
COVID-19; Administración Pública; Política Pública
Introduction
Crisis management in health care is an important interdisciplinary field of knowledge, especially given the increased risk of pandemics due to the expansion of global flows. Despite lack of consensus in the literature on health system strengthening requirements 11. Gilson L, Marchal B, Ayepong I, Barasa E, Dossou JP, George A, et al. What role can health policy and systems research play in supporting responses to COVID-19 that strengthen socially just health systems? Health Policy Plan 2020; 35:1231-6.,22. Haldane V, Morgan GT. From resilient to transilient health systems: the deep transformation of health systems in response to the COVID-19 pandemic. Health Policy Plan 2021; 36:134-5., many others remain concealed such as State capacity aspects.
Studies on State capacities gained prominence on the 1970s, and have recently been applied to analyze public policy implementation in democratic and globalized environments 33. Cingolani L. The state of State capacity: a review of concepts, evidence and measures. http://mgsog.merit.unu.edu (accessed on 21/Sep/2020).
http://mgsog.merit.unu.edu... ,44. Gomide AA, Pereira AK, Machado R. O conceito de capacidade estatal e a pesquisa científica. Sociedade e Cultura 2017; 20:3-12.. State capacity has been broadly defined as the entire set of resources and abilities a State can employ to achieve its social objectives 55. Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43.. Empirically, these capacities can be grouped in varying ways. Pires & Gomide 55. Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43. classify State capacities into technical-administrative - referring to human, technological, and financial resources, as well as instruments for coordinating and evaluating policies - and political-relational - linked to the articulations between bureaucrats, State agents and non-State actors.
Overall, literature on the topic converges in three directions: organizing theoretical and methodological debates; testing the concept; and discussing the advantages, disadvantages, fragility, and strength of its measurement methods 66. Souza C, Fontanelli F. Capacidade estatal e burocrática: sobre conceitos, dimensões e medidas. In: Mello J, Ribeiro VMR, Lotta G, Bonamino A, Carvalho CP, editors. Implementação de políticas e atuação de gestores públicos. Brasília: Instituto de Pesquisa Econômica Aplicada; 2020. p. 43-67.. In this article, we focus on the second dimension: testing its different components. To do so, we take the dimensions proposed by Pires & Gomide 55. Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43. as a priori without, however, considering them as fixed. Thus, we will disaggregate the concept into new categories according to data associations.
The COVID-19 pandemic motivated some studies into investigating the importance of State capacities in combating the new disease, whether in terms of reducing cases and deaths or minimizing social harm to citizens. In this perspective, the State capacity to implement public policies would help explain the different actions adopted by government officials and, consequently, the diverse results 77. Ito NC, Pongeluppe LS. The COVID-19 outbreak and the municipal administration responses: resource munificence, social vulnerability, and the effectiveness of public actions. Rev Adm Pública 2020; 54:782-838.,88. Pereira AK, Oliveira MS, Sampaio TS. Asymmetries of state government social distancing policies in the face of COVID-19: political and technical-administrative aspects. Rev Adm Pública 2020; 54:678-96..
But State capacity may not be evenly distributed across territories, resulting in governments having different sets of resources and skills to combat the pandemic thus compromising the results of actions 77. Ito NC, Pongeluppe LS. The COVID-19 outbreak and the municipal administration responses: resource munificence, social vulnerability, and the effectiveness of public actions. Rev Adm Pública 2020; 54:782-838.,99. Sanabria-Pulido P. COVID-19: una prueba ácida a la capacidad de Estados, gobiernos y sociedades. Recomendaciones de gestión y políticas públicas para una respuesta integral y coordinada. Bogotá: Escuela de Gobierno Alberto Lleras Camargo; 2020. (Apuntes de Gestión y Políticas Públicas, 1).. Factors that influence the State’s ability to face crises originate from before the pandemic 1010. Lima LD, Pereira AMM, Machado CV. Crisis, conditioning factors, and challenges in the coordination of Brazil's federative State in the context of COVID-19. Cad Saúde Pública 2020; 36:e00185220.. Moreover, State capacities are directly affected by inequalities in tax collection, economic dynamism, population size and bureaucratic profile, among other aspects that affect service provision 1111. Santana MO, Gomes SC. Capacidades estatais no federalismo brasileiro: um perfil da evolução do funcionalismo público municipal no Rio Grande do Norte no período recente. In: Anais do Encontro Nacional de Ensino e Pesquisa do Campo de Públicas. Brasília: Associação Nacional de Ensino, Pesquisa e Extensão do Campo de Públicas; 2017. p. 1241-64..
In Brazil, whose territory is large and heterogeneous, municipalities are primarily responsible for managing public services in a federative context of significant inequalities between subnational entities, especially in terms of financial resources and infrastructure 1212. Arretche M. Financiamento federal e gestão local de políticas sociais: o difícil equilíbrio entre regulação, responsabilidade e autonomia. Ciênc Saúde Colet 2003; 8:331-45.,1313. Santos AMSP. Descentralização, desenvolvimento local e autonomia financeira dos municípios. Quivera 2008; 10:47-64.. To minimize existing disparities, health regionalization was implemented in Brazil starting in 2011 to promote State capacities through cooperation between subnational entities to expand population access to services 1414. Viana ALd'A, Iozzi FL. Confronting health inequalities: impasses and dilemmas in the regionalization process in Brazil. Cad Saúde Pública 2019; 35 Suppl 2:e00022519.,1515. Brasil. Decreto nº 7.508, de 28 de junho de 2011. Regulamenta a Lei nº 8.080, de 19 de setembro de 1990, para dispor sobre a organização do Sistema Único de Saúde - SUS, o planejamento da saúde, a assistência à saúde e a articulação interfederativa, e dá outras providências. Diário Oficial da União 2011; 29 jun.. These health regions would enable the integrated planning of care networks, combining different supply capacities and diversity of resources 1616. Lima LD, Viana ALdA, Machado CV, Albuquerque MV, Oliveira RG, Iozzi FL, et al. Regionalização e acesso à saúde nos estados brasileiros: condicionantes históricos e político-institucionais. Ciênc Saúde Colet 2012; 17:2881-92..
Crisis situations can increase asymmetries in resource concentration, worsening health inequities. Hence, resilient health systems and governments capable of learning from crises require preparation for such events 22. Haldane V, Morgan GT. From resilient to transilient health systems: the deep transformation of health systems in response to the COVID-19 pandemic. Health Policy Plan 2021; 36:134-5.,1717. Duong DB, King AJ, Grépin KA, Hsu LY, Lim JF, Phillips C, et al. Strengthening national capacities for pandemic preparedness: a cross-country analysis of COVID-19 cases and deaths. Health Policy Plan 2021; 37:55-64.. In the case of COVID-19, a research agenda that subsidizes decision-making for current and future crises based on responses from health system worldwide is necessary 11. Gilson L, Marchal B, Ayepong I, Barasa E, Dossou JP, George A, et al. What role can health policy and systems research play in supporting responses to COVID-19 that strengthen socially just health systems? Health Policy Plan 2020; 35:1231-6..
Seeking to contribute to this discussion, this article analyzes how the level of local State capacity impacted COVID-19 mortality in Brazilian health regions by considering new State capacity dimensions besides health system infrastructure, such as managers’ bureaucratic capacity, participation in intermunicipal consortia and quality of the primary health services.
Incorporating more State capacity dimensions enables the construction of bases for resilient health systems, recognizing that these are not only formed by infrastructure, but also by leadership and behavior aspects of the actors involved 1818. Barasa EW, Cloete K, Gilson L. From bouncing back, to nurturing emergence: reframing the concept of resilience in health systems strengthening. Health Policy Plan 2017; 32:iii91-4.. In the next section we will present the data and econometric strategies used for analysis. We then move on to the results and discussions and, finally, we bring the final considerations.
Material and methods
Data collection
We used the 450 Brazilian health regions, covering the country’s 5,570 municipalities, as units of analysis. Health region is categorized as a continuous geographic space formed by neighboring cities that share socioeconomic and cultural characteristics, as well as communication and transport networks, defined by the States in conjunction with the municipalities 1515. Brasil. Decreto nº 7.508, de 28 de junho de 2011. Regulamenta a Lei nº 8.080, de 19 de setembro de 1990, para dispor sobre a organização do Sistema Único de Saúde - SUS, o planejamento da saúde, a assistência à saúde e a articulação interfederativa, e dá outras providências. Diário Oficial da União 2011; 29 jun.. As for the number of COVID-19 deaths, data were collected from the repository Monitoring the Number of COVID-19 Cases and Deaths in Brazil at Municipal and Federative Level1919. Cota W. Monitoring the number of COVID-19 cases and deaths in Brazil at municipal and federative units level. SciELO Preprints 2020; 5 jul. https://preprints.scielo.org/index.php/scielo/preprint/view/362., which aggregates official data provided by the Brazilian Ministry of Health and State Health Departments also informing the confirmation date. We considered as a cut-off point the number of deaths (from confirmed cases) by health region up to the 29th week in 2020.
The time frame proposed was calculated individually for each health region, starting immediately from the confirmation of the first COVID-19 cases. Importantly, the 29th week of the pandemic fell in October 2020 for 72% of the Brazilian health regions, followed by the months of November (102 regions), December (18 regions), and September (6 regions). Regarding contamination, by the end of the 29th week, more than 5 million cases and approximately 154,000 deaths had already been reported.
This cut-off was informed by the peculiar virus transmission, which initially affected peripheral areas of capitals and metropolitan regions before spreading to municipalities in the countryside 2020. Freitas CM, Barcellos C, Villela DAM, Portela MC, Reis LC, Guimarães RM, et al. Observatório Covid-19 Fiocruz - uma análise da evolução da pandemia de fevereiro de 2020 a abril de 2022. Ciênc Saúde Colet 2023; 28:2845-55.. Consequently, the peaks of contamination waves were not coincident across the Brazilian territory 2121. Moura EC, Cortez-Escalante J, Cavalcante FV, Barreto ICHC, Sanchez MN, Santos LMP. COVID-19: temporal evolution and immunization in the three epidemiological waves, Brazil, 2020-2022. Rev Saúde Pública 2022; 56:105.. Moreover, the cut-off point sought to avoid influence by the start of vaccination, with debates beginning late 2020.
To represent the capacity of health regions in facing the pandemic we include variables from the technical-administrative and political-relational aspects proposed by Pires & Gomide 55. Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43., encompassing different dimensions according to the literature. In the technical-administrative dimension, we considered the degree of primary health care resolution - measured by the Brazilian National Program for Improvement of Access and Quality of Basic Care (PMAQ, acronym in Portuguese) values transferred -, number of intensive care units (ICU) beds, the average schooling level of health managers, number of nurses from the Family Health Strategy, vital support equipment available, as well as financial resources transferred by the Federal Government to municipalities for direct application in combating the pandemic. PMAQ is an important public policy to ensure the quality of primary health services provided, conditioning financial resources to the performance of municipal teams in the assessments conducted.
These variables were chosen due to the theoretical and empirical debate on government performance in implementing public policies, highlighting the relevance of human and material resources 88. Pereira AK, Oliveira MS, Sampaio TS. Asymmetries of state government social distancing policies in the face of COVID-19: political and technical-administrative aspects. Rev Adm Pública 2020; 54:678-96.,2222. Pearson CM, Mitroff II. From crisis prone to crisis prepared: a framework for crisis management. The Executive 1993; 7:48-59., quality of bureaucracy 2323. Marenco A. Burocracias profissionais ampliam capacidade estatal para implementar políticas? Governos, burocratas e legislação em municípios brasileiros. Dados Rev Ciênc Sociais 2017; 60:1025-58. and availability of financial resources 2424. Martins DG. The state of the art of institutional capacity: a scoping review of the literature in Portuguese. Cadernos EBAPE.BR 2021; 19:165-89.. In the political-relational dimension, we considered the percentage of municipal participation in health consortia, regarded as important mechanisms of intermunicipal cooperation since the 1990s 2525. Nascimento ABFM, Fernandes ASA, Sano H, Grin EJ, Silvestre HC. Cooperação intermunicipal baseada no Institutional Collective Action: os efeitos dos consórcios públicos de saúde no Brasil. Rev Adm Pública 2021; 55:1369-91.. These consortia are crucial for sharing health inputs and services, and unlike with regions a municipality can participate in more than one consortium simultaneously.
Considering the heterogeneity of the Brazilian territory, we included control variables to enabled grouping health regions with similar characteristics, namely population size, the density of inhabitants per square kilometer, the amounts spent on the Brazilian Income Transfer Program (representing local social vulnerability), the amount of Emergency Aid received from the Federal Government, fiscal effort, the Firjan Municipal Development Index (IFDM, acronym in Portuguese), Firjan Fiscal Management Index (IFGF, acronym in Portuguese), percentage of population with access to water supply, percentage of population aged 60 or over, gross domestic product per capita, and geographic location of the health region. General IFDM and IFGF were included because they represent good aggregate indicators of human development and public management quality, covering several variables not included in this study.
We collected a cross-section with the most current data available in open databases from official Brazilian sources such as Brazilian Health Informatics Department (DATASUS, acronym in Portuguese), Brazilian Institute of Geography and Statistics (IBGE, acronym in Portuguese), Brazilian Ministry of Citizenship, Transparency Portal, Firjan Institute, Institute for Applied Economic Research (IPEA, acronym in Portuguese), and National Sanitation Information System (SNIS, acronym in Portuguese). Box 1 details the variables included.
Variables referring to equipment, human resources, and financial resources (ICUs, equipment, nurses and financial transfers) were collected only up to the 29th week of the pandemic, thus avoiding the inclusion of resources made available after the cut-off. For the Emergency Aid amounts, given the nature of the payment model, we considered the amount made available to all health regions until October 2020, which represented the 29th week for most municipalities (72%).
Statistical analysis
ANOVA tests were performed after descriptive statistics analysis to find associations between the data and the health region’s population size. We submitted the variables to an exploratory factor analysis (EFA) to explore existing factors (i.e., latent constructs or dimensions) in the data. We used principal component analysis (PCA) for factor extraction and varimax criteria for rotation. Adequacy of the EFA to the data was verified by Kaiser-Meyer-Olkin (KMO) statistics and Bartlett’s sphericity test 2626. Hair Jr. JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6th Ed. Porto Alegre: Bookman; 2009..
EFA allowed to explore new factors, thus justifying not limiting the nomenclatures used to those fully explored in public policies. Data characteristics also underline this choice, since EFA will aggregate them according to their respective correlation, which may not correspond to the dimensions explored in state capacity theory.
Factors related to state capacity and local characteristics were identified, the latter being important for matching the health regions, and we separated the treated and untreated groups before applying the propensity score matching (PSM) technique. This allowed us to analyze how the levels of State capacities impacted COVID-19 mortality.
As State capacities may exist to a greater or lesser degree in each locality, it would be impossible to identify treated and untreated groups by the simple existence (or not) of such capacities. We thus used the median as a separation factor between treated and untreated groups, allowing for a balanced number of observations in each group. We attributed a value of 1 (treated group) to values equal to or greater than the median, representing regions that previously invested in their State capacity, and 0 to the others (untreated group). Differences between group averages was verified using t-tests (parametric data) and the Mann-Whitney’s test (nonparametric data) 2727. Gertler PJ, Martínez S, Premand P, Rawlings LB, Vermeersch CMJ. Avaliação de impacto na prática. 2nd Ed. Washington DC: Banco Mundial; 2018..
With the groups defined, we imputed the local characteristics in the PSM to match treated and untreated groups. PSM calculated the probability of receiving treatment, interpreted as a higher level of State capacity. Matching was performed considering health regions of treated and untreated groups that presented similar probabilities according to predefined criteria 2828. Haupt MR, Weiss SM, Chiu M, Cuomo R, Chein JM, Mackey T. Psychological and situational profiles of social distance compliance during COVID-19. J Commun Healthc 2022; 15:44-53..
According to Rosenbaum & Rubin 2929. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70:41-55. and Becker & Ichino 3030. Becker SO, Ichino A. Estimation of average treatment effects based on propensity scores. Stata J 2002; 2:358-77., the probability or propensity score is the conditional probability of receiving treatment based on a set of predetermined observable variables. Since the treated and untreated groups share the same observable characteristics 3131. Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. Pesquisas estatísticas e indicadores educacionais. https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores (accessed on 20/Jun/2021).
https://www.gov.br/inep/pt-br/areas-de-a... , the average difference in COVID-19 mortality gives us the estimated impact of State capacities. This analysis points out the contributing factors to reduce the number of COVID-19 deaths.
Results
Table 1 details the average, standard deviation, maximum and minimum values of the descriptive statistics analysis.
The five factors identified by EFA and their corresponding variables are shown in Table 2. Together, these five factors had an explained percentage of variance of 73.58%, higher than the 60% recommended by the literature 2626. Hair Jr. JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6th Ed. Porto Alegre: Bookman; 2009., showing a good explanatory power with this number of constructs. KMO statistics presented a value of 0.876, indicating a good adequacy of the data to the method, also corroborated by Bartlett’s sphericity test, which showed a sufficient degree of correlations at 1% significance.
As EFA grouped variables related to the health region’s characteristics (management quality, social vulnerability, socioeconomic status, human development, location) in the first factor, we labeled it as the local context. This factor also encompassed risk behaviors related to economic inequality and, consequently, the ability to maintain stricter standards of compliance with social distancing 2828. Haupt MR, Weiss SM, Chiu M, Cuomo R, Chein JM, Mackey T. Psychological and situational profiles of social distance compliance during COVID-19. J Commun Healthc 2022; 15:44-53.. The literature highlights the local context as an element that conditions government results in confronting the pandemic, covering aspects such as average schooling level, location, socioeconomic condition, average population age, among others 3232. Araújo JM, Ferreira MAM. A saúde em tempos de crise: lições a partir da COVID-19. Revista Katálysis 2023; 26:65-76..
Disparity in these indices hinders combating health crises as local characteristics also influence the quality and quantity of resources available. Structural, this disparity impacts the federal coordination capacity to implement policies 3333. Censon D, Barcelos M. O papel do estado na gestão da crise ocasionada pela COVID-19: visões distintas sobre federalismo e as relações entre União e municípios. Revista Brasileira de Gestão e Desenvolvimento Regional 2020; 16:49-63..
The second factor consisted of the health system’s general characteristics, involving the quantity of human resources, the political capacity to form consortia and the quality of primary health care. Health manager’s schooling level, population size and demographic density were grouped into the third factor, labeled territorial bureaucratic capacity. This correlation may be explained by the concentration of higher education institutions in larger and denser locations 3131. Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. Pesquisas estatísticas e indicadores educacionais. https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores (accessed on 20/Jun/2021).
https://www.gov.br/inep/pt-br/areas-de-a... , which justifies the existence of managers with a higher level of education.
Financial resources allocated to municipalities by the Federal Government for combating the pandemic makes up the financial capacity factor, representing the mobilization of short-term resources to fight the pandemic. Finally, the fourth factor encompasses the ICU beds for COVID-19 patients and the number of life support equipment representing the operational capacity, an element of paramount importance to ensure timely care for the most severe cases.
After determining the State capacity factors, we performed the PSM to separate between treated and untreated groups. We attribute 1 to values greater than or equal to the median of each variable to form the treated group, and 0 to the others, forming the untreated group. Using the median as a separation factor allowed for a similar number of health regions in each group (Table 3). Table 3 shows the discrepancies between group averages, whose differences are statistically significant by the t-tests (parametric variables) or Mann-Whitney (nonparametric variables). We therefore confirmed that the averages in state capacities of the treated groups are superior to those of the untreated groups.
After confirming the average differences, we applied the PSM to analyze the impact of State capacities on the number of registered COVID-19 deaths. We used the local context variables (factor 1) to calculate the probability of receiving treatment, matching between elements of the treated and untreated groups using the nearest neighbor criterion (i.e., similarity of probability). As shown in Table 4, the average difference in mortality between similar elements in these groups determines the impact (average treatment effect).
From Table 4, we highlight the negative impact observed regarding mortality in relation to participation in health consortia, bureaucratic capacity, represented by health manager’s schooling, and PMAQ resources. These observations are important for defining coping strategies for health crises such as COVID-19. We will discuss these results in more detail below.
Discussion
Core data characteristics (Box 1) and their great heterogeneity, revealed by the high standard deviation values observed, show a scenario of marked social and economic inequalities between health regions especially in the number of ICU beds, an essential resource for treating the most severe COVID-19 cases.
In the period analyzed, the average number of ICU-COVID beds was 0.88 per 10,000 inhabitants, below the minimum of one bed recommended by the World Health Organization 88. Pereira AK, Oliveira MS, Sampaio TS. Asymmetries of state government social distancing policies in the face of COVID-19: political and technical-administrative aspects. Rev Adm Pública 2020; 54:678-96.. Such a situation becomes more serious when considering that 49 health regions lacked any specific ICU bed for COVID-19 patients, demonstrating a fragility of the health infrastructure before the pandemic. When considering the total number of beds, 72% of the health regions provided a lower number than recommended even for routine use, as observed by Rache et al. 3434. Rache B, Rocha R, Nunes L, Spinola P, Malik AM, Massuda A. Necessidades de infraestrutura do SUS em preparo ao COVID19: leitos de UTI, respiradores e ocupação hospitalar. São Paulo: Instituto para Estudo em Políticas de Saúde; 2020. (Nota Técnica, 3).. These findings confirm that health systems are often unprepared to respond quickly to population demands in a pandemic context 11. Gilson L, Marchal B, Ayepong I, Barasa E, Dossou JP, George A, et al. What role can health policy and systems research play in supporting responses to COVID-19 that strengthen socially just health systems? Health Policy Plan 2020; 35:1231-6..
ANOVA testing provided an important picture of the human resources distribution and infrastructure of the Brazilian health system. Health regions serving a higher population size concentrated a greater number of ICU-COVID beds, more life maintenance equipment, as well as health managers with a higher schooling level. Conversely, regions with fewer inhabitants despite having lower infrastructure, presented a greater number of nurses, greater participation in health consortia and more PMAQ transfers, indicating better quality of primary care services.
Hence, despite a 10-year implementation of the health regions, these lack a standardization of the resources available thus revealing the fragility of regional health planning. These findings are worrisome given the importance of health regions as bases for planning care networks and privileged spaces for articulating health actions 1616. Lima LD, Viana ALdA, Machado CV, Albuquerque MV, Oliveira RG, Iozzi FL, et al. Regionalização e acesso à saúde nos estados brasileiros: condicionantes históricos e político-institucionais. Ciênc Saúde Colet 2012; 17:2881-92..
As health regions are centers for health planning, the primary and secondary care systems should act together to reduce patient referral to intensive care 3535. Moreira RS. COVID-19: unidades de terapia intensiva, ventiladores mecânicos e perfis latentes de mortalidade associados à letalidade no Brasil. Cad Saúde Pública 2020; 36:e00080020.. However, larger health regions concentrated the intensive care infrastructure for the most severe COVID-19 cases, while the smaller regions showed greater investment in primary health care.
At the municipal level, Cardoso et al. 3636. Cardoso RL, Azevedo RR, Pigatto JAM, Fajardo BAG, Cunha ASM. Lessons from Brazil's unsuccessful fiscal decentralization policy to fight COVID-19. Public Adm Dev 2022; (Online ahead of print). found that the income transfer policy of the Brazilian Federal Government disregarded local vulnerability, level of contamination and municipal income level. Consequently, many municipalities had to reduce their own health expenditures, as places with greater health resources received more financial transfers. New investments are therefore being made disregarding the level of preexisting resources, leading to greater planning of public policies to support governments in health crises.
Regarding impact, PSM analysis showed that operational capacity, which was concentrated in large healthcare regions, was associated with an increase in COVID-19 deaths. This may be because larger and more developed locations concentrate more people whose displacements result in greater risks of exposure. Moreover, larger locations have more opportunities to enhance State capacities to treat patients 3737. Araújo JM, Ferreira MAM. Análise das capacidades estatais no enfrentamento da pandemia da COVID-19 no Brasil. REAd - Revista Eletrônica de Administração 2023; 29:337-63..
An increase in COVID-19 cases, even with a greater number of beds, could render the health infrastructure insufficient and lead to an increase in the number of deaths. Initially, the levels of death and contamination were directly related to population size, but following the collapse of the health system local medical-hospital structure began to directly influence the fatality rate 88. Pereira AK, Oliveira MS, Sampaio TS. Asymmetries of state government social distancing policies in the face of COVID-19: political and technical-administrative aspects. Rev Adm Pública 2020; 54:678-96..
Although our results highlight the importance of primary health care as a tool to halt the pandemic, the literature emphasizes other contributing aspects 3838. Pereira AMM, Machado CV, Veny MB, Juan AMY, Recio SN. Governance and State capacities against COVID-19 in Germany and Spain: national responses and health systems from a comparative perspective. Ciênc Saúde Colet 2021; 26:4425-37.. In fact, the increased health system capacity’s effectiveness would depend on minimum conditions such as teams of qualified professionals, political will and financing 3939. Andrade CLT, Lima SML, Pereira CCA, Martins M, Soares FRG, Portela MC. Evolução da disponibilidade dos leitos de terapia intensiva na rede hospitalar do Brasil para o enfrentamento da emergência sanitária. In: Portela MC, Reis LGC, Lima SML, editors. COVID-19: desafios para a organização e repercussões nos sistemas e serviços de saúde. Rio de Janeiro: Observatório Covid-19 Fiocruz/Editora Fiocruz; 2022. p. 131-44..
PSM analysis revealed that a greater transfer of PMAQ resources is associated with a reduction in the number of COVID-19 deaths. Importantly, the PMAQ resources allocated are directly linked to the evaluation of each primary care team and Expanded Family Health and Primary Care Center (NASF-AB, acronym in Portuguese). Thus, these transfers related to the quality and resolvability of the primary care services provided. In fact, this variable had the highest coefficient in the PSM results, that is, it would have the greatest impact on reducing the number of deaths and combating the pandemic.
Primary care’s role in combating COVID-19 is founded on the need to monitor and screen infected and suspected patients, helping to control the pandemic and ensure that seriously ill patients have timely access to the healthcare system. Recent studies by Medina et al. 4040. Medina MG, Giovanella L, Bousquat A, Mendonça MHM, Aquino R; Comitê Gestor da Rede de Pesquisa em Atenção Primária à Saúde da Abrasco. Atenção primária à saúde em tempos de COVID-19: o que fazer? Cad Saúde Pública 2020; 36:e00149720. and Barbosa et al. 4141. Barbosa IR, Galvão MHR, Souza TA, Gomes SM, Medeiros AA, Lima KC. Incidence of and mortality from COVID-19 in the older Brazilian population and its relationship with contextual indicators: an ecological study. Rev Bras Geriatr Gerontol 2020; 23:200171. corroborate this result, demonstrating the importance of primary care to minimize health inequities, reduce infection levels, and mitigate the social and economic effects of the pandemic.
Despite the difficulty in facing crises of countries with decentralized government models, Erkoreka & Hernando‐Pérez 4242. Erkoreka M, Hernando-Pérez J. Decentralization: a handicap in fighting the COVID-19 pandemic? The response of the regional governments in Spain. Public Adm Dev 2022; (Online ahead of print). state that this does not pose a disadvantage. When analyzing sub-central governments in Spain, the authors found that action coordination and health system robustness, represented by financial investments, human resources, and equipment, enabled a better performance in facing the COVID-19 pandemic.
Kim & Jeong 4343. Kim Y, Jeong YA. The role of local governments in South Korea's COVID-19 response. Public Adm Dev 2022; (Online ahead of print). stress that despite the importance of central governments, local actions played a crucial role in combating the pandemic. This is because in addition to national coordinated actions, local assessment allows health systems to meet population needs. Effective containment of the pandemic is related to government effectiveness 4444. Serikbayeva B, Abdulla K, Oskenbayev Y. State capacity in responding to COVID-19. International Journal of Public Administration 2021; 44:920-30., whose resources must be mobilized through political processes, determining how state capacity can and will be used 4545. Kavanagh MM, Singh R. Democracy, capacity, and coercion in pandemic response: COVID-19 in comparative political perspective. J Health Polit Policy Law 2020; 45:997-1012.. In this relational perspective, the (de)activation of State capabilities materializes, among other aspects, in the institutional arrangements formed and the interactions between different actors 55. Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43..
Besides primary care, we also observed a reduction in the number of deaths by greater participation in health consortia. This result corroborates Ferreira et al. 4646. Ferreira MAM, Emmendoerfer M, Silvestre HMC, Correia AM. Capacidade estatal e redes de cooperação pública na saúde no controle da pandemia COVID-19. Sistemas & Gestão 2022; 17:314-26., who found that municipal association via consortia was one of the most effective measures to control the pandemic.
These consortia enable health care networks to be more collaborative, allowing for the expansion of service access 4747. Julião KS, Olivieri C. Cooperação intergovernamental na política de saúde: a experiência dos consórcios públicos verticais no Ceará, Brasil. Cad Saúde Pública 2020; 36:e00037519. and consequently the reduction of inequities in the health regions studied. The importance of municipal consortia was also discussed by Santos 4848. Santos RJM. Consórcios públicos de saúde em tempos de pandemia da COVID-19. In: Santos AO, Lopes LT, editors. Planejamento e gestão. Brasília: Conselho Nacional de Secretários de Saúde; 2021. p. 244-54., who assessed their prominent role in fighting the pandemic through the provision of services, joint acquisition of inputs, personal protective and ICU equipments, promotion of educational activities, among others.
Our results also highlighted another aspect little investigated when discussing coping with COVID-19 in Brazil: the negative association between bureaucratic capacity and the number of deaths. This reinforces that the coordination of pandemic-fighting efforts based on bureaucratic capacities is an important aspect of health crisis management 4949. Schmidt F, Mello J, Cavalcante P. Estratégias de coordenação governamental na crise da COVID-19. Brasília: Instituto de Pesquisa Econômica Aplicada; 2020. (Nota Técnica, 32).. Focusing on education 5050. Lui L, Segatto CI, Albert CE, Santos RM. Capacidades estatais e políticas municipais de educação durante a pandemia de COVID-19. Cadernos Gestão Pública e Cidadania 2023; 28:e86049., they identified that the manager’s schooling was important for implementing successful policies in the pandemic context, highlighting the relevance of a competent and professionalized municipal bureaucracy.
Bureaucratic capacity is widely discussed in the literature on State capacities as it relates to technical competences, that is, to the development of a competent technical team to achieve good public policy results in the most diverse areas 5151. Grin EJ. O verso e o reverso da cooperação federativa e da difusão vertical de políticas para promover capacidade estatal nos municípios brasileiros. Administração Pública e Gestão Social 2021; 13(2). https://periodicos.ufv.br/apgs/article/view/9686.
https://periodicos.ufv.br/apgs/article/v... . Thus, our results corroborate the importance of the human factor for managing crisis situations, highlighting that managers’ characteristics can influence the probability of success of the implemented actions 5252. Panos E, Dafni P, Kostas G, Zacharoula M. Crisis management in the health sector: qualities and characteristics of health crisis managers. Int J Caring Sci 2009; 2:105-7..
Conclusion
Our results showed that the levels of State capacity influenced COVID-19 mortality in Brazil, highlighting knowledge already acquired regarding the pandemic and reinforcing new findings. Among them, the quality of primary care emerges as a helping factor to reduce contamination levels and consequently deaths. Moreover, the results emphasized the importance of consortia as a mechanism to increase health resources for coping with crisis situations.
Association between schooling level of health managers and reduced number of COVID-19 deaths indicate the importance of bureaucratic capacity, reinforcing theoretical discussions on how bureaucratic capacity influences public policy outcomes even during health crisis.
Thus, COVID-19 mortality could be minimized by a preventive, comprehensive, and integrated approach via the articulation of actions between different entities, investment in health management training and assurance of quality health services in basic care. Finally, our results encourage debate on State capacity and their relevance and demonstrate that an effective fight against the pandemic goes beyond health system infrastructure since other capacity dimensions are equally important. As for study limitations, we emphasize that the existence of State capacity in health regions does not ensure its operation, requiring further studies to understand whether this process occurred and how it took place during the COVID-19 pandemic.
Acknowledgments
This work received financial support from the Brazilian Coordination for the Improvement of Higher Education Personnel (CAPES; financing code 001). The authors also thank Minas Gerais State Research Foundation (FAPEMIG) and Brazilian National Research Council (CNPq) for their support.
References
- 1Gilson L, Marchal B, Ayepong I, Barasa E, Dossou JP, George A, et al. What role can health policy and systems research play in supporting responses to COVID-19 that strengthen socially just health systems? Health Policy Plan 2020; 35:1231-6.
- 2Haldane V, Morgan GT. From resilient to transilient health systems: the deep transformation of health systems in response to the COVID-19 pandemic. Health Policy Plan 2021; 36:134-5.
- 3Cingolani L. The state of State capacity: a review of concepts, evidence and measures. http://mgsog.merit.unu.edu (accessed on 21/Sep/2020).
» http://mgsog.merit.unu.edu - 4Gomide AA, Pereira AK, Machado R. O conceito de capacidade estatal e a pesquisa científica. Sociedade e Cultura 2017; 20:3-12.
- 5Pires RRC, Gomide AA. Governança e capacidades estatais: uma análise comparativa de programas federais. Revista de Sociologia e Política 2016; 24:121-43.
- 6Souza C, Fontanelli F. Capacidade estatal e burocrática: sobre conceitos, dimensões e medidas. In: Mello J, Ribeiro VMR, Lotta G, Bonamino A, Carvalho CP, editors. Implementação de políticas e atuação de gestores públicos. Brasília: Instituto de Pesquisa Econômica Aplicada; 2020. p. 43-67.
- 7Ito NC, Pongeluppe LS. The COVID-19 outbreak and the municipal administration responses: resource munificence, social vulnerability, and the effectiveness of public actions. Rev Adm Pública 2020; 54:782-838.
- 8Pereira AK, Oliveira MS, Sampaio TS. Asymmetries of state government social distancing policies in the face of COVID-19: political and technical-administrative aspects. Rev Adm Pública 2020; 54:678-96.
- 9Sanabria-Pulido P. COVID-19: una prueba ácida a la capacidad de Estados, gobiernos y sociedades. Recomendaciones de gestión y políticas públicas para una respuesta integral y coordinada. Bogotá: Escuela de Gobierno Alberto Lleras Camargo; 2020. (Apuntes de Gestión y Políticas Públicas, 1).
- 10Lima LD, Pereira AMM, Machado CV. Crisis, conditioning factors, and challenges in the coordination of Brazil's federative State in the context of COVID-19. Cad Saúde Pública 2020; 36:e00185220.
- 11Santana MO, Gomes SC. Capacidades estatais no federalismo brasileiro: um perfil da evolução do funcionalismo público municipal no Rio Grande do Norte no período recente. In: Anais do Encontro Nacional de Ensino e Pesquisa do Campo de Públicas. Brasília: Associação Nacional de Ensino, Pesquisa e Extensão do Campo de Públicas; 2017. p. 1241-64.
- 12Arretche M. Financiamento federal e gestão local de políticas sociais: o difícil equilíbrio entre regulação, responsabilidade e autonomia. Ciênc Saúde Colet 2003; 8:331-45.
- 13Santos AMSP. Descentralização, desenvolvimento local e autonomia financeira dos municípios. Quivera 2008; 10:47-64.
- 14Viana ALd'A, Iozzi FL. Confronting health inequalities: impasses and dilemmas in the regionalization process in Brazil. Cad Saúde Pública 2019; 35 Suppl 2:e00022519.
- 15Brasil. Decreto nº 7.508, de 28 de junho de 2011. Regulamenta a Lei nº 8.080, de 19 de setembro de 1990, para dispor sobre a organização do Sistema Único de Saúde - SUS, o planejamento da saúde, a assistência à saúde e a articulação interfederativa, e dá outras providências. Diário Oficial da União 2011; 29 jun.
- 16Lima LD, Viana ALdA, Machado CV, Albuquerque MV, Oliveira RG, Iozzi FL, et al. Regionalização e acesso à saúde nos estados brasileiros: condicionantes históricos e político-institucionais. Ciênc Saúde Colet 2012; 17:2881-92.
- 17Duong DB, King AJ, Grépin KA, Hsu LY, Lim JF, Phillips C, et al. Strengthening national capacities for pandemic preparedness: a cross-country analysis of COVID-19 cases and deaths. Health Policy Plan 2021; 37:55-64.
- 18Barasa EW, Cloete K, Gilson L. From bouncing back, to nurturing emergence: reframing the concept of resilience in health systems strengthening. Health Policy Plan 2017; 32:iii91-4.
- 19Cota W. Monitoring the number of COVID-19 cases and deaths in Brazil at municipal and federative units level. SciELO Preprints 2020; 5 jul. https://preprints.scielo.org/index.php/scielo/preprint/view/362.
- 20Freitas CM, Barcellos C, Villela DAM, Portela MC, Reis LC, Guimarães RM, et al. Observatório Covid-19 Fiocruz - uma análise da evolução da pandemia de fevereiro de 2020 a abril de 2022. Ciênc Saúde Colet 2023; 28:2845-55.
- 21Moura EC, Cortez-Escalante J, Cavalcante FV, Barreto ICHC, Sanchez MN, Santos LMP. COVID-19: temporal evolution and immunization in the three epidemiological waves, Brazil, 2020-2022. Rev Saúde Pública 2022; 56:105.
- 22Pearson CM, Mitroff II. From crisis prone to crisis prepared: a framework for crisis management. The Executive 1993; 7:48-59.
- 23Marenco A. Burocracias profissionais ampliam capacidade estatal para implementar políticas? Governos, burocratas e legislação em municípios brasileiros. Dados Rev Ciênc Sociais 2017; 60:1025-58.
- 24Martins DG. The state of the art of institutional capacity: a scoping review of the literature in Portuguese. Cadernos EBAPE.BR 2021; 19:165-89.
- 25Nascimento ABFM, Fernandes ASA, Sano H, Grin EJ, Silvestre HC. Cooperação intermunicipal baseada no Institutional Collective Action: os efeitos dos consórcios públicos de saúde no Brasil. Rev Adm Pública 2021; 55:1369-91.
- 26Hair Jr. JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6th Ed. Porto Alegre: Bookman; 2009.
- 27Gertler PJ, Martínez S, Premand P, Rawlings LB, Vermeersch CMJ. Avaliação de impacto na prática. 2nd Ed. Washington DC: Banco Mundial; 2018.
- 28Haupt MR, Weiss SM, Chiu M, Cuomo R, Chein JM, Mackey T. Psychological and situational profiles of social distance compliance during COVID-19. J Commun Healthc 2022; 15:44-53.
- 29Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70:41-55.
- 30Becker SO, Ichino A. Estimation of average treatment effects based on propensity scores. Stata J 2002; 2:358-77.
- 31Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. Pesquisas estatísticas e indicadores educacionais. https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores (accessed on 20/Jun/2021).
» https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores - 32Araújo JM, Ferreira MAM. A saúde em tempos de crise: lições a partir da COVID-19. Revista Katálysis 2023; 26:65-76.
- 33Censon D, Barcelos M. O papel do estado na gestão da crise ocasionada pela COVID-19: visões distintas sobre federalismo e as relações entre União e municípios. Revista Brasileira de Gestão e Desenvolvimento Regional 2020; 16:49-63.
- 34Rache B, Rocha R, Nunes L, Spinola P, Malik AM, Massuda A. Necessidades de infraestrutura do SUS em preparo ao COVID19: leitos de UTI, respiradores e ocupação hospitalar. São Paulo: Instituto para Estudo em Políticas de Saúde; 2020. (Nota Técnica, 3).
- 35Moreira RS. COVID-19: unidades de terapia intensiva, ventiladores mecânicos e perfis latentes de mortalidade associados à letalidade no Brasil. Cad Saúde Pública 2020; 36:e00080020.
- 36Cardoso RL, Azevedo RR, Pigatto JAM, Fajardo BAG, Cunha ASM. Lessons from Brazil's unsuccessful fiscal decentralization policy to fight COVID-19. Public Adm Dev 2022; (Online ahead of print).
- 37Araújo JM, Ferreira MAM. Análise das capacidades estatais no enfrentamento da pandemia da COVID-19 no Brasil. REAd - Revista Eletrônica de Administração 2023; 29:337-63.
- 38Pereira AMM, Machado CV, Veny MB, Juan AMY, Recio SN. Governance and State capacities against COVID-19 in Germany and Spain: national responses and health systems from a comparative perspective. Ciênc Saúde Colet 2021; 26:4425-37.
- 39Andrade CLT, Lima SML, Pereira CCA, Martins M, Soares FRG, Portela MC. Evolução da disponibilidade dos leitos de terapia intensiva na rede hospitalar do Brasil para o enfrentamento da emergência sanitária. In: Portela MC, Reis LGC, Lima SML, editors. COVID-19: desafios para a organização e repercussões nos sistemas e serviços de saúde. Rio de Janeiro: Observatório Covid-19 Fiocruz/Editora Fiocruz; 2022. p. 131-44.
- 40Medina MG, Giovanella L, Bousquat A, Mendonça MHM, Aquino R; Comitê Gestor da Rede de Pesquisa em Atenção Primária à Saúde da Abrasco. Atenção primária à saúde em tempos de COVID-19: o que fazer? Cad Saúde Pública 2020; 36:e00149720.
- 41Barbosa IR, Galvão MHR, Souza TA, Gomes SM, Medeiros AA, Lima KC. Incidence of and mortality from COVID-19 in the older Brazilian population and its relationship with contextual indicators: an ecological study. Rev Bras Geriatr Gerontol 2020; 23:200171.
- 42Erkoreka M, Hernando-Pérez J. Decentralization: a handicap in fighting the COVID-19 pandemic? The response of the regional governments in Spain. Public Adm Dev 2022; (Online ahead of print).
- 43Kim Y, Jeong YA. The role of local governments in South Korea's COVID-19 response. Public Adm Dev 2022; (Online ahead of print).
- 44Serikbayeva B, Abdulla K, Oskenbayev Y. State capacity in responding to COVID-19. International Journal of Public Administration 2021; 44:920-30.
- 45Kavanagh MM, Singh R. Democracy, capacity, and coercion in pandemic response: COVID-19 in comparative political perspective. J Health Polit Policy Law 2020; 45:997-1012.
- 46Ferreira MAM, Emmendoerfer M, Silvestre HMC, Correia AM. Capacidade estatal e redes de cooperação pública na saúde no controle da pandemia COVID-19. Sistemas & Gestão 2022; 17:314-26.
- 47Julião KS, Olivieri C. Cooperação intergovernamental na política de saúde: a experiência dos consórcios públicos verticais no Ceará, Brasil. Cad Saúde Pública 2020; 36:e00037519.
- 48Santos RJM. Consórcios públicos de saúde em tempos de pandemia da COVID-19. In: Santos AO, Lopes LT, editors. Planejamento e gestão. Brasília: Conselho Nacional de Secretários de Saúde; 2021. p. 244-54.
- 49Schmidt F, Mello J, Cavalcante P. Estratégias de coordenação governamental na crise da COVID-19. Brasília: Instituto de Pesquisa Econômica Aplicada; 2020. (Nota Técnica, 32).
- 50Lui L, Segatto CI, Albert CE, Santos RM. Capacidades estatais e políticas municipais de educação durante a pandemia de COVID-19. Cadernos Gestão Pública e Cidadania 2023; 28:e86049.
- 51Grin EJ. O verso e o reverso da cooperação federativa e da difusão vertical de políticas para promover capacidade estatal nos municípios brasileiros. Administração Pública e Gestão Social 2021; 13(2). https://periodicos.ufv.br/apgs/article/view/9686
» https://periodicos.ufv.br/apgs/article/view/9686 - 52Panos E, Dafni P, Kostas G, Zacharoula M. Crisis management in the health sector: qualities and characteristics of health crisis managers. Int J Caring Sci 2009; 2:105-7.
- 53Cota W. Monitoring the number of COVID-19 cases and deaths in Brazil at municipal and federative units level. https://covid19br.wcota.me/?fbclid=IwAR06ZBfAk_-73gmXmx90CzfV9WgPmxbbTq7Cyu2vpFGmqxKFjqcuX_61YJo#footer (accessed on 31/Dec/2020).
» https://covid19br.wcota.me/?fbclid=IwAR06ZBfAk_-73gmXmx90CzfV9WgPmxbbTq7Cyu2vpFGmqxKFjqcuX_61YJo#footer
Publication Dates
- Publication in this collection
29 July 2024 - Date of issue
2024
History
- Received
08 Sept 2023 - Reviewed
02 Feb 2024 - Accepted
11 Mar 2024