ABSTRACT

OBJETIVE

Analyze the implementation of the strategy e-SUS Atenção Básica (e-SUS AB – e-SUS Primary Care) in Brazil between the first years of the system, from 2013 to 2019.

METHODS

This is a quantitative, descriptive, and exploratory study. We considered official data from the Ministry of Health, submitted by Brazilian municipalities, in the period from April 2013 to December 2019. We categorized the municipalities as ‘not implemented’, ‘initial implementation’, ‘partial implementation’ and ‘implemented’ according to the criteria defined in this study. We also verified whether the type of municipality, according to the IBGE classification, influenced the degree of implementation of the e-SUS AB strategy. We performed descriptive analyses and investigated the association between the degrees of implementation of e-SUS AB and the typology of the IBGE classification and characterization of rural and urban spaces.

RESULTS

The implementation increased in the analyzed period. The implementation status of the e-SUS AB strategy in 2019 was ‘implemented’ in 20.2% (1,117) of the municipalities, ‘partial implementation’ in 32.9% (1,819), ‘initial implementation’ in 39.1% (2,159) and ‘not implemented’ in 7.8% (432). The South and Southeast regions presented the best implementation situation in all years, and the states of Rio Grande do Sul, São Paulo and Santa Catarina reached a higher percentage of municipalities with ‘implemented’ status in 2019.

CONCLUSIONS

We confirmed the progress in the implementation of the e-SUS AB strategy over the years. Most of the municipalities are between the status ‘initial implementation’ and ‘partial implementation’. Therefore, we conclude that investments in technological resources, training of professionals, and support are necessary to qualify the implementation and use of information systems in the country, especially for the e-SUS AB strategy.

Unified Health System; Electronic Health Records; Health Information Systems; Primary Health Care; eHealth Strategies

INTRODUCTION

Health information systems (HIS) are standardized data collection and monitoring tools designed to provide information for health analysis, aiming at improving the understanding of the population’s health problems¹1. Marin HF. Sistemas de informação em saúde: considerações gerais. J Health Informatics. 2010 [cited 2020 Feb 24];2(1):20-4. Available from: http://www.jhi-sbis.saude.ws/ojs-jhi/index.php/jhi-sbis/article/view/4
http://www.jhi-sbis.saude.ws/ojs-jhi/ind... ,²2. Thaines GHLS, Bellato R, Faria APS, Araújo LFS. Produção, fluxo e análise de dados do sistema de informação em saúde: um caso exemplar. Texto Context Enferm. 2009;18(3):466-74. https://doi.org/10.1590/S0104-07072009000300009
https://doi.org/10.1590/S0104-0707200900... , subsidizing decision making in public policies³3. Pinheiro ALS, Andrade KTS, Silva DO, Zacharias FCM, Gomide MFS, Pinto IC. Gestão da saúde: o uso dos sistemas de informação e o compartilhamento de conhecimento para a tomada de decisão. Texto Contexto Enferm. 2016;25(3):9. https://doi.org/10.1590/0104-07072016003440015
https://doi.org/10.1590/0104-07072016003... .

Historically, Brazilian HIS are fragmented. With multiple sources, the collected data is consolidated with low quality and its availability adopts a format that hinders its appropriation and use by health managers⁴4. Morais RM, Costa AL. Um modelo para avaliação de sistemas de informação do SUS de abrangência nacional: o processo de seleção e estruturação de indicadores. Rev Adm Publica. 2014;48(3):767-93. https://doi.org/10.1590/0034-76121512
https://doi.org/10.1590/0034-76121512... ,⁵5. Jorge MHPM, Laurenti R, Gotlieb SLD. Avaliação dos sistemas de informação em saúde no Brasil. Cad Saude Coletiva. 2010 [cited 2020 Feb 25];18(1):7-18. Available from: http://www.cadernos.iesc.ufrj.br/cadernos/images/csc/2010_1/artigos/Modelo%20Livro%20UFRJ%201-a.pdf
http://www.cadernos.iesc.ufrj.br/caderno... . Thus, the monitoring of the quality of the data that serves the Brazilian Unified Health System (SUS) does not follow a regular plan of evaluations, with only isolated initiatives⁶6. Lima CRA, Schramm JMA, Coeli CM, Silva MEM. Revisão das dimensões de qualidade dos dados e métodos aplicados na avaliação dos sistemas de informação em saúde. Cad Saude Publica. 2009;25(10):2095-109. https://doi.org/10.1590/S0102-311X2009001000002
https://doi.org/10.1590/S0102-311X200900... .

The Brazilian government, inspired by successful experiences in countries in Europe, in Canada, Australia and New Zealand, among others, conceived and adopted the e-Health Strategy for Brazil. The e-Health Strategy aims to increase the quality and expand access to health care, qualify the teams, streamline care and improve the flow of information for clinical decision making, surveillance, regulation and health promotion. In addition, it aims at decision making focused on health management⁷7. Ministério da Saúde (BR), Comitê Gestor da Estratégia e-Saúde. Estratégia e-Saúde para o Brasil. Ministério. Brasília, DF; 2017 [cited 2020 Feb 24]. Available from: http://portalarquivos.saude.gov.br/images/pdf/2017/julho/12/Estrategia-e-saude-para-o-Brasil.pdf
http://portalarquivos.saude.gov.br/image... , in line with the National Information and Informatics Policy, which, in its latest version in 2016, reinforced the importance of guiding information and communication technology (ICT) actions and standardizing the collection and processing of health system data⁸8. Ministério da Saúde (BR), Secretaria Executiva, Departamento de Monitoramento e Avaliação do SUS. Política Nacional de Informação e Informática em Saúde. Brasília, DF; 2016 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/politica_nacional_infor_informatica_saude_2016.pdf
http://bvsms.saude.gov.br/bvs/publicacoe... .

In primary care (PC), the strategy e-SUS Atenção Básica (e-SUS AB – e-SUS Primary Care) was created in 2013⁹9. Ministério da Saúde (BR). Portaria N°1.412, de 10 de julho de 2013. Institui o Sistema de Informação em Saúde para a Atenção Básica (SISAB). Brasilia, DF; 2013 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt1412_10_07_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis... ,¹⁰10. Ministério da Saúde (BR). Portaria No 1.113, de 31 de julho de 2015. Altera o § 3º do art. 3º da Portaria nº 1.412/GM/MS, de 10 de julho de 2013, que institui o Sistema de Informação em Saúde para a Atenção Básica (SISAB). Brasília, DF; 2015 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1113_31_07_2015.html
http://bvsms.saude.gov.br/bvs/saudelegis... . It proposed to offer a new health information system to meet the different informatization and organization needs of the municipalities. Its goal was to modernize the technological platform, supporting care management, optimizing data collection, interfacing with the various systems used by primary care, and improving the detailing of health information¹¹11. Comitê Gestor da Internet no Brasil, Núcleo de Informação e Coordenação do Ponto BR. TIC Saúde: pesquisa sobre o uso das tecnologias de informação e comunicação nos estabelecimentos de saúde brasileiros. Estratégia e-SUS AB: transformação digital na Atenção Básica do Brasil. São Paulo; 2018 [cited 2020 Feb 24]. Available from: https://cetic.br/media/docs/publicacoes/2/tic_saude_2017_livro_eletronico.pdf
https://cetic.br/media/docs/publicacoes/... . This would be possible through the National Health Card, which allows the individualization of records, which was a great challenge for Brazil, because it broke the logic of consolidated data used in primary care until then.

Three years after the system was made available, it became mandatory to send information to the database of the Sistema de Informação em Saúde para a Atenção Básica (SISAB – Health Information System for Primary Care)¹⁰10. Ministério da Saúde (BR). Portaria No 1.113, de 31 de julho de 2015. Altera o § 3º do art. 3º da Portaria nº 1.412/GM/MS, de 10 de julho de 2013, que institui o Sistema de Informação em Saúde para a Atenção Básica (SISAB). Brasília, DF; 2015 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1113_31_07_2015.html
http://bvsms.saude.gov.br/bvs/saudelegis... .

The e-SUS AB strategy includes the national information repository SISAB and two collection software for entering primary data recorded by primary care professionals: 1) Coleta de Dados Simplificada (CDS – Simplified Data Collection), using paper forms; and 2) Prontuário Eletrônico do Cidadão (PEC – Electronic Citizen Record), a computational system. It also includes the systems sold by third parties or the municipalities’ own systems, integrated by means of a previously defined data import mechanism ¹1. Marin HF. Sistemas de informação em saúde: considerações gerais. J Health Informatics. 2010 [cited 2020 Feb 24];2(1):20-4. Available from: http://www.jhi-sbis.saude.ws/ojs-jhi/index.php/jhi-sbis/article/view/4
http://www.jhi-sbis.saude.ws/ojs-jhi/ind... .

The movement generated by the change in the information system impelled the informatization of primary care services throughout the country and can be considered a success story among the available systems at the federal level. Souza et al.¹⁰10. Ministério da Saúde (BR). Portaria No 1.113, de 31 de julho de 2015. Altera o § 3º do art. 3º da Portaria nº 1.412/GM/MS, de 10 de julho de 2013, que institui o Sistema de Informação em Saúde para a Atenção Básica (SISAB). Brasília, DF; 2015 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1113_31_07_2015.html
http://bvsms.saude.gov.br/bvs/saudelegis... highlight that, in 2018, the e-SUS AB strategy was present in the 5,562 Brazilian municipalities with primary care services and around 98% of the family health teams (eSF– Saúde da Família), representing more than 42.8 thousand teams.

Despite the visible progress, studies analyzing the evolution of the e-SUS AB implementation are still scarce, as well as the factors that influence this process and the time needed to implement the strategy. It is plausible the existence of different degrees of implementation of the strategy, influenced by the characteristics of the municipalities, such as their location, population density, urbanization, level of informatization, etc. Geographic and socioeconomic factors, in general, are relevant for government initiatives that require the prior availability of specific resources for their implementation, while they are measurable and available, in official databases, facilitating their use for monitoring the progress of implementation.

This study analyzed the implementation of the e-SUS AB strategy in Brazil in the period from 2013 to 2019, also investigating municipal characteristics that potentially influenced the best performance in this process.

METHODS

Study Design

This is a quantitative, descriptive and exploratory study, based on administrative data. We estimated the degree of implementation of e-SUS AB at the municipal level, considering the period from April 2013 to December 2019. Thus, the study population consists of the Brazilian municipalities offering Primary Care services registered in the Cadastro Nacional de Estabelecimentos de Saúde (CNES – National Registry of Health Care Establishments). The number of municipalities presented a variation in the years studied: 5,454 (2013); 5,496 (2014); 5,514 (2015); 5,517 (2016); 5,522 (2017); 5,524 (2018); and 5,527 (2019). We based the stage of implementation in each municipality on data provided by the primary care/family health teams to the Ministry of Health regarding the use of e-SUS AB. We excluded from this study Atenção Básica Prisional (EABP – Prison Primary Care Teams), Núcleo de Apoio a Saúde da Família (NASF – Family Health Support Center), Consultório na Rua (CnR – Street Clinic), isolated Oral Health Teams (not linked to an ESF), and Basic Health Units with no linked teams.

Procedures Adopted to Estimate the Percentage of e-SUS Implementation

The variables used in this study reflect the systematic sending of data to SISAB: competence (month), Federated Unit (FU), municipality code from the Brazilian Institute of Geography and Statistics (IBGE), health unit code from CNES, team code from the Identificador Nacional de Equipes (INE – National Team Identifier), team type code from CNES, professional category, and valid records in the CNES national base.

The preparation of the database preceded the data analysis, comprising the following processing steps: identification of the active professional categories in the CNES per month; verification of the information sent to SISAB by the active professional categories in the CNES (doctor, nurse, nursing technician and assistant, dentist, oral health technician and assistant, and community health agent); analysis of the information sent to SISAB by Primary Care/Family Health team. In this step, we analyzed whether the professional categories of each team sent information, classifying the teams between those that sent information and those that did not, according to the criteria defined for the study.

In the next step, we defined and applied the criteria to characterize the degree of implementation of e-SUS AB, considering the frequency and regularity of data submission to SISAB. First, we considered data submission by team: a) Insufficient Submission – no submission of information or submission of less than 30% of the year’s competencies; b) Initial Submission – Submission of information above 30% of the year’s competencies or submission of information for three (3) consecutive competencies in the year; c) Partial Submission – Submission of information above 50% of the year’s competencies and submission of information for three (3) consecutive competencies in the year; d) Satisfactory Submission – Submission of information above 80% of the year’s competencies and three (3) consecutive competencies in the year.

Next, the results of the previous step were used to assess the degree of implementation of the e-SUS AB strategy in the municipalities: a) Not Implemented – more than 80% of the teams in the municipality classified as ‘insufficient submission’ in the previous phase; b) Initial Implementation – more than 80% of the teams in the municipality classified as ‘initial submission’ or between 50% and 80% of the teams classified as ‘partial submission’ or between 30% and 50% of the teams classified as ‘satisfactory submission’ in the previous phase; c) Partial Implementation – more than 80% of the municipality’s teams classified as ‘partial submission’ or between 50% and 80% of the teams classified as ‘satisfactory submission’ in the previous phase; d) Implemented – more than 80% of the municipality’s teams classified as ‘satisfactory submission’ in the previous phase. Figure 1 shows the flow of the classification performed.

Statistical Analysis

The data was calculated using the ‘team’ as the unit of analysis, and then aggregated by municipality, and finally by state, by geographic region, and nationally. We presented the data as maps and graphs and made the analysis using the programming language R and RStudio (version 1.1.463, 2009 – 2018¹²12. R Core Team. R: a language and environment for statistical computing. Vienna (AT): R Foundation for Statistical Computing; 2018 [cited 2020 Feb 26]. Available from: https://www.r-project.org/
https://www.r-project.org/... , package plyr, dplyr, readxl and rlist).

Finally, we also used the IBGE¹³13. Instituto Brasileiro de Geografia e Estatística, Diretoria de Geociências, Coordenação de Geografia. Classificação e caracterização dos espaços rurais e urbanos do Brasil: uma primeira aproximação. Rio de Janeiro: IBGE; 2017 [cited 2020 Feb 24]. (Estudos e Pesquisas. Informação Geográfica; nº 11). Available from: https://biblioteca.ibge.gov.br/visualizacao/livros/liv100643.pdf
https://biblioteca.ibge.gov.br/visualiza... classification for characterizing rural and urban spaces to investigate the implementation of e-SUS AB, considering the groups defined in it. This classification considers aspects related to population density and its distribution in the territory of the municipalities, to define five groups, applicable to the characterization of Brazilian municipalities: urban, adjacent intermediate, remote intermediate, adjacent rural, and remote rural.

Ethical Considerations

We conducted the research in accordance with ethical research standards. This study used secondary and unidentified data from official information systems of the Ministry of Health, exempted from ethics committee review, as provided in Resolution No. 510, April 7, 2016¹⁴14. Ministério da Saúde (BR), Conselho Nacional de Saúde. Resolução No 510, de 07 de abril de 2016. Dispõe sobre as normas aplicáveis a pesquisas em Ciências Humanas e Sociais cujos procedimentos metodológicos envolvam a utilização de dados diretamente obtidos com os participantes ou de informações identificáveis ou que possam acarretar riscos maiores do que os existentes na vida cotidiana, na forma definida nesta Resolução. Brasília, DF: CNS; 2016 [cited 2020 Feb 24]. Available from: http://conselho.saude.gov.br/resolucoes/2016/Reso510.pdf
http://conselho.saude.gov.br/resolucoes/... .

RESULTS

The aggregated national scale results of the implementation of the e-SUS AB strategy show expressive growth in the implementation of the system. The Figure 2 shows the evolution of the implementation of this strategy in Brazil from 2013 to 2019. In 2013 and 2014, the classification of the status of municipalities were 99.7% and 83.4% to ‘not implemented’, respectively. In 2015, 49.2% of municipalities achieved some degree of implementation other than ‘not implemented’ status. In 2016 and 2017, the ‘initial implementation’ and ‘partial implementation’ statuses exceeded the ‘not implemented’ percentage and the largest share was between the ‘initial implementation’ status, 49.7% and 48.3%, and ‘partial implementation’ status, 21.6% and 28.7%, respectively. In the last two years of analysis, 2018 and 2019, 37.9% and 39.1% of municipalities had ‘initial implementation’ status; 32.4% and 32.9%, ‘partial implementation’; and with ‘implemented’ status, 21.7% and 20.2%, respectively.

The evolution of the implementation of the e-SUS AB strategy happened differently among the country’s regions, as shown in Figure 3. In terms of the percentage of implementation, the North, Northeast, and Midwest regions were below the national average in every year since 2015, while the Southeast and South regions were above the national average in the same period. In 2019, the percentages of municipalities in the ‘implemented’ and ‘partial implementation’ situation exceed the ‘not implemented’ and ‘initial implementation’ situation in Brazil. In this aspect, the Southeast region presents the best situation, with 56.8% of the municipalities in this situation; followed by the South region, 54.1%; the North, 53%; the Northeast, 51.4%; and the Midwest, 44.5%. The analysis of the best percentage of municipalities with ‘implemented’ status highlights the South region (24.8%); followed by the Southeast region (24.4%); the Midwest (16.9%); and the Northeast and North (15.4%) with the same percentage.

In the analysis of implementation by State (Table 1), we observed that the highest percentage of municipalities with the ‘implemented’ situation in 2019 was in the state of Rio Grande do Sul (30.3%), followed by São Paulo (29.5%) and Santa Catarina (28.8%). The state with the most deficient situation is Amapá, with 4.5% of the municipalities with the ‘implemented’ status. Distrito Federal, despite its peculiarities, did not present the ‘implemented’ situation. The Brazilian states with the highest percentage of municipalities with the ‘not implemented’ situation were Roraima with 20%, Paraná with 15.3%, Rio Grande do Sul, and Goiás with 13.7%. Alagoas also had no municipality with a ‘not implemented’ situation.

Figure 4 shows the differences in relation to the classification and characterization of rural and urban spaces in Brazil. In 2019, the distribution of municipalities for each typology was ‘remote rural’ (322), ‘adjacent rural’ (3,022), ‘remote intermediate’ (60), ‘adjacent intermediate’ (680) and ‘urban’ (1,443). Municipalities classified as ‘adjacent rural’ and ‘urban’ had the highest percentage of implemented in all years of the study. In 2019, the highest percentage of ‘not implemented’ was from municipalities classified as ‘remote rural’ (9.9%).

DISCUSSION

This is the first study conducted in Brazil to analyze the implementation of the e-SUS AB strategy. In addition, this study also considered the municipal sphere and the association between the characteristics of the municipalities and their performance in the strategy implementation process. The results mainly showed that, in 2019, 92.2% of Brazilian municipalities had a degree of e-SUS AB implementation distinct from ‘not implemented’. The South and Southeast regions stood out with higher percentages of strategy implementation, with the states with the highest percentages of ‘implemented’ status being Rio Grande do Sul (30.3%), São Paulo (29.5%), and Santa Catarina (28.8%).

Several factors and organizational arrangements affects the implementation of health information systems. Studies show that the degree of informatization, availability of internet connection, qualification and training of health professionals, and adequate IT (information technology) support¹⁵15. Medeiros JB, Holmes ES, Albuquerque SGE, Santos SR, Candeia RMS, Costa T. O E-SUS Atenção Básica e a coleta de dados simplificada: relatos da implementação em uma estratégia saúde da família. Rev Atenção Primaria Saude. 2017;20(1):145-9. https://doi.org/10.34019/1809-8363.2017.v20.15784
https://doi.org/10.34019/1809-8363.2017.... ,¹⁶16. Ribeiro MA, Muniz TBF, Albuquerque IMN, Vasconcelos AA, Costa MM, Vasconcelos AMB. Processo de implantação do e-SUS Atenção Básica em Sobral – CE. Rev Eletron Comun Inform Inov Saude. 2018;12(3):258-67. https://doi.org/10.29397/reciis.v12i3.1364
https://doi.org/10.29397/reciis.v12i3.13... are key factors for the successful implementation of information systems. In addition, the characteristics of the system’s user interface may also influence the implementation process, including the functionality of the features and their usability, the quality of the data collected, and interoperability with other systems¹⁷17. Thum MA, Baldisserotto J, Celeste RK. Utilização do e-SUS AB e fatores associados ao registro de procedimentos e consultas da atenção básica nos municípios brasileiros. Cad Saude Publica. 2019;35(2): e00029418. https://doi.org/10.1590/0102-311X00029418
https://doi.org/10.1590/0102-311X0002941... .

A systematic review demonstrated that the process of implementing an information system is as important as the system itself. In this study, implementers’ concerns were patient privacy and safety, provider/patient relationship, staff anxiety, time required to implement the HIS, quality of care, financial issues, efficiency, and accountability¹⁸18. Ludwick DA, Doucette J. Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inform. 2009;78(1):22-31. https://doi.org/10.1016/j.ijmedinf.2008.06.005
https://doi.org/10.1016/j.ijmedinf.2008.... .

In Brazil, the e-SUS AB strategy was developed with support of the states and municipalities, represented by their entities, the Conselho Nacional de Secretários de Saúde (CONASS – National Council of Health Secretaries) and the Conselho Nacional de Secretarias Municipais de Saúde (CONASEMS – National Council of Municipal Health Secretaries). In the context of the results presented in this study, it is important to consider some previous actions of the Ministry of Health, developed since 2013, as preparatory to the implementation of the e-SUS AB strategy. Among these actions are the project QualiSUS-Rede (QualiSUS-Net), focused on the supply of equipment and peripherals for 486 municipalities; the support for the implementation for municipalities covered by 14 Telessaúde (Telehealth) centers; the training workshops for multipliers for municipalities with populations larger than 100 thousand inhabitants; the local support for municipalities via e-SUS AB consultants; the support for Dial 136 and for the Primary Care Department to solve doubts about the system and the supply of connectivity points for approximately 13 thousand Primary Care Units¹¹11. Comitê Gestor da Internet no Brasil, Núcleo de Informação e Coordenação do Ponto BR. TIC Saúde: pesquisa sobre o uso das tecnologias de informação e comunicação nos estabelecimentos de saúde brasileiros. Estratégia e-SUS AB: transformação digital na Atenção Básica do Brasil. São Paulo; 2018 [cited 2020 Feb 24]. Available from: https://cetic.br/media/docs/publicacoes/2/tic_saude_2017_livro_eletronico.pdf
https://cetic.br/media/docs/publicacoes/... ,¹⁹19. Cielo AC, Costa ML, Fava V, Lora V, Gomes IC, Kitajima A, et al. Consultores e-SUS AB: A estratégia de apoio à implantação dos Sistemas e-SUS AB por meio de consultores externos. In: Anais do 12o Congresso Internacional da Rede Unida. Rev Saude Redes. 2016 [cited 2020 Feb 24];2(1 Supl):1. Available from: http://conferencia2016.redeunida.org.br/ocs/index.php/congresso/2016/paper/view/5697
http://conferencia2016.redeunida.org.br/... ,²⁰20. Pilz C. Desafios e propostas para a informatização da Atenção Primária no Brasil na perspectiva de implantação do Prontuário Eletrônico do e-SUS AB [tese]. Porto Alegre, RS: Faculdade de Odontologia, Universidade Federal do Rio Grande do Sul; 2016..

In 2019, the Program to Support the Informatization and Qualification of Primary Health Care Data (Informatiza APS) was instituted by the Ministry of Health to computerize all Family Health Teams (eSF) and Primary Health Care Teams (eAP) in the country and to qualify the health data of the municipalities and the Federal District²¹21. Ministério da Saúde (BR). Portaria No 2.983, de 11 de novembro de 2019 Institui o Programa de Apoio à Informatização e Qualificação dos Dados da Atenção Primária à Saúde - Informatiza APS, por meio da alteração das Portarias de Consolidação nº 5/GM/MS e nº 6/GM/MS, de 28 de setembro de 2017. Diario Oficial da União. 13 nov 2019 [cited 2020 Feb 24]; Seção 1:99. Available from: http://www.in.gov.br/en/web/dou/-/portaria-n-2.983-de-11-de-novembro-de-2019-227652196
http://www.in.gov.br/en/web/dou/-/portar... , which certainly may have made an important contribution to the informatization scenario necessary for the implementation of the e-SUS AB strategy, especially in more vulnerable localities.

The results of this study showed that the e-SUS AB strategy has distinct moments of implementation, with the greatest degree of implementation at the beginning of the process, in 2013, in the Northeast and Southeast, while in subsequent years, the South region showed the greatest advance in implementation. This result may be influenced by the state of Rio Grande do Sul, which appears with one of the highest rates of implementation in recent years of the series studied, corroborating the results of a study that reported the experience of the participation of telehealth services to support the implementation, with better distribution of training in the local scenario, face-to-face and remote activities to support managers and professionals²⁰20. Pilz C. Desafios e propostas para a informatização da Atenção Primária no Brasil na perspectiva de implantação do Prontuário Eletrônico do e-SUS AB [tese]. Porto Alegre, RS: Faculdade de Odontologia, Universidade Federal do Rio Grande do Sul; 2016..

The relationship between the degree of implementation and the type of municipality by the classification and characterization of rural and urban spaces in Brazil, made by IBGE, demonstrated the dependence between the variables. We saw lower implementation percentages in municipalities with the ‘remote rural’ and ‘remote intermediate’ typologies. Geographic and professional isolation may influence the implementation and require specific strategies to face the geographic barriers, such as the implementation of technologies of an interconnected communication network between health units and other levels of care that analyzes the peculiarities of the technological infrastructure, which are not always available in these locations²²22. Pessoa VM, Almeida MM, Carneiro FF. Como garantir o direito à saúde para as populações do campo, da floresta e das águas no Brasil? Saude Debate. 2018;42(1):302-14. https://doi.org/10.1590/0103-11042018s120
https://doi.org/10.1590/0103-11042018s12... .

Another important aspect is the reliability of HIS. A systematic review evaluated studies conducted in Brazil and identified four priority dimensions of quality, which are reliability, validity, coverage and completeness⁶6. Lima CRA, Schramm JMA, Coeli CM, Silva MEM. Revisão das dimensões de qualidade dos dados e métodos aplicados na avaliação dos sistemas de informação em saúde. Cad Saude Publica. 2009;25(10):2095-109. https://doi.org/10.1590/S0102-311X2009001000002
https://doi.org/10.1590/S0102-311X200900... . The importance of good quality information indicates the need to establish a formal and regular evaluation policy for the HIS in Brazil, especially for those of national scope. This study did not directly address the quality of information provided in the e-SUS AB strategy, but the indicators used reflect, albeit in an exploratory way, some of the relevant aspects for information quality considerations.

In addition, computers and other technological resources are essential for the use of diagnostic and treatment systems, as well as information systems and electronic patient record systems that provide the information to support decision making. The better the computerized systems are able to record, store, and make available information, the better the information will be and the higher the quality in decision making will be¹1. Marin HF. Sistemas de informação em saúde: considerações gerais. J Health Informatics. 2010 [cited 2020 Feb 24];2(1):20-4. Available from: http://www.jhi-sbis.saude.ws/ojs-jhi/index.php/jhi-sbis/article/view/4
http://www.jhi-sbis.saude.ws/ojs-jhi/ind... ,²³23. Gonçalves JPP, Batista LR, Carvalho LM, Oliveira MP, Moreira KS, Leite MTS. Prontuário Eletrônico: uma ferramenta que pode contribuir para a integração das Redes de Atenção à Saúde. Saude Debate. 2013 [cited 2020 Feb 24];37(96):43-50. Available from: https://www.scielo.br/j/sdeb/a/xLMq3HyhgqNwhX6y3jjpNff/?format=pdf&lang=pt
https://www.scielo.br/j/sdeb/a/xLMq3Hyhg... , with electronic medical record systems standing out.

Finally, the results of this study also add to the national discussion on monitoring and evaluation, in the scope of the Política Nacional de Informação e Informática em Saúde (PNIIS – National Health Information and Informatics Policy), establishing a series of guidelines that encourage, among other aspects, the promotion of strategies and mechanisms for the qualification of production and management of health information to strengthen e-Health, in the three spheres of SUS management⁸8. Ministério da Saúde (BR), Secretaria Executiva, Departamento de Monitoramento e Avaliação do SUS. Política Nacional de Informação e Informática em Saúde. Brasília, DF; 2016 [cited 2020 Feb 24]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/politica_nacional_infor_informatica_saude_2016.pdf
http://bvsms.saude.gov.br/bvs/publicacoe... .

It is possible to understand the results of this study by considering its methodological limitations: first, other agents, in addition to health professionals, may have produced the records of the e-SUS AB strategy, since municipalities may adopt organizational arrangements where data entry and submission are performed outside the UBS, in administrative sectors of the health secretariats. On the other hand, there are municipalities using their own systems or systems marketed by third parties, where sending data in an adequate manner also depends on these service providers. Secondly, as the data in this study were not broken down at the sub-municipal level and in aggregate form, it is not possible to have an explicit vision of the flows of production and sending of the information analyzed.

Another important issue is that this study did not adopt a previous model validated by the literature to evaluate the degree of implementation of information systems, making it necessary to develop an original model for this analysis. Although not exactly a limitation, the discussion about the design adopted in this study to classify the implementation may benefit its validation and subsequent adoption, including in the health policy sphere, for monitoring and evaluation of this and other SUS strategies.

This study offers subsidies to support the public sector in monitoring and evaluating the implementation of information systems. It also presents useful solutions to improve the implementation of the e-SUS AB system, as well as contributing to the discussion about the model adopted in the provision of computerized systems, and to ground future studies in different areas of knowledge.

The results reinforce the need for consistent investments in the training of professionals to use the information system studied, systematic monitoring of the production of information – from collection to validation – and dissemination of data.

REFERENCES

Publication Dates

History