ABSTRACT

OBJECTIVE

To evaluate the quality of information on gestational syphilis (GS) and congenital syphilis (CS) on the Sistema de Informação de Agravos de Notificação (SINAN-Syphilis Brazil – Notifiable Diseases Information System) by compiling and validating completeness indicators between 2007 and 2018.

METHODS

Overall, care, and socioeconomic completeness scores were compiled based on selected variables, by using ad hoc weights assigned by experts. The completeness scores were analysed, considering the region and area of residence, the pregnant woman’s race/colour, and the year of case notification. Pearson’s correlation coefficients were used to validate the scores obtained by the weighted average method, compared with the values obtained by principal component analysis (PCA).

RESULTS

Most selected variables presented a good or excellent degree of completeness for GS and CS, except for clinical classification, pregnant woman’s level of education, partner’s treatment, and child’s race/colour, which were classified as poor or very poor. The overall (89.93% versus 89.69%) and socioeconomic (88.71% versus 88.24%) completeness scores for GS and CS, respectively, were classified as regular, whereas the care score (GS-90.88%, and CS-90.72%) was good, despite improvements over time. Differences in the overall, care and socioeconomic completeness scores according to region, area of residence, and ethnic-racial groups were reported for syphilis notifications. The completeness scores estimated by the weighted average method and PCA showed a strong linear correlation (> 0.90).

CONCLUSION

The completeness of GS and CS notifications has been improving in recent years, highlighting the variables that form the care score, compared with the socioeconomic scores, despite differences between regions, area of residence, and ethnic-racial groups. The weighted average was a viable methodological alternative easily operationalised to estimate data completeness scores, allowing routine monitoring of the completeness of gestational and congenital syphilis records.

Health Information Systems; Syphilis, Congenital; Data Accuracy

INTRODUCTION

Problems with the quality of data registered on Brazilian Health Information Systems (HIS) remain, despite the undeniable progress made in recent years¹1. Laguardia J, Domingues CM, Carvalho C, Lauerman CR, Macário E, Glatt R. Sistema de informação de agravos de notificação em saúde (Sinan): desafios no desenvolvimento de um sistema de informação em saúde. Epidemiol Serv Saude. 2004;13:135-46. https://doi.org/10.5123/S1679-49742004000300002
https://doi.org/10.5123/S1679-4974200400... . Different parameters have been used to evaluate the quality of health information, including completeness²2. Marques CA, Siqueira MM, Portugal FB. [Assessment of the lack of completeness of compulsory dengue fever notifications registered by a small municipality in Brazil]. Cien Saude Colet. 2020 Mar;25(3):891-900. Portuguese. https://doi.org/10.1590/1413-81232020253.16162018
https://doi.org/10.1590/1413-81232020253... ,³3. Lima CR, Schramm JM, Coeli CM, Silva ME. [Review of data quality dimensions and applied methods in the evaluation of health information systems]. Cad Saude Publica. 2009 Oct;25(10):2095-109. Portuguese. https://doi.org/10.1590/S0102-311X2009001000002
https://doi.org/10.1590/S0102-311X200900... , defined as the degree of variable completion on HIS, a thermometer of the quality of information generated by these systems³3. Lima CR, Schramm JM, Coeli CM, Silva ME. [Review of data quality dimensions and applied methods in the evaluation of health information systems]. Cad Saude Publica. 2009 Oct;25(10):2095-109. Portuguese. https://doi.org/10.1590/S0102-311X2009001000002
https://doi.org/10.1590/S0102-311X200900... .

The incompleteness of information from HIS impairs the accuracy of records, affecting the reliability of the information, the adequate knowledge of the health-disease process, and the epidemiological patterns of events⁴4. Saraceni V, Domingues RM, Vellozo V, Lauria LM, Dias MAB, Ratto KMN, et al. [Surveillance of syphilis in pregnancy/. Epidemiol Serv Saude. 2007 Jun;16(2):103-11. Portuguese. https://doi.org/10.5123/S1679-49742007000200005
https://doi.org/10.5123/S1679-4974200700... ,⁵5. Correia LO, Padilha BM, Vasconcelos SM. Methods for assessing the completeness of data in health information systems in Brazil: a systematic review. Cien Saude Colet. 2014 Nov;19(11):4467-78. Portuguese. https://doi.org/10.1590/1413-812320141911.02822013
https://doi.org/10.1590/1413-81232014191... . It reduces the capacity to plan appropriate actions to prevent and control disease and disorders within the scope of epidemiological surveillance, integrated into those of care⁶6. Ministério da Saúde (BR). Sistema de Informação de Agravos de Notificação-SINAN: normas e rotinas. Brasília, DF: Ministério da Saúde; 2006.. Therefore, HIS completeness is essential to promote and protect the population’s health and to appropriately plan and manage resources, including investments for the continuous improvement of these systems by the Ministry of Health²2. Marques CA, Siqueira MM, Portugal FB. [Assessment of the lack of completeness of compulsory dengue fever notifications registered by a small municipality in Brazil]. Cien Saude Colet. 2020 Mar;25(3):891-900. Portuguese. https://doi.org/10.1590/1413-81232020253.16162018
https://doi.org/10.1590/1413-81232020253... ,⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese..

Syphilis is among the diseases of great relevance in public health, and, therefore, we need qualified information for its monitoring. As a secular and historically neglected disease, syphilis is caused by the bacterium Treponema pallidum and transmitted mainly sexually and vertically⁸8. Hook EW 3rd. Syphilis. Lancet. 2017 Apr;389(10078):1550-7. https://doi.org/10.1016/S0140-6736(16)32411-4
https://doi.org/10.1016/S0140-6736(16)32... ,⁹9. World Health Organization. Report on global sexually transmitted infection surveillance 2018. Geneva: World Health Organization;. The World Health Organization (WHO) estimates that approximately 12 million new syphilis cases occur annually, mainly in low-and-middle-income countries⁹9. World Health Organization. Report on global sexually transmitted infection surveillance 2018. Geneva: World Health Organization;. During the pregnancy, labour, and postpartum phases, the mother-baby binomial has been the focus to track maternal syphilis in prenatal care, preventing the vertical transmission of congenital syphilis (CS).

In Brazil, approximately 61,441 cases of gestational syphilis (GS) and 22,065 cases of CS were reported in 2021, with a GS detection rate of 20.8 and CS incidence rate of 8.9 per 1,000 live births¹⁰10. Ministério da Saúde (BR). Departamento de Doenças de Condições Crônicas e Infecções Sexualmente Transmissíveis. Boletim Epidemiológico de Sífilis 2021. 2022 [cited 2022 Jan 21). Available from : http://www.aids.gov.br/pt-br/pub/2021/boletim-epidemiologico-de-sifilis-2021
http://www.aids.gov.br/pt-br/pub/2021/bo... . The CS was only included on the national list of diseases requiring mandatory notification in 1986, GS and acquired syphilis were added in 2005 and 2010, respectively⁶6. Ministério da Saúde (BR). Sistema de Informação de Agravos de Notificação-SINAN: normas e rotinas. Brasília, DF: Ministério da Saúde; 2006.,¹¹11. Dantas LA. [Epidemiologic profile of acquired syphilis diagnosed and notified at a maternal-child university hospital]. Enferm Glob. 2017;16(2):217-45. Portuguese. https://doi.org/10.6018/eglobal.16.2.229371
https://doi.org/10.6018/eglobal.16.2.229... , and are reported with individual notification records (INR) on the Sistema de Informação de Agravos de Notificação (SINAN – Notifiable Diseases Information System). Filling INR fields, including those not mandatory, is recommended following confirmation of a syphilis case⁶6. Ministério da Saúde (BR). Sistema de Informação de Agravos de Notificação-SINAN: normas e rotinas. Brasília, DF: Ministério da Saúde; 2006.. Analysing the information generated by GS and CS notification records is fundamental to monitoring diseases indicators and ensuring the improvement of prevention, control, and care, besides indicating strategies to enhance its completion quality.

Few national studies have evaluated the completeness of SINAN-Syphilis information⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,¹²12. Soares MA, Aquino R. Completeness and characterization of gestational syphilis and congenital syphilis records in Bahia, Brazil, 2007-2017. Epidemiol Serviços Saúde. 2021;30(4):e20201148,21. https://doi.org/10.1590/S1679-49742021000400018
https://doi.org/10.1590/S1679-4974202100... ,¹³13. Braz RM, Oliveira PT, Reis AT, Machado NM. [Evaluation of the race/color variable completeness in the national health information systems for the measuring of ethnic-racial inequality in indicators used by the Performance Index of the Brazilian Unified Health System]. Saúde Debate. 2013;37(99):554-62. Portuguese. https://doi.org/10.1590/S0103-11042013000400002
https://doi.org/10.1590/S0103-1104201300... and the factors that influence its variation, such as region, year of notification, area of residence, and race/colour of the individual, as has been evidenced in other studies with HIS in Brazil²2. Marques CA, Siqueira MM, Portugal FB. [Assessment of the lack of completeness of compulsory dengue fever notifications registered by a small municipality in Brazil]. Cien Saude Colet. 2020 Mar;25(3):891-900. Portuguese. https://doi.org/10.1590/1413-81232020253.16162018
https://doi.org/10.1590/1413-81232020253... ,⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,¹⁴14. Saraceni V, Miranda AE. [Coverage by the Family Health Strategy and diagnosis of syphilis in pregnancy and congenital syphilis]. Cad Saude Publica. 2012 Mar;28(3):490-6. Portuguese. https://doi.org/10.1590/S0102-311X2012000300009
https://doi.org/10.1590/S0102-311X201200... . Valuable indicators that are easily operationalised, which enable health managers and professionals to monitor the completeness of the information registered on HIS are also lacking. This study aims to evaluate the quality of the information by compiling and validating SINAN-Syphilis completeness indicators in Brazil between 2007 and 2018.

METHODS

This descriptive and analytical study evaluated the degree of completeness of the variables in the GS and CS records available on the Ministry of Health SINAN-Syphilis between 2007 and 2018⁶6. Ministério da Saúde (BR). Sistema de Informação de Agravos de Notificação-SINAN: normas e rotinas. Brasília, DF: Ministério da Saúde; 2006.. We build binary indicators and completeness scores for the overall variables selected and for those classified as socioeconomic or related to care. Completeness degree was classified according to Romero and Cunha¹⁵15. Romero DE, Cunha CB. Quality of socioeconomic and demographic data in relation to infant mortality in the Brazilian Mortality Information System (1996/2001). Cad Saude Publica. 2006 Mar;22(3):673-84. Portuguese. https://doi.org/10.1590/S0102-311X2006000300022
https://doi.org/10.1590/S0102-311X200600... as follows: excellent (> 95%), good (90%–95%), regular (80%–90%), poor (50%–80%), and very poor (≤ 50%).

The following variables were selected after a literature review of social determinants and factors related to the prevalence and incidence of gestational and congenital syphilis cases¹⁶16. Domingues RM, Leal MC. [Incidence of congenital syphilis and factors associated with vertical transmission: data from the Birth in Brazil study]. Cad Saude Publica. 2016 Jun;32(6):e00082415. https://doi.org/10.1590/0102-311X00082415
https://doi.org/10.1590/0102-311X0008241... and their importance for syphilis surveillance⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,⁹9. World Health Organization. Report on global sexually transmitted infection surveillance 2018. Geneva: World Health Organization;,¹⁰10. Ministério da Saúde (BR). Departamento de Doenças de Condições Crônicas e Infecções Sexualmente Transmissíveis. Boletim Epidemiológico de Sífilis 2021. 2022 [cited 2022 Jan 21). Available from : http://www.aids.gov.br/pt-br/pub/2021/boletim-epidemiologico-de-sifilis-2021
http://www.aids.gov.br/pt-br/pub/2021/bo... , monitoring⁴4. Saraceni V, Domingues RM, Vellozo V, Lauria LM, Dias MAB, Ratto KMN, et al. [Surveillance of syphilis in pregnancy/. Epidemiol Serv Saude. 2007 Jun;16(2):103-11. Portuguese. https://doi.org/10.5123/S1679-49742007000200005
https://doi.org/10.5123/S1679-4974200700... ,¹²12. Soares MA, Aquino R. Completeness and characterization of gestational syphilis and congenital syphilis records in Bahia, Brazil, 2007-2017. Epidemiol Serviços Saúde. 2021;30(4):e20201148,21. https://doi.org/10.1590/S1679-49742021000400018
https://doi.org/10.1590/S1679-4974202100... , and the knowledge of its epidemiological profile in the Brazilian territory⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,²⁰20. Cardoso AR, Araújo MA, Cavalcante MD, Frota MA, Melo SP. Analysis of cases of gestational and congenital syphilis between 2008 and 2010 in Fortaleza, State of Ceará, Brazil. Cien Saude Colet. 2018 Feb;23(2):563-74. https://doi.org/10.1590/1413-81232018232.01772016
https://doi.org/10.1590/1413-81232018232... : GS – pregnant woman’s age range, area of residence, level of education, race/colour, gestational age, qualitative results of treponemal and non-treponemal tests (VDRL), treatment regime, clinical classification, and partner’s treatment; and CS – age range, child’s sex and race/colour, area of residence, mother’s level of education and race/colour, qualitative VDRL results for the child, case evolution, attendance to prenatal care, treatment regime, time of diagnosis, and partner’s treatment.

Building the Completeness Indicators and Scores

(a) Binary completeness indicator: to evaluate the individual completion of each variable, the proportion of individual notification records with complete information was obtained, considering the indicator of the presence of information (1) or of it being absent, ignored, or inconsistent (0) in the selected variables.

(b) Completeness scores: to evaluate the completion of a set of variables, the weighted average method was used, based on the values of the binary indicators defined in (a) and weights defined on a scale from 1 to 4, varying from the lowest to the highest importance, related to syphilis surveillance, epidemiology, and disease control. Public health specialists and health professionals working in the Brazilian Unified Health System (SUS, in Portuguese Sistema Único de Saúde) assigned ad hoc weights for each variable. Subsequently, these subjective weights were evaluated and agreed upon by the study researchers, considering the value endorsed by most of the specialists (Table 1). Note that this approach is commonly used to propose indexes and tends to present similar results when compared with other weighting methods²¹21. Nguefack‐Tsague G, Klasen S, Zucchini W. On weighting the components of the human development index: a statistical justification. J Human Dev Capabil. 2011;12(2):183-202. https://doi.org/10.1080/19452829.2011.571077
https://doi.org/10.1080/19452829.2011.57... . Based on the final weights, the overall score considers all variables selected, whereas the socioeconomic and care scores consider the variables classified as socioeconomic and care, respectively. The three scores vary between 0 and 1, and the higher the score value, the better the completeness of the set of variables considered. The completeness scores were analysed according to the year of case notification, region, area of residence, and pregnant woman’s race/colour.

Validating the Completeness Scores

The validation was based on comparing the scores obtained by the weighted average method with those obtained with principal component analysis (PCA), a multivariate statistical technique used to reduce dimensionality, generate indexes (scores), and cluster individuals or variables. The tetrachoric correlation matrix of the binary completeness indicators was used to extract the principal components²⁴24. Kirk DB. On the numerical approximation of the bivariate normal (tetrachoric) correlation coefficient. Psychometrika. 1973;38(2):259-68. https://doi.org/10.1007/BF02291118
https://doi.org/10.1007/BF02291118... . The binary indicators of the variables with excellent completeness (> 95%) were not considered in the analysis due to the low variability between the categories, and the “partner’s treatment” variable was disregarded in the CS analysis due to the high percentage of data either missing or ignored. We calculated the PCA scores for each record using the regression method²⁵25. MingotI SA. Análise de dados através de métodos de estatística multivariada. uma abordagem aplicada. Belo Horizonte: UFMG; 2007.. The mean of scores associated with the first two principal components extracted in the analysis was considered for the overall score. For socioeconomic and care scores, only the first principal component was considered. Lastly, we analyse the relationship between scores calculated by the weighted average and PCA methods via scatter plots and estimate Pearson’s linear correlation coefficient. The R software, version 3.6.0, and the psych package were used in the PCA²⁶26. Foundation for Statistical Computing. R: The R project for statistical computing. 2021 [cited 2021 July 11]. Avaliable from: https://www.r-project.org/
https://www.r-project.org/... .

Ethical Aspects

This study used anonymised administrative health data provided by the Ministry of Health, exempting submission to the Ethics and Research Committee.

RESULTS

A total of 305,891 GS and 197,974 CS cases were notified between 2007 and 2018, registering an increase of 9.1 and 5.3 times, respectively, in notification cases in 2018. Most GS notifications were from the Southeast (44.8%) and Northeast (21.3%) regions, followed by the South (14.4%), North (10.8%), and Midwest (8.6%). The CS showed a similar pattern. Considering the area of residence of GS notifications, 88.3% occur in the urban area, 7.7% in rural, 0.7% from the peri-urban area, and 3.2% of the notifications did not fill out this information. Most CS notifications (89.3%) were from urban areas, 6% from rural, and 0.8% from peri-urban areas, and 3.9% of the cases did not include this information. The prevalence of GS cases was concentrated among women who self-declared as mixed-race (48.3%), white (29.3%), black (12.3%), Asian descendant/yellow (0.9%), and indigenous (0.8%), with race/colour information being absent in 8.5% of the notifications. For CS, 48.9% of case notifications was mixed-race, 25.4% white, 5.0% black, 0.4% indigenous, 0.24% yellow, and 20.1% of notifications lacked this information.

Analysis of the completeness of GS records, measured by the binary indicator (Table 1), was classified as excellent (> 95%) for the pregnant woman’s age range, area of residence, and gestational age; good (90%–95%) for the pregnant woman’s race/colour, qualitative results of treponemal test, VDRL test, and treatment regime; poor (50%–80%) for the pregnant woman’s level of education and clinical classification; and very poor (< 50%) for the partner’s treatment information. The CS notification records presented excellent completeness (> 95%) for the mother and child’s age range variable, area of residence, qualitative results of VDRL test, and clinical evolution; good (90%–95%) for child’s sex, prenatal care, and the time of diagnosis; regular (80%-90%) for the mother’s race/colour, treponemal test and treatment regime; and poor (50%–80%) for the mother’s level of education, child’s race/colour, and partner’s treatment.

Moreover, overall, and socioeconomic completeness scores for GS (89.93% and 88.7%) and CS (89.69% and 88.71%) were classified as regular (Table 1), whereas the care score was good (GS – 90.88% and CS – 90.72%) over the years.

Between 2007 and 2015 in Brazil (Figure 1), the overall completeness score was evaluated as regular for GS (87.7% in 2007 to 89.9% in 2009) and CS (85.5% in 2007 to 89.9% in 2014) and good from 2016 onwards. For both diseases, the socioeconomic score was also classified as regular over the years, with a growing tendency to improve completeness between 2011 and 2017 for GS (87.5% and 89.8%), and between 2007 and 2017 for CS (85.5% and 89.4%). The care score was classified as regular for GS between 2007 and 2012 and good in the following years, whereas for CS, it remained regular until 2015, with a gradual increase in the completeness scores in the subsequent years. We highlighted that, from 2008, the care score was higher than the socioeconomic score for both diseases. The North and South Brazilian regions presented, over time, improvement in completeness scores for GS and CS, especially for socioeconomic scores (Figure 1). This improvement occurred in the Midwest and Southeast regions for GS, whereas for CS, it was more evident in the Southeast and Northeast regions.

Note the regional differences of the gestational and congenital completeness scores (Figure 2): the overall and socioeconomic scores were classified as good in the North (GS – 92.2% and CS – 92.6% and GS – 93.1% and CS – 93.7%, respectively) and South regions (GS – 91% and GS – 90.5% and CS – 92% and CS – 91.2%, respectively), and regular in the other regions; the care score for GS was classified as good in all regions (North – 91.4%; Midwest – 90.5%; Southeast – 91.3%; and South – 91.5%), except for the Northeast region (89.4%), where it was regular; for CS, the care score was classified as good for the North (91.9%), Southeast (90.8%), and South regions (92.5%) and regular for the Northeast (89.7%) and Midwest (89.1%) regions.

Gestational and congenital syphilis cases presented information for the area of residence in 96.8% and 96.1% of notification records, respectively (Figure 3). The overall and care scores classifications were good in the urban (GS – 90.4% and 91.1%; CS – 90.1% and 91%), rural (GS – 91.3% and 90.8%; CS – 91.5% and 90.8%) and peri-urban area of residence (GS – 90.6% and 90.5%; CS – 90.5% and 91.1%). However, the socioeconomic score presented a good quality for GS in rural (92.0%) and peri-urban areas of residence (90.8%) but regular in the urban area (89.5%). For CS, the socioeconomic score was good for the rural area (99.2%) and regular for the other areas of residence (urban – 88.9% and peri-urban – 89.7%). However, when information about the area of residence was ignored (GS – 3.2% and CS – 3.9%), the classification of completeness scores worsened (overall and care scores were poor, whereas the socioeconomic score was regular).

Considering 91.5% and 79.85% of the GS and CS cases (Figure 4), respectively, had race/colour information, we observed that the overall, socioeconomic, and care completeness scores for GS were classified as good for all the racial categories (black, mixed-race, indigenous, yellow, and white). For CS, the overall and socioeconomic scores presented good completeness for all the racial categories. In cases where race/colour information was ignored (GS – 8.5% and CS – 20.15%), all the completeness scores were classified as poor, except the socioeconomic score of GS records, which was regular.

Validation of the overall, socioeconomic and care scores were achieved by comparing them using the weighted average and PCA methods, and the result presented a strong linear correlation (> 0.90) in the scatter plots (Figure 5). In the case of PCA, the explanation percentage for the principal components retained in the analysis varied between 47.15% and 63.30% for the six different scores calculated. The result obtained by both methods was similar.

DISCUSSION

The results indicate a good or excellent degree of completeness for most of the SINAN-Syphilis variables included in gestational and congenital syphilis notification records, except for clinical classification, pregnant mother’s level of education, partner’s treatment, and child’s race/colour, which were classified as poor or very poor. The overall and socioeconomic completeness scores were similar for GS and CS records, both classified as regular, whereas the care score was classified as good and improved during the period studied. However, differences in scores were verified according to region, area of residence, and ethnic-racial groups. These differences were also observed in studies that evaluated the completeness of information on GS and CS notification cases in Latin American and Caribbean countries²⁷27. Serruya SJ, Duran P, Martinez G, Romero M, Caffe S, Alonso M, et al. Maternal and congenital syphilis in selected Latin America and Caribbean countries: a multi-country analysis using data from the Perinatal Information System. Sex Health. 2015 Apr;12(2):164-9. https://doi.org/10.1071/SH14191
https://doi.org/10.1071/SH14191... . This situation emphasised the need to improve the capacity of countries to collect high-quality data for diseases of public health interest⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,²⁷27. Serruya SJ, Duran P, Martinez G, Romero M, Caffe S, Alonso M, et al. Maternal and congenital syphilis in selected Latin America and Caribbean countries: a multi-country analysis using data from the Perinatal Information System. Sex Health. 2015 Apr;12(2):164-9. https://doi.org/10.1071/SH14191
https://doi.org/10.1071/SH14191... .

The GS and CS notifications have increased more than 9 and 5 times, respectively, in recent years, possibly due to the expansion of primary health care coverage, in particular the Family Health Strategy, and the Bolsa Familia Program, which conditions receiving the benefit to the attendance of pregnant women to prenatal care and children to medical appointments to monitor growth and development¹⁴14. Saraceni V, Miranda AE. [Coverage by the Family Health Strategy and diagnosis of syphilis in pregnancy and congenital syphilis]. Cad Saude Publica. 2012 Mar;28(3):490-6. Portuguese. https://doi.org/10.1590/S0102-311X2012000300009
https://doi.org/10.1590/S0102-311X201200... ,²⁸28. Baroni L, Alves RF, Boccolini CS, Salles R, Gritz R, Paixão B, et al. Database on the coverage of the “Bolsa-Família” conditioning cash-transfer program: Brazil, 2005 to 2021. BMC Res Notes. 2021 Nov;14(1):435. https://doi.org/10.1186/s13104-021-05849-5
https://doi.org/10.1186/s13104-021-05849... . Improving case detection has not been followed by increasing the completeness of information, with significant regional differences across Brazilian regions, which corroborate previous results described in the literature for other infectious diseases¹²12. Soares MA, Aquino R. Completeness and characterization of gestational syphilis and congenital syphilis records in Bahia, Brazil, 2007-2017. Epidemiol Serviços Saúde. 2021;30(4):e20201148,21. https://doi.org/10.1590/S1679-49742021000400018
https://doi.org/10.1590/S1679-4974202100... ,¹⁴14. Saraceni V, Miranda AE. [Coverage by the Family Health Strategy and diagnosis of syphilis in pregnancy and congenital syphilis]. Cad Saude Publica. 2012 Mar;28(3):490-6. Portuguese. https://doi.org/10.1590/S0102-311X2012000300009
https://doi.org/10.1590/S0102-311X201200... ,¹⁸18. Conceição HN, Câmara JT, Pereira BM. [Epidemiological and spatial analysis of cases of gestational and congenital syphilis]. Saúde Debate. 2020;43(123):1145-58. Portuguese. https://doi.org/10.1590/0103-1104201912313
https://doi.org/10.1590/0103-11042019123... . Problems with information completeness of GS and CS records may be related to the differences in the commitment level of health professionals regarding the adequate registration of case notification records, the reduced number of health professionals in health services to complete a significant number of records, and the non-prioritisation of syphilis by health managers⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,¹²12. Soares MA, Aquino R. Completeness and characterization of gestational syphilis and congenital syphilis records in Bahia, Brazil, 2007-2017. Epidemiol Serviços Saúde. 2021;30(4):e20201148,21. https://doi.org/10.1590/S1679-49742021000400018
https://doi.org/10.1590/S1679-4974202100... . Considering that, often, notification is seen as a bureaucratic activity of secondary importance, training health professionals on the need to generate quality information for epidemiological surveillance is essential to ensure the integrated flow of information between the responsible sectors, which can reduce differences at the area of residence and regional level in the quality of the information available in syphilis notification records⁵5. Correia LO, Padilha BM, Vasconcelos SM. Methods for assessing the completeness of data in health information systems in Brazil: a systematic review. Cien Saude Colet. 2014 Nov;19(11):4467-78. Portuguese. https://doi.org/10.1590/1413-812320141911.02822013
https://doi.org/10.1590/1413-81232014191... ,⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,²⁹29. Muguande OF, Ferraz ML, França E, Gontijo ED. Evaluation of the quality system of epidemiological surveillance of acute Chagas disease in Minas Gerais, 2005-2008. Epidemiol Serv Saude. 2011;20(3):317-25. Portuguese. https://doi.org/10.5123/S1679-49742011000300006
https://doi.org/10.5123/S1679-4974201100... .

The care score completeness for CS was classified as regular for the indigenous group and good for the other racial categories, indicating possible difficulties in the monitoring of indigenous children and, consequently, in the adequate case notification, in addition to the absence or insufficiency in the training of indigenous health teams³⁰30. Tiago ZD, Picoli RP, Graeff SV, Cunha RV, Arantes R, Tiago ZS, et al. Underreporting of gestational, congenital and acquired syphilis among indigenous peoples in Mato Grosso do Sul State, Brazil, 2011-2014. Epidemiol Serv Saude. 2017;26(3):503-12. https://doi.org/10.5123/S1679-49742017000300008
https://doi.org/10.5123/S1679-4974201700... . Many factors may contribute to information incompleteness, such as the availability of time to complete the INR fields, considering the demands of the service, the existence of linguistic and cultural barriers, and difficulty in entering data onto SINAN by the base-centres and/or Special Indigenous Sanitary Districts, since, besides not being notifying units, they do not interact with those in the municipal health system¹³13. Braz RM, Oliveira PT, Reis AT, Machado NM. [Evaluation of the race/color variable completeness in the national health information systems for the measuring of ethnic-racial inequality in indicators used by the Performance Index of the Brazilian Unified Health System]. Saúde Debate. 2013;37(99):554-62. Portuguese. https://doi.org/10.1590/S0103-11042013000400002
https://doi.org/10.1590/S0103-1104201300... ,³⁰30. Tiago ZD, Picoli RP, Graeff SV, Cunha RV, Arantes R, Tiago ZS, et al. Underreporting of gestational, congenital and acquired syphilis among indigenous peoples in Mato Grosso do Sul State, Brazil, 2011-2014. Epidemiol Serv Saude. 2017;26(3):503-12. https://doi.org/10.5123/S1679-49742017000300008
https://doi.org/10.5123/S1679-4974201700... .

Note that the “partner’s treatment” variable had a poor and very poor degree of completeness for GS and CS, respectively. We supposed that this occurs due to the Brazilian Ministry of Health modifying the definition of CS cases by including the criterion “adequate treatment of the pregnant woman” and disregarding the information on the simultaneous “partner’s treatment” since September of 2017. Therefore, this variable has become a complementary and non-mandatory filling field in INR³¹31. Ministério da Saúde (BR). Departamento de Doenças de Condições Crônicas e Infecções Sexualmente Transmissíveis. Nota Informativa no 02-SEI/2017 - DCCI/SVS/MS |. 2017. http://www.aids.gov.br/pt-br/legislacao/nota-informativa-no-02-sei2017-diahvsvsms (accessed Oct 18, 2021).
http://www.aids.gov.br/pt-br/legislacao/... . Insufficient completeness of the field “concomitant treatment of the partner,” influenced by the non-mandatory registration of the information, harms the monitoring of syphilis cases, mainly CS, which reduces the possibility to assess the real transmission scenario of syphilis and the quality of prenatal care¹²12. Soares MA, Aquino R. Completeness and characterization of gestational syphilis and congenital syphilis records in Bahia, Brazil, 2007-2017. Epidemiol Serviços Saúde. 2021;30(4):e20201148,21. https://doi.org/10.1590/S1679-49742021000400018
https://doi.org/10.1590/S1679-4974202100... ,³²32. World Health Organization. The global elimination of congenital syphilis: rationale and strategy for action. Geneva: World Health Organization; 2007.,³³33. Ministério da Saúde (BR). Manual de normas e rotinas do SINAN. Brasília, DF: 2007.. Studies indicate that the incompleteness of SINAN information, particularly for CS, and the high underreporting of cases limit the use of this system in studies of incidence and factors related to the growth of syphilis in Brazil⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,¹⁹19. Benzaken AS, Pereira GF, Cunha AR, Souza FM, Saraceni V. Adequacy of prenatal care, diagnosis and treatment of syphilis in pregnancy: a study with open data from Brazilian state capitals. Cad Saude Publica. 2019 Dec;36(1):e00057219-00057219. https://doi.org/10.1590/0102-311x00057219
https://doi.org/10.1590/0102-311x0005721... ,³⁴34. Heringer R. Racial inequalities in Brazil: a synthesis of social indicators and challenges for public policies. Cad Saude Publica. 2002;18 suppl:S57-65. Portuguese. https://doi.org/10.1590/S0102-311X2002000700007
https://doi.org/10.1590/S0102-311X200200... .

Moreover, many variables present in INR are considered important markers for the monitoring and epidemiological evolution of GS and CS in the country (i.e., partner’s treatment for CS) and support the adoption of therapeutic conduct of the disease (i.e., clinical classification and time of diagnosis of the disease). Other fields, such as the mother’s level of education and race/colour of the mother or child, are used as markers of social and racial inequalities related to infection and/or associated negative outcomes⁴4. Saraceni V, Domingues RM, Vellozo V, Lauria LM, Dias MAB, Ratto KMN, et al. [Surveillance of syphilis in pregnancy/. Epidemiol Serv Saude. 2007 Jun;16(2):103-11. Portuguese. https://doi.org/10.5123/S1679-49742007000200005
https://doi.org/10.5123/S1679-4974200700... ,⁷7. Saraceni V, Pereira GF, Silveira MF, Araujo MA, Miranda AE. [Epidemiological surveillance of vertical transmission of syphilis: data from six federal units in Brazil]. Rev Panam Salud Publica. 2017;41:e44. Portuguese.,¹⁹19. Benzaken AS, Pereira GF, Cunha AR, Souza FM, Saraceni V. Adequacy of prenatal care, diagnosis and treatment of syphilis in pregnancy: a study with open data from Brazilian state capitals. Cad Saude Publica. 2019 Dec;36(1):e00057219-00057219. https://doi.org/10.1590/0102-311x00057219
https://doi.org/10.1590/0102-311x0005721... , which highlighted the importance to improve quality data in SINAN-Syphilis. Also, we should highlight that the incompleteness of information related to education level had been observed in several HIS throughout the national territory, limiting its use in research³⁵35. Lima DJ, Chagas AC, Mendes IC, Oriá MO, Aquino P S, Pinheiro AK. Completeness and consistency of data on notified HIV-positive pregnant women. Rev Enferm UERJ. 2014;22(3):321-6..

Data incompleteness directly reflects on the quality of information by not demonstrating the reality of the epidemiological profile of syphilis cases notified in the country³⁶36. Komka MR, Lago EG. [Congenital syphylis: notification and reality]. Sci Med. 2007;17(4) :205-11. Portuguese.. This scenario complicates the planning of strategies and actions to prevent and control syphilis, contributes to the inefficiency of public policies to tackle the disease, and interferes in achieving the goals of eliminating and eradicating syphilis cases proposed by the WHO⁹9. World Health Organization. Report on global sexually transmitted infection surveillance 2018. Geneva: World Health Organization;,¹⁴14. Saraceni V, Miranda AE. [Coverage by the Family Health Strategy and diagnosis of syphilis in pregnancy and congenital syphilis]. Cad Saude Publica. 2012 Mar;28(3):490-6. Portuguese. https://doi.org/10.1590/S0102-311X2012000300009
https://doi.org/10.1590/S0102-311X201200... ,³⁶36. Komka MR, Lago EG. [Congenital syphylis: notification and reality]. Sci Med. 2007;17(4) :205-11. Portuguese.. This situation becomes more complex when we consider regional, residential, and ethnic-racial variations in the information completeness scores in a country of continental dimensions, such as Brazil. Therefore, we suggest that future studies analyse the factors associated with the incompleteness of data and its variations among different groups and regions, which will allow the adoption of strategies to reduce differentials in the quality of SINAN-Syphilis information.

Our results indicate an improvement in the degree of completeness of SINAN-Syphilis information during the study period, despite the observed variations. We present a proposal to evaluate the quality of SINAN-Syphilis information, which is still little explored in the national scenario, building scores based on the weighted average of completeness indicators that are easily operationalised. There are some limitations related to defining weights for the weighted average method, based on the experience of specialists and not by the correlation structure from the data obtained by the PCA. However, weighting is commonly used to compile health indicators and, in our case, produced results consistent with those obtained via PCA. This study only accessed the completeness of information, one of the parameters used to evaluate the quality of the information, not considering cases of underreporting or agreement of information, which are also important parameters to be considered when we evaluate the quality of HIS³3. Lima CR, Schramm JM, Coeli CM, Silva ME. [Review of data quality dimensions and applied methods in the evaluation of health information systems]. Cad Saude Publica. 2009 Oct;25(10):2095-109. Portuguese. https://doi.org/10.1590/S0102-311X2009001000002
https://doi.org/10.1590/S0102-311X200900... .

CONCLUSION

The completeness of GS and CS notifications has improved in recent years, mainly with the care score variables, compared with the socioeconomic variables, despite differences between Brazilian regions, ethnic-racial groups, and area of residence for both diseases. However, essential information to describe the epidemiological profile and monitor GS and CS still have poor completeness, compromising the planning of epidemiological surveillance and health care actions. We recommended promoting health teams’ training and health managers adopting strategies aiming at improving the complete filling of INR, given the prioritisation of other demands in health services. Lastly, health professionals and managers can incorporate indicators of easy compilation and interpretability for monitoring the completeness of SINAN-syphilis data, as proposed in this study, into the routine of evaluating the quality of information aiming at its improvement.

REFERENCES

Publication Dates

History