Validation of the internal structure of the Brazilian Dental Vulnerability Scale

Daniele Boina de Oliveira Flávio Rebustini Danielle da Costa Palacio Marcio Cardozo Paresque Ilana Eshriqui Oliveira Wander Barbieri Danielle Viana Ribeiro Debora Heller Daiana Bomfim Tamara Kerber Tedesco About the authors

ABSTRACT

OBJECTIVE

This study aimed to evaluate evidence of validity of internal structure of the Brazilian Dental Vulnerability Scale (EVO-BR) when applied in Brazil.

METHODS

This is a psychometric study that seeks to validate a scale elaborated by evidence of internal structure. Data collection was conducted in 18 basic health units that implement the Brazilian Healthcare Planning (PAS) methodology, across the five regions of Brazil. The initial version of the EVO-BR contained 41 items that measured dental vulnerability and was applied to users of the Brazilian Unified Health System (SUS) aged 18 years or older who were in basic health units for consultation with higher education professionals. To evaluate the evidence, the following statistical analyses were performed: exploratory factor analysis, confirmatory factor analysis, and network analysis.

RESULTS

A total of 1,753 users participated in the study. To adjust the sample, we considered the factorability obtained from Kaiser-Meyer-Olkin (KMO) test = 0.65, Bartlett sphericity test = 8019.7, and a matrix determinant of 0.008. The initial parallel analysis indicated a four-dimensional model and had the items adjusted according to factor loading (ranging from 0.38 to 0.99), common factors (0.13 to 0.89), and Pratt’s measure, until the model presented congruence in the statistical and interpretative principles simultaneously. The final model contained 15 items, maintaining the four dimensions indicated by the parallel analysis, and held an explained variance of 68.56%.

CONCLUSIONS

The EVO-BR is a validated scale to measure dental vulnerability and, thus, can contribute to the organization of access to the oral health team in primary health care (PHC) by stratifying the population, as recommended in the Brazilian Healthcare Planning.

Oral Health; Primary Health Care; Population Health Management

INTRODUCTION

The challenge of ensuring access to oral health in a universal and equitable manner remains in the Brazilian Unified Health System (SUS). In this context, authors have been discussing formats to organize supply and demand by population-based management. Strategies such as the Brazilian Healthcare Planning (PAS) aim to overcome historical fragmentation and the supply base management model11. Mendes EV. As redes de atenção à saúde. 2a ed. Brasília, DF: Organização Pan-Americana da Saúde; 2011..

The PAS acts in the micro and macro processes of primary health care (PHC) and is based on the knowledge of the subpopulations that compose the territory, so that care can be organized considering their needs. This requires tools that can support professionals in these processes.

Vulnerability is the result of multidimensional and relational conditions, and is determined by a set of individual, social, and programmatic factors. In oral health, dental vulnerability has recently been defined as “a set of factors of the social, structural, and general, mental, oral health dimensions, in addition to health services and public management that influence the dynamics of the health-disease process in dentistry.”22. Palacio DD, Rebustini F, Oliveira DB, Peres Neto J, Sanches TP, Mafra AC, et al. The concept of dental vulnerability in Brazil. Res Soc Dev. 2021;10(9):e30310917792. https://doi.org/10.33448/rsd-v10i9.17792
https://doi.org/10.33448/rsd-v10i9.17792...
In light of this multifactorial context and the knowledge gap in oral healthcare, an instrument that allows the identification of dental vulnerability in a systematic and standardized manner across Brazil is essential to support the planning of oral health actions in a timely and equitable manner.

In this sense, the Dental Vulnerability Scale (EVO) was developed and demonstrated evidence of validity in a study conducted in the city of São Paulo, lacking validity in a national context. Considering the diversity and extension of the Brazilian territory, it is necessary to investigate the evidence of validity of EVO at the national level. Thus, this study aims to investigate the evidence of efficacy of the internal structure of the Brazilian Dental Vulnerability Scale (EVO-BR) in PHC, in different Brazilian contexts. EVO-BR is believed to support the planning of oral health policies that expand access to healthcare services based on the measurement of dental vulnerability, reducing access inequality in Brazil.

METHODS

This study aims to provide additional evidence on the internal structure of the EVO-BR by analyzing it using exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and network analysis (NA), following current recommendations from the American Educational Research Association, the American Psychological Association, and the US National Council on Measurement in Education. The study was approved by the Research Ethics Committee of the Hospital Israelita Albert Einstein (CAAE No. 12395919.0.0000.0071).

Study Location

The sample was composed of users of basic health units (BHUs) located in the five Brazilian geographic regions. BHUs were selected according to the following criteria: located in municipalities that implement the PAS methodology, considering that at least one BHU was selected from each of the five Brazilian geographic regions; located in the most populous municipalities; and with easy access to data collectors.

Based on these criteria, EVO-BR was applied in the municipalities of: Uberlândia-MG (two BHUs) and São Paulo-SP (11 BHUs), covering the Southeast; Irati and Teixeira Soares-PR (two BHUs), covering the South; Belo Jardim-PE (one BHU), covering the Northeast; Rondonópolis-MT (two BHUs), covering the Midwest; and, finally, Boa Vista-RR (one BHU), covering the North. Data collection was conducted in two stages, the first from September to November 2019 (SP) and the second from May to August 2022 (MG, MT, RR, PE, PR).

The first stage of collection was performed by dentists33. Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
https://doi.org/10.1186/s12903-021-01742...
and the second by trained data collectors, during a two-week visit to the municipalities outside São Paulo.

Sample

Inclusion criteria were users of the service; aged 18 years or older; and attending a BHU during the data collection period. Users with lack of information about the EVO items (i.e., those who agreed to participate and answered the characterization instrument but had data collection interrupted before answering the items predicted in the scale) were excluded.

Participants were approached during care at the dental clinic or in the waiting room of the BHU and invited to participate in the research. After signing the informed consent form, the clinical and sociodemographic characterization structured questionnaire and the EVO-BR items were applied (Table 1)33. Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
https://doi.org/10.1186/s12903-021-01742...
. Research Electronic Data Capture (RedCap) software program was used for data collection and storage.

Table 1
Validation of the Dental Vulnerability Scale.

Statistical analysis

Exploratory factor analysis (EFA): the verification of data is fundamental, and they are susceptible to factor analysis via the measure of sampling adequacy. For this stage, Bartlett sphericity, matrix determinant, and KMO were measured. In addition to assessing the database, an individual analysis of items was conducted, as recommended, so that their unsuitability for factoring could affect the solution of the model. The missing values were treated using the multiple imputation technique33. Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
https://doi.org/10.1186/s12903-021-01742...
.

Dimensionality was tested by the optimal implementation of parallel analysis (PA) with minimum rank factor analysis, which minimizes the common variance of residuals. PA has been implemented using polychoric matrix and random permutation of 500 matrices. This strategy has been considered one of the most robust and accurate techniques for dimensionality testing44. Cho SJ, Li F, Bandalos D. Accuracy of the parallel analysis procedure with polychoric correlations. Educ Psychol Meas. 2009;69(5):748-59. https://doi.org/10.1177/0013164409332229
https://doi.org/10.1177/0013164409332229...
,55. Dobriban E, Owen AB. Deterministic parallel analysis: an improved method for selecting factors and principal components. J R Stat Soc Series B Stat Methodol. 2019;81(1):163-83. https://doi.org/10.1111/rssb.12301
https://doi.org/10.1111/rssb.12301...
. The factor extraction was performed by the unweighted least squares (ULS) technique, which reduces the matrix residues. If the instrument showed multidimensionality, the Promin oblique rotation was used66. Urbano L-S. Promin: a method for oblique factor rotation. Multivariate Behav Res. 1999;34(3):347-65. https://doi.org/10.1207/S15327906MBR3403_3
https://doi.org/10.1207/S15327906MBR3403...
. The following indicators were adopted to evaluate unidimensionality: unidimensional congruence (UNICO) > 0.95, explained common variance (ECV) > 0.80, and mean of item residual absolute loadings (MIREAL) < 0.3077. Quinn HC. Bifactor models, Explained Common Variance (ECV), and the usefulness of scores from unidimensional item response theory analyses [thesis]. Chapell Hill: University of North Carolina; 2019..

Instrument quality parameters: the explained variance of the instrument should be around 60%88. HAIR JR JF. et al. Multivariate data analysis. In: Multivariate data analysis. 2010; 785.. Initial factor loadings of 0.30 are recommended when the sample comprises 300 individuals at least. The permanence or removal of the item in the model will depend on the magnitude of the factor loadings, common factors, absence of double saturation, Heywood cases, and interpretability of factors. To increase the accuracy of decision-making regarding the permanence or removal of items, the unique directional correlation coefficient (ETA) by Pratt’s measure was used99. Wu AD, Zumbo BD, Marshall SK. A method to aid in the interpretation of EFA results: an application of Pratt's measures. Int J Behav Dev. 2014;38(1):98-110. https://doi.org/10.1177/0165025413506143
https://doi.org/10.1177/0165025413506143...
.

Confirmatory factor analysis (CFA): for the primary CFA data, the factor loadings and predictive power of the item (R2) were used. The model’s fit indices were: χ2/df; Non-Normed Fit Index (NNFI) > 0.95; Comparative Fit Index (CFI) > 0.95; Goodness Fit Index (GFI) > 0.95; Root Mean Square Error of Approximation (RMSEA) < 0.08; and Root Mean Square of Residuals (RMSR) < 0.8. The model tested in CFA was the factorial solution found in the initial EFA study22. Palacio DD, Rebustini F, Oliveira DB, Peres Neto J, Sanches TP, Mafra AC, et al. The concept of dental vulnerability in Brazil. Res Soc Dev. 2021;10(9):e30310917792. https://doi.org/10.33448/rsd-v10i9.17792
https://doi.org/10.33448/rsd-v10i9.17792...
.

Reliability was measured by four indicators: Cronbach’s alpha1010. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF02310555
https://doi.org/10.1007/BF02310555...
, Greatest Lower Bound1111. Woodhouse B, Jackson PH. Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: a search procedure to locate the greatest lower bound. Psychometrika. 1977;42(4):579-91. https://doi.org/10.1007/BF02295980
https://doi.org/10.1007/BF02295980...
, Omega1212. McDonald RP. Test theory: a unified treatment. New York: Psychology Press; 2013.— these three by Bayesian estimation — and Overall Reliability of Fully-Informative Prior Oblique N-EAP scores (ORION)1313. Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicologica (Valencia). 2016 Jan;37(2):235-47..

Network analysis: over the last decade, network analysis has been extended to various scenarios, such as symptom assessment1414. Mullarkey MC, Marchetti I, Beevers CG. Using network analysis to identify central symptoms of adolescent depression. J Clin Child Adolesc Psychol. 2019 Jul-Aug;48(4):656-68. https://doi.org/10.1080/15374416.2018.1437735.
https://doi.org/10.1080/15374416.2018.14...
, psychological networks and psychopathologies, post-traumatic stress1515. Liang Y, Li F, Zhou Y, Liu Z. Evolution of the network pattern of posttraumatic stress symptoms among children and adolescents exposed to a disaster. J Anxiety Disord. 2021 Jan;77:102330. https://doi.org/10.1016/j.janxdis.2020.102330
https://doi.org/10.1016/j.janxdis.2020.1...
, anxiety1616. Haws JK, Brockdorf AN, Gratz KL, Messman TL, Tull MT, DiLillo D. Examining the associations between PTSD symptoms and aspects of emotion dysregulation through network analysis. J Anxiety Disord. 2022 Mar;86:102536. https://doi.org/10.1016/j.janxdis.2022.102536
https://doi.org/10.1016/j.janxdis.2022.1...
, the development of measurement instruments1717. Borsboom D. Possible futures for network psychometrics. Psychometrika. 2022 Mar;87(1):253-65. https://doi.org/10.1007/s11336-022-09851-z
https://doi.org/10.1007/s11336-022-09851...
, and dentistry1818. Yeung AW, Leung WK. Citation network analysis of dental implant literature from 2007 to 2016. Int J Oral Maxillofac Implants. 2018;33(6):1240-6. https://doi.org/10.11607/jomi.6727
https://doi.org/10.11607/jomi.6727...
.

It is important to understand how network analysis can be useful in the search for evidence of validity. According to Newman1919. Newman M. Networks: an introduction. Oxford: Oxford University Press; 2010. https://doi.org/10.1093/acprof:oso/9780199206650.001.0001
https://doi.org/10.1093/acprof:oso/97801...
, the analysis consists of two stages: in the first, a statistical model of the data is estimated, from which some parameters can be represented as a weighted network between the observed variables, and in the second stage, the structure of the weighted network is analyzed using measures derived from graph theory.

This study used the High-dimensional Undirected Graph Estimation (HUGE)2020. Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L. The huge package for high-dimensional undirected graph estimation in R. J Mach Learn Res. 2012 Apr;13(1):1059-62. PMID:26834510 technique as estimator and the Extended Bayesian Information Criterion (EBIC) as criterion. Huge works with two estimation procedures: 1) neighborhood search algorithm; and 2) Lasso graph algorithm2121. Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul;9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045
https://doi.org/10.1093/biostatistics/kx...
. The graph nodes were positioned using the Fruchterman-Reingold algorithm2222. Fruchterman T, Reingold E. Graph drawing by force-directed placement. Software: Practice and Experience.1991;21(1):1129-64. https://doi.org/10.1002/spe.4380211102
https://doi.org/10.1002/spe.4380211102...
, which is based on the strength and connectivity between nodes, each one representing an item of the instrument.

Four indicators were used to evaluate the model: betweenness, which assesses the efficiency with which a node connects to others; closeness, which assesses how easily information reaches other nodes from a specific node; strength or degree, which represents how connected a node is to the rest of the network; and finally, expected influence, which aims to assess the nature and strength of a node’s cumulative influence within the network2323. Fonseca-Pedrero E, Ortuño J, Debbané M, Chan RC, Cicero D, Zhang LC, et al. The network structure of schizotypal personality traits. Schizophr Bull. 2018 Oct;44 suppl_2:S468-79. https://doi.org/10.1093/schbul/sby044
https://doi.org/10.1093/schbul/sby044...
and thus the role it can be expected to play in its activation, persistence, and remission2424. Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016 Aug;125(6):747-57. https://doi.org/10.1037/abn0000181
https://doi.org/10.1037/abn0000181...
.

The literature has recommended adopting multiple tests and techniques to adjust an instrument, meeting contemporary recommendations for evidence of validity. This combination aims to improve the accuracy and quality of the instruments2525. Hu Z, Lin L, Wang Y, Li J. The integration of classical testing theory and item response theory. Psychology. 2021 Sep;12(9):1397-409. https://doi.org/10.4236/psych.2021.129088
https://doi.org/10.4236/psych.2021.12908...
,2626. Schlechter P, Wilkinson PO, Knausenberger J, Wanninger K, Kamp S, Morina N, et al. Depressive and anxiety symptoms in refugees: insights from classical test theory, item response theory and network analysis. Clin Psychol Psychother. 2021 Jan;28(1):169-81. https://doi.org/10.1002/cpp.2499
https://doi.org/10.1002/cpp.2499...
and can help determine which model is best when there is more than one possible solution2727. Alvarenga WA, Nascimento LC, Rebustini F, Santos CB, Muehlan H, Schmidt S, et al. Evidence of validity of internal structure of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp-12) in Brazilian adolescents with chronic health conditions. Front Psychol. 2022 Sep;13:991771. https://doi.org/10.3389/fpsyg.2022.991771
https://doi.org/10.3389/fpsyg.2022.99177...
. For both techniques, a bootstrap of 5000 was applied. The analyses were performed as Factor 12.02 and JASP 16.04.

RESULTS

The study population comprised 1,753 participants. Most respondents were male (52.01%), with a mean age of 39 years (14.37%). Regarding ethnicity/skin color, the distribution was similar between White (30.20%) and Black and Mixed-race (32.69%), with a predominance of Black individuals (34.44%). Most people (81.42%) reported that the ratio of residents/rooms in the household was equal to or less than one.

The analyses were performed with the initial 41 items of the EVO-BR (Table 1). The measure of sample adequacy indicated the possibility of factorability with KMO = 0.65; Bartlett sphericity = 8019.7 (df = 820; p < 0.0001); and matrix determinant of 0.008.

The initial PA indicated a four-dimensional model, but with several items with inadequate levels of factor loading, common factors, and Pratt’s measure. This led to the successive removal of items to adjust the statistical and interpretative principles of the model until they became congruent. The final model contained 15 items, maintaining the four dimensions indicated by the parallel analysis, and held an explained variance of 68.56%. The closeness of dimensionality values indicated a multidimensional model: UNICO = 0.79; ECV = 0.63; and MIREAL = 0.21. Table 2 presents the final model with factor loadings, common factors, and Pratt’s measure. The factor loadings of the instrument ranged from 0.38 to 0.99, common factors from 0.13 to 0.89, and the ETA of the Pratt’s measure from 0.36 to 0.94

Table 2
Factor loadings, common factors, and Pratt’s measure.

The first dimension was called “General Health” and consisted of Items 1 to 3; the second dimension was called “Oral Health” with Items 4 to 7; the third dimension was called “Infrastructure” with Items 8 to 11; and the last dimension was called “Health Services” with Items 12 to 15. The model was identical to the initial model33. Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
https://doi.org/10.1186/s12903-021-01742...
.

The reliability indices with Bayesian estimation showed Cronbach’s alpha = 0.81 (95%CI 0.79-0.82), McDonald’s omega = 0.78 (95%CI 0.76-0.81), and GLB = 0.93 (95%CI 0.92-0.93). The ORION was, respectively, for each dimension, 0.95, 0.84, 0.92, and 0.98. All indicators are at appropriate levels.

The model obtained in the EFA was replicated in the CFA, with factor loadings ranging from 0.20 to 0.96 and the predictive capacity of the item (R2) from 0.09 to 0.92 (Figure 1). “General Health” had factor loadings ranging from 0.48 to 0.78; “Oral Health” from 0.28 to 0.54; “Infrastructure” from 0.34 to 0.96; and “Health Services” from 0.20 to 0.76. In addition to the primary indicators, the quality indices of the model were established as: X2(51) = 2.96, p < 0.001; NNFI = 0.98; CFI = 0.99; GFI = 0.98; RMSEA = 0.03; and RMSR = 0.04. The indicators were established at satisfactory and consistent levels.

Figure 1
Path diagram.

Network analysis was applied to the previously established model (Figure 2). Figure 3 shows that the items were appropriately associated with their correlated pairs, respecting the established domains. This indicates, again, the sustainability and stability of the proposed model.

Figure 2
Network analysis of EVO-BR.

Figure 3
Centrality indices of the standardized items (z).

For the standardized centrality indicators, the items (Figure 3) that showed the most relevant results were: for betweenness, Items 3 “Do you have any illnesses that need follow-up?” and 8 “Do you have a bathroom in your house?”. For closeness the most relevant results were present in items that allow the flow of information in a shorter space, specifically in Items 3 “Do you have any illness that needs follow-up?”, 4 “Do you consider it important to take care of your mouth?”, 6 “Do you consider yourself responsible for the health of your mouth?”, 7 “Do you consider it important to have all your teeth in your mouth?”, and 8 “Do you have a bathroom in your home?”. For the strength/degree index and expected influence, Item 7 “Do you consider it important to have all your teeth in your mouth?” showed the best result, indicating the highest connection strength and the greatest cumulative influence for the model’s configuration.

DISCUSSION

This study demonstrated, by using the initial model in the EFA with a multicenter sample and the replication of this model in the CFA and network analysis, that the EVO-BR is consistent, robust, and reliable in Brazil. In addition to suitable psychometric properties, the final version of the scale is a practical, concise, and easily applicable instrument since it comprises only 15 items, all with yes or no response options. Thus, the EVO-BR minimizes the subjectivity of responses and allows an accurate measurement of dental vulnerability by various primary healthcare professionals, including community health agents, not limited to dental professionals.

Despite this study being conducted with a convenience sample, not statistically representative of the Brazilian population, a notable strength is its inclusion of users from all five geographic regions of Brazil, thus encompassing the country’s territorial, cultural, and social diversity.

Corroborating the study conducted in São Paulo33. Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
https://doi.org/10.1186/s12903-021-01742...
, EVO-BR maintains the dimensions of general health, oral health, infrastructure, and health services to allow measurement of dental vulnerability. The general and oral health exhibit a strong correlation in the context of the health-disease process and impact the patient’s quality of life, becoming inseparable2828. Palma PV, Leite IC, Greco RM. Associação entre a qualidade de vida relacionada à saúde bucal e a capacidade para o trabalho de técnicos administrativos em educação: um estudo transversal. Cad Saude Colet. 2019;27(1):100-7. https://doi.org/10.1590/1414-462x201900010089
https://doi.org/10.1590/1414-462x2019000...
. This fact can be explained by the association of oral problems with nutritional imbalances, interference in sleep quality, speech, worsening of psychosocial conditions, among others.

According to Gonçalves et al.2929. Gonçalves AJ, Pereira PH, Monteiro V, Silva MF Junior, Baldani MH. Estrutura dos serviços de saúde bucal ofertados na Atenção Básica no Brasil: diferenças regionais. Saúde Debate. 2020;44(126):725-38. https://doi.org/10.1590/0103-1104202012610
https://doi.org/10.1590/0103-11042020126...
, most BHUs in Brazil lack the necessary infrastructure to ensure universal access and accessibility to dental services, which highlights the importance of this dimension for at least 23.1% of Brazilians who have some form of limitation2929. Gonçalves AJ, Pereira PH, Monteiro V, Silva MF Junior, Baldani MH. Estrutura dos serviços de saúde bucal ofertados na Atenção Básica no Brasil: diferenças regionais. Saúde Debate. 2020;44(126):725-38. https://doi.org/10.1590/0103-1104202012610
https://doi.org/10.1590/0103-11042020126...
. Poor oral health service infrastructure is associated with reduced use of dental services, which are considered fundamental for characterizing dental vulnerability

Historical factors inherent in the late integration of dentistry into the Brazilian Family Health Strategy have contributed to reduced attention to oral health by the population, as well as weakened management. It is estimated that about 13% of the Brazilian population has never been to the dentist3030. Lynch J, Smith GD, Harper S, Hillemeier M, Ross N, Kaplan GA, et al. Is income inequality a determinant of population health? Part 1. A systematic review. Milbank Q. 2004;82(1):5-99. https://doi.org/10.1111/j.0887-378X.2004.00302.x
https://doi.org/10.1111/j.0887-378X.2004...
. The items of EVO-BR, in the oral health dimension, precisely encompass this self-perception approach that reflects individuals’ experiences and quality of life, portraying their needs. This supports the population management model and challenges the current model of care, characterized by invasive procedures and low effectiveness for years.

It is known that individuals with better living conditions are more likely to receive dental care2828. Palma PV, Leite IC, Greco RM. Associação entre a qualidade de vida relacionada à saúde bucal e a capacidade para o trabalho de técnicos administrativos em educação: um estudo transversal. Cad Saude Colet. 2019;27(1):100-7. https://doi.org/10.1590/1414-462x201900010089
https://doi.org/10.1590/1414-462x2019000...
. In this context, the dimension of health services considers access to and use of services in the measurement of dental vulnerability.

The PAS methodology aims to support healthcare managers and professionals in organizing health services and care networks, using Modelo de Atenção às Condições Crônicas11. Mendes EV. As redes de atenção à saúde. 2a ed. Brasília, DF: Organização Pan-Americana da Saúde; 2011. (MACC – Care Model for Chronic Conditions) as its reference framework. The MACC considers elements of the Chronic Care Model (CCM), the risk pyramid model, and the social determinants of health model. Therefore, it is suggested that work processes be organized based on an understanding of social factors, extending beyond the biopsychosocial risk factors11. Mendes EV. As redes de atenção à saúde. 2a ed. Brasília, DF: Organização Pan-Americana da Saúde; 2011..

CONCLUSION

The EVO-BR proved to be a potential instrument for use in the Brazilian Healthcare Planning (PAS), aiming to support the work process and the planning of oral health actions in PHC, based on the needs of users. This helps promote comprehensive, equitable, and timely care for patients. Based on the identification of vulnerable groups, the EVO-BR is a strategy that contributes to advancing the discussion on organizing oral health services in Brazil.

REFERENCES

  • 1
    Mendes EV. As redes de atenção à saúde. 2a ed. Brasília, DF: Organização Pan-Americana da Saúde; 2011.
  • 2
    Palacio DD, Rebustini F, Oliveira DB, Peres Neto J, Sanches TP, Mafra AC, et al. The concept of dental vulnerability in Brazil. Res Soc Dev. 2021;10(9):e30310917792. https://doi.org/10.33448/rsd-v10i9.17792
    » https://doi.org/10.33448/rsd-v10i9.17792
  • 3
    Palacio DC, Rebustini F, Oliveira DB, Peres Neto J, Barbieri W, Sanchez TP, et al. Dental vulnerability scale in primary health care: evidence of content and structure internal validity. BMC Oral Health. 2021 Aug;21(1):421. https://doi.org/10.1186/s12903-021-01742-6
    » https://doi.org/10.1186/s12903-021-01742-6
  • 4
    Cho SJ, Li F, Bandalos D. Accuracy of the parallel analysis procedure with polychoric correlations. Educ Psychol Meas. 2009;69(5):748-59. https://doi.org/10.1177/0013164409332229
    » https://doi.org/10.1177/0013164409332229
  • 5
    Dobriban E, Owen AB. Deterministic parallel analysis: an improved method for selecting factors and principal components. J R Stat Soc Series B Stat Methodol. 2019;81(1):163-83. https://doi.org/10.1111/rssb.12301
    » https://doi.org/10.1111/rssb.12301
  • 6
    Urbano L-S. Promin: a method for oblique factor rotation. Multivariate Behav Res. 1999;34(3):347-65. https://doi.org/10.1207/S15327906MBR3403_3
    » https://doi.org/10.1207/S15327906MBR3403_3
  • 7
    Quinn HC. Bifactor models, Explained Common Variance (ECV), and the usefulness of scores from unidimensional item response theory analyses [thesis]. Chapell Hill: University of North Carolina; 2019.
  • 8
    HAIR JR JF. et al. Multivariate data analysis. In: Multivariate data analysis. 2010; 785.
  • 9
    Wu AD, Zumbo BD, Marshall SK. A method to aid in the interpretation of EFA results: an application of Pratt's measures. Int J Behav Dev. 2014;38(1):98-110. https://doi.org/10.1177/0165025413506143
    » https://doi.org/10.1177/0165025413506143
  • 10
    Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF02310555
    » https://doi.org/10.1007/BF02310555
  • 11
    Woodhouse B, Jackson PH. Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: a search procedure to locate the greatest lower bound. Psychometrika. 1977;42(4):579-91. https://doi.org/10.1007/BF02295980
    » https://doi.org/10.1007/BF02295980
  • 12
    McDonald RP. Test theory: a unified treatment. New York: Psychology Press; 2013.
  • 13
    Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicologica (Valencia). 2016 Jan;37(2):235-47.
  • 14
    Mullarkey MC, Marchetti I, Beevers CG. Using network analysis to identify central symptoms of adolescent depression. J Clin Child Adolesc Psychol. 2019 Jul-Aug;48(4):656-68. https://doi.org/10.1080/15374416.2018.1437735
    » https://doi.org/10.1080/15374416.2018.1437735
  • 15
    Liang Y, Li F, Zhou Y, Liu Z. Evolution of the network pattern of posttraumatic stress symptoms among children and adolescents exposed to a disaster. J Anxiety Disord. 2021 Jan;77:102330. https://doi.org/10.1016/j.janxdis.2020.102330
    » https://doi.org/10.1016/j.janxdis.2020.102330
  • 16
    Haws JK, Brockdorf AN, Gratz KL, Messman TL, Tull MT, DiLillo D. Examining the associations between PTSD symptoms and aspects of emotion dysregulation through network analysis. J Anxiety Disord. 2022 Mar;86:102536. https://doi.org/10.1016/j.janxdis.2022.102536
    » https://doi.org/10.1016/j.janxdis.2022.102536
  • 17
    Borsboom D. Possible futures for network psychometrics. Psychometrika. 2022 Mar;87(1):253-65. https://doi.org/10.1007/s11336-022-09851-z
    » https://doi.org/10.1007/s11336-022-09851-z
  • 18
    Yeung AW, Leung WK. Citation network analysis of dental implant literature from 2007 to 2016. Int J Oral Maxillofac Implants. 2018;33(6):1240-6. https://doi.org/10.11607/jomi.6727
    » https://doi.org/10.11607/jomi.6727
  • 19
    Newman M. Networks: an introduction. Oxford: Oxford University Press; 2010. https://doi.org/10.1093/acprof:oso/9780199206650.001.0001
    » https://doi.org/10.1093/acprof:oso/9780199206650.001.0001
  • 20
    Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L. The huge package for high-dimensional undirected graph estimation in R. J Mach Learn Res. 2012 Apr;13(1):1059-62. PMID:26834510
  • 21
    Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul;9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045
    » https://doi.org/10.1093/biostatistics/kxm045
  • 22
    Fruchterman T, Reingold E. Graph drawing by force-directed placement. Software: Practice and Experience.1991;21(1):1129-64. https://doi.org/10.1002/spe.4380211102
    » https://doi.org/10.1002/spe.4380211102
  • 23
    Fonseca-Pedrero E, Ortuño J, Debbané M, Chan RC, Cicero D, Zhang LC, et al. The network structure of schizotypal personality traits. Schizophr Bull. 2018 Oct;44 suppl_2:S468-79. https://doi.org/10.1093/schbul/sby044
    » https://doi.org/10.1093/schbul/sby044
  • 24
    Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016 Aug;125(6):747-57. https://doi.org/10.1037/abn0000181
    » https://doi.org/10.1037/abn0000181
  • 25
    Hu Z, Lin L, Wang Y, Li J. The integration of classical testing theory and item response theory. Psychology. 2021 Sep;12(9):1397-409. https://doi.org/10.4236/psych.2021.129088
    » https://doi.org/10.4236/psych.2021.129088
  • 26
    Schlechter P, Wilkinson PO, Knausenberger J, Wanninger K, Kamp S, Morina N, et al. Depressive and anxiety symptoms in refugees: insights from classical test theory, item response theory and network analysis. Clin Psychol Psychother. 2021 Jan;28(1):169-81. https://doi.org/10.1002/cpp.2499
    » https://doi.org/10.1002/cpp.2499
  • 27
    Alvarenga WA, Nascimento LC, Rebustini F, Santos CB, Muehlan H, Schmidt S, et al. Evidence of validity of internal structure of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp-12) in Brazilian adolescents with chronic health conditions. Front Psychol. 2022 Sep;13:991771. https://doi.org/10.3389/fpsyg.2022.991771
    » https://doi.org/10.3389/fpsyg.2022.991771
  • 28
    Palma PV, Leite IC, Greco RM. Associação entre a qualidade de vida relacionada à saúde bucal e a capacidade para o trabalho de técnicos administrativos em educação: um estudo transversal. Cad Saude Colet. 2019;27(1):100-7. https://doi.org/10.1590/1414-462x201900010089
    » https://doi.org/10.1590/1414-462x201900010089
  • 29
    Gonçalves AJ, Pereira PH, Monteiro V, Silva MF Junior, Baldani MH. Estrutura dos serviços de saúde bucal ofertados na Atenção Básica no Brasil: diferenças regionais. Saúde Debate. 2020;44(126):725-38. https://doi.org/10.1590/0103-1104202012610
    » https://doi.org/10.1590/0103-1104202012610
  • 30
    Lynch J, Smith GD, Harper S, Hillemeier M, Ross N, Kaplan GA, et al. Is income inequality a determinant of population health? Part 1. A systematic review. Milbank Q. 2004;82(1):5-99. https://doi.org/10.1111/j.0887-378X.2004.00302.x
    » https://doi.org/10.1111/j.0887-378X.2004.00302.x

  • Funding: Support Project for the Institutional Development of the Brazilian Unified Health System (Proadi-SUS – Technical Opinion No. 2/2021 – CGGAP/DESF/SAPS/MS 0019478128 and dispatch SAPS/GAB/SAPS/MS 0019480381).

Publication Dates

  • Publication in this collection
    15 Apr 2024
  • Date of issue
    2023

History

  • Received
    31 Jan 2023
  • Accepted
    01 July 2023
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br