Family Vulnerability Scale: validity evidence in primary health care

Evelyn Lima de Souza Flávio Rebustini Ilana Eshriqui Francisco Timbó de Paiva Neto Eliana Tiemi Masuda Ricardo Macedo Lima Daiana Bonfim About the authors

ABSTRACT

OBJECTIVE

Investigate evidence of validity of the Family Vulnerability Scale (EVFAM-BR) as an instrument to support population-based management in primary health care (PHC), in the scope of Health Care Planning (PAS).

METHODS

This is a psychometric study to assess any additional evidence of the internal structure of EVFAM-BR using confirmatory factor analysis (CFA) and network analysis (NA). A preliminary version of the scale with 38 items was submitted to patients of PHC facilities that use the PAS methodology, distributed across the five regions of Brazil. For the primary CFA data, factor loadings and predictive power (R2) of the item were used. Seven model adjustment indices were adopted and reliability was measured by three indicators, using Bayesian estimation.

RESULTS

The preliminary version of the scale was applied to 1,255 patients. Using the AFC, factor loadings ranged from 0.66 to 0.90 and R2 from 0.44 to 0.81. Both the primary indicators and the model adequacy indices presented satisfactory and consistent levels. According to the NA, the items were appropriately associated with their peers, respecting the established dimensions, thus demonstrating sustainability and stability of the proposed model.

CONCLUSIONS

The evidence of validity presented by EVFAM-BR indicates, for the first time in Brazil, a concise instrument that is able to assertively measure family vulnerability, potentially supporting population-based management.

Health Vulnerability; Family Characteristics; Validation Study Primary Health Care; Population Health Management

INTRODUCTION

The health system organization, with a focus on strengthening primary health care (PHC) and as coordinator of care and organizer of the Health Care Network, is critical for the management of work processes and production of results in health11. Giovanella L. Atenção básica ou atenção primária à saúde? Cad Saude Publica. 2018 Aug;34(8):e00029818. https://doi.org/10.1590/0102-311x00029818
https://doi.org/10.1590/0102-311x0002981...
. It implies changing the predominant service management model in the Brazilian National Health System (SUS), which is based on the provision of services, into a population health management model, or population-based management, which recognizes the needs of the patient population, the context in which they are inserted, their social determinants of health, stratification by health risks to qualify the care provided, and the search for reducing health inequalities22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019..

In this sense, the Health Care Planning (PAS) methodology, proposed by the National Council of Health Secretaries33. Conselho Nacional de Secretários de Saúde. Planificação da Atenção à Saúde: um instrumento de gestão e organização da atenção primária à saúde e da atenção ambulatorial especializada nas redes de atenção à saúde. Brasília, DF: CONASS; 2018 [cited 2022 Nov 3]. (Conass documenta 31). Available from: https://www.conass.org.br/biblioteca/caderno-conass-documenta-n-31/
https://www.conass.org.br/biblioteca/cad...
,44. Evangelista MJ, Guimarães AM, Dourado EM, Vale FL, Lins MZ, Matos MA, et al. O planejamento e a construção das redes de atenção à saúde no DF, Brasil. Cien Saude Colet. 2019;24(6):2115-24. https://doi.org/10.1590/1413-81232018246.08882019
https://doi.org/10.1590/1413-81232018246...
, is a strategy to organize work processes in PHC in order to promote population-based management. PAS is based on the discussion conducted by Mendes et al.22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019. about the organization of service provision, according to the demand profiles of the territory, and the Chronic Care Model55. Mendes EV. As redes de atenção à saúde. Brasília, DF: Organização Pan-Americana da Saúde; 2011 [cited 2022 Nov 3]. Available from: https://www.conass.org.br/biblioteca/as-redes-de-atencao-a-saude/
https://www.conass.org.br/biblioteca/as-...
, which determines levels of care management according to risk stratification of subpopulations.

In addition to exposure to risks from the classic reasoning of epidemiology, in the health field, vulnerability has been discussed since the 1990s concerning social determinants of health as a set of factors that cause damage or condition of interest to the public health, being used as an indicator of social inequality, with increasing relevance based on studies of susceptible populations66. Ayres JR, Calazans GJ, Saletti Filho HC, França I Junior. Risco, vulnerabilidade e práticas de prevenção e promoção da saúde. In: Campos GWS, Bonfim JRA, Minayo MCS, Akerman M, Drumond Junior M, Carvalho YM, organizadores. Tratado de saúde coletiva. São Paulo: Hucitec; 2016. p. 399-442.. Considering the family context as one of the determinants of the health-disease process, families would have to be stratified by level of vulnerability in order to plan care and prioritize the most vulnerable ones. However, although the health care literature shows different definitions of family vulnerability, this concept is broad and difficult to measure66. Ayres JR, Calazans GJ, Saletti Filho HC, França I Junior. Risco, vulnerabilidade e práticas de prevenção e promoção da saúde. In: Campos GWS, Bonfim JRA, Minayo MCS, Akerman M, Drumond Junior M, Carvalho YM, organizadores. Tratado de saúde coletiva. São Paulo: Hucitec; 2016. p. 399-442., involving multiple factors such as health status, income, and education of family members, as well family dynamics, among others77. Ayres JR, França I Junior, Calazans GJ, Saletti Filho HC. O conceito de vulnerabilidade e as práticas de saúde: novas perspectivas e desafios. Czeresnia D, Freitas CM, editores. Promoção da saúde: conceitos, reflexões, tendências. Rio de Janeiro: Fiocruz; 2003. p. 117-39.,88. Ayres JR, Paiva V, França I Jr, Gravato N, Lacerda R, Della Negra M, et al. Vulnerability, human rights, and comprehensive health care needs of young people living with HIV/AIDS. Am J Public Health. 2006 Jun;96(6):1001-6. [ https://doi.org/10.2105/AJPH.2004.060905
https://doi.org/10.2105/AJPH.2004.060905...
.

Some initiatives have proposed the development of instruments to measure family vulnerability, which can be used by PHC to plan care1010. Savassi LC, Lage JL, Coelho FL. Sistematização de um instrumento de estratificação de risco familiar: escala de risco familiar de Coelho-Savassi. J Manag Prim Health Care. 2012;3(2):179-85. https://doi.org/10.14295/jmphc.v3i2.155.
https://doi.org/10.14295/jmphc.v3i2.155...
,1111. Amendola F, Alvarenga MR, Latorre MD, Oliveira MA. Índice de vulnerabilidade a incapacidades e dependência (IVF-ID), segundo condições sociais e de saúde [Internet]. Cien Saude Colet. 2017 Jun;22(6):2063-71. https://doi.org/10.1590/1413-81232017226.03432016
https://doi.org/10.1590/1413-81232017226...
. However, these initiatives have not advanced in validity, presenting limited use in Brazil, a continental-size country with different socioeconomic and cultural realities.

In PAS, a scale for stratifying family vulnerability has been developed and validated, so that it can be standardized nationwide in PHC1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
, in agreement with the organization process of population-based management. The Family Vulnerability Scale (EVFAM-BR)1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
has 14 items divided into four dimensions (income, health care, family, and violence), answered with yes or no by a family member. Every positive answer to an item adds one point to the final score of the family vulnerability classification: low vulnerability (score of 0 to 4), moderate vulnerability (score of 5 to 6), and high vulnerability (score of 7 to 14).

A prior study1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
described the EVFAM-BR development and validity stages using exploratory factor analysis (EFA). However, for validity of an instrument with enough robust evidence to support its recommendation, additional evidence must be investigated. Therefore, this study aims to investigate evidence of validity of the Family Vulnerability Scale as an instrument to support population-based management in PHC, in the PAS scope in Brazil.

METHODS

Study design

This is a psychometric study that seeks additional evidence of the internal structure of EVFAM-BR through confirmatory factor analysis (CFA) and network analysis (NA). The recommendations from the Standards for Educational and Psychological Testing, of the American Educational Research Association (AERA), the American Psychological Association (APA), and the National Council on Measurement in Education (NCME)1313. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, The standards for educational and psychological testing. Washington, DC: American Psychological Association; 2014. to analyze sources of evidence were adopted. This study was approved by the Research Ethics Committee of Hospital Israelita Albert Einstein, report CEP 3.674.106, on October 22, 2019, CAAE 12395919.0.0000.0071.

Study setting and population

A prior study described the development of the EVFAM-BR1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
and presented evidence of its content validity and internal structure using an exploratory qualitative study with PHC health professionals. The 38-item scale version showed satisfactory evidence of content validity1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
and was applied to patients of 11 basic health units (UBS): one in the North region (Roraima), one in the Northeast region (Pernambuco), two in the Central West region (Mato Grosso), five in the Southeast region (São Paulo and Minas Gerais), and two in the South region (Paraná).

The UBS selection criteria were: 1) units that adopt the PAS methodology; 2) selection of at least one UBS in each of the five Brazilian geographic regions; and 3) UBS located in the most populous municipalities with the largest population in the region.

Given the covid-19 pandemic, data collection was performed in two stages: the first between June and November 2020 through telephone contact with patients from UBS units located in São Paulo. The researchers obtained patient identification and contact information after consent from the respective UBS management. The second stage was conducted between May and August 2022 in remaining UBS units, through face-to-face interviews with patients who attended the respective services on data collection days. In both stages, the inclusion criterion was participants aged 18 years or older.

After the patients accepted the invitation to participate in the study and signed the informed consent form, the interviewers applied a structured questionnaire from the preliminary version of EVFAM-BR with a participant characterization questionnaire. RedCap1414. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019 Jul;95:103208. https://doi.org/10.1016/j.jbi.2019.103208
https://doi.org/10.1016/j.jbi.2019.10320...
software was used for data collection and storage.

Statistical analysis

Confirmatory Factor Analysis

For the primary data of the CFA, factor loadings and the predictive power (R22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019.) of the item were used. The model adjustment indices adopted were: χ22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019./df; non-normed fit index (NNFI ≥0 .95), comparative fit index (CFI ≥ 0.95), goodness fit index (GFI ≥ 0.95), Tucker-Lewis index (TLI), root mean square error of approximation (RMSEA ≤ 0.08), and root mean square of residuals (RMSR ≤0.8). The model tested in the AFC was the factorial solution found in the initial study of the EFA1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
.

Reliability was measured by three indicators: Cronbach’s alpha1515. Crobach LJ. Coefficient alpha and the internal structure of tests [Internet]. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF02310555.
https://doi.org/10.1007/BF02310555...
, greatest lower bound or GLB1616. Woodhouse B, Jackson PH. Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound. Psychometrika. 1977;42(4):579-91. https://doi.org/10.1007/BF02295980.
https://doi.org/10.1007/BF02295980...
, and Omega1717. McDonald RP. Test theory: a unified treatment. New York: Psychology Press; 2013., using Bayesian estimation1818. Pfadt JM, Bergh DV, Sijtsma K, Wagenmakers EJ. A tutorial on Bayesian single-test reliability analysis with JASP. Behav Res Methods. 2022;55:1069-78. https://doi.org/10.3758/s13428-021-01778-0
https://doi.org/10.3758/s13428-021-01778...
.

Network analysis

Network analysis has been used in different settings and applications in the last decade, such as: assessment of symptoms1919. Mullarkey MC, Marchetti I, Beevers CG. Using Network Analysis to identify central symptoms of adolescent depression. J Clin Child Adolesc Psychol. 2019;48(4):656-68. https://doi.org/10.1080/15374416.2018.1437735
https://doi.org/10.1080/15374416.2018.14...
, psychological networks2020. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. 2018 Feb;50(1):195-212. https://doi.org/10.3758/s13428-017-0862-1
https://doi.org/10.3758/s13428-017-0862-...
, and post-traumatic stress2121. Yuan GF, Shi W, Elhai JD, Montag C, Chang K, Jackson T, et al. Gaming to cope: applying network analysis to understand the relationship between posttraumatic stress symptoms and internet gaming disorder symptoms among disaster-exposed Chinese young adults. Addict Behav. 2022 Jan;124:107096. https://doi.org/10.1016/j.addbeh.2021.107096
https://doi.org/10.1016/j.addbeh.2021.10...
, and in the development of measurement instruments2222. Borsboom D. Possible futures for network psychometrics. Psychometrika. 2022 Mar;87(1):253-65. https://doi.org/10.1007/s11336-022-09851-z
https://doi.org/10.1007/s11336-022-09851...
. However, its use is incipient in studies on the development of measurement instruments in Brazil.

A network analysis usually has two steps: 1) estimation of a statistical data model, from which some parameters can be represented as a weighted network between assessed variables; and 2) analysis of the weighted network structure using measurements taken from graph theory2525. Newman M. Networks: an introduction. Oxford: Oxford University Press; 2010..

Our study used the high-dimensional undirected graph estimation (HUGE)2626. Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L. The huge package for high-dimensional undirected graph estimation in R. J Mach Learn Res. 2012 Apr;13:1059-62. technique as the estimator and the extended Bayesian information criteria (EBIC) as the criteria. HUGE uses two estimation procedures: the neighborhood search algorithm2727. Meinshausen N, Bühlmann P. High-Dimensional Graphs and Variable Selection with the Lasso. Ann Stat. 2006;34(3):1436-62. https://doi.org/10.1214/009053606000000281
https://doi.org/10.1214/0090536060000002...
and the Lasso graph algorithm2828. Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul;9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045
https://doi.org/10.1093/biostatistics/kx...
. The graph nodes were positioned using the Fruchterman and Reingold algorithm2929. Fruchterman TM, Reingold EM. Graph drawing by force-directed placement. Softw Pract Exp. 1991;21(11):1129-1164. DOI. https://doi.org/10.1002/spe.4380211102.
https://doi.org/10.1002/spe.4380211102...
, which is based on the strength and connectivity between the nodes. Each node represents an item of the instrument.

Four indicators were adopted to evaluate the generated model: betweenness, which evaluates the efficiency with which a node connects to others; closeness, which assess how easy information reaches other nodes from a specific node; strength or degree, which shows how much a node is connected to the rest of the network3030. Valente TW. Network interventions. Science. 2012 Jul;337(6090):49-53. https://doi.org/10.1126/science.1217330
https://doi.org/10.1126/science.1217330...
; and, finally, expected influence, which evaluates the nature and strength of the cumulative influence of a node within the network and, therefore, its expected role in activation, persistence, and remission3131. Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016 Aug;125(6):747-57. https://doi.org/10.1037/abn0000181
https://doi.org/10.1037/abn0000181...
.

For both techniques (CFA and NA) a 5000 bootstrap was used. Analyses were performed in JASP 16.04 software. Absolute and relative frequencies, mean, standard deviation, and variation were used to characterize the participants.

RESULTS

In total, 1,584 patients were invited to participate in the study; of these, 1,505 (95%) accepted it, and 1,255 completed the application of the preliminary version of the proposed scale. Mean age of participants was 43 years old (standard deviation: 15 years), most of them were female (43.9%), had brown skin (50.9%), 12 to 15 years of education (38.2%), received up to one minimum wage (26.1%), had no health insurance (83.7%), and were born in the Northeast region (34.0%), followed by the Southeast region (27.6 %), South (13.8%), North (11.2%), Central West (10.1%), and another country (1.7%).

Using the CFA, factor loadings ranged from 0.66 to 0.90 and the predictive capacity of the item (R22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019.) from 0.44 to 0.81 (Figure 1). The “income” dimension presented factor loadings ranging from 0.75 to 0.90; the “health care” dimension from 0.66 to 0.89; the “family” dimension from 0.68 to 0.72; and the results of the “violence” dimension showed loadings between 0.74 and 0.85 – all of them at satisfactory levels. In addition to the primary indicators, the quality indices of the model were X22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019.(71) = 1.56, p = 0.0017; NNFI = 0.99, CFI = 0.99, GFI = 0.99, TLI = 0.99, RMSEA = 0.0218 (95%CI 0.0135–0.0293), and RMSR = 0.07. Covariance between factors ranged from 0.15 to 0.41.

Figure 1
Path diagram.

Reliability indices with Bayesian estimation were Cronbach’s alpha = 0.70 (95%CI 0.67–0.75), McDonald’s omega = 0.71 (95%CI 0.68–0.73), and GLB = 0.83 (95%CI 0.81–0.84) – all of them at satisfactory levels.

This way, both the primary indicators and the model adequacy indices were at satisfactory and consistent levels.

NA was applied to the previously developed model. Figure 2 shows the items were appropriately associated with their peers, respecting established dimensions. It again indicates sustainability and stability of the proposed model. Also, standardized centrality indices showed the roles of the items in the model.

Figure 2
Network analysis (left) and Item Centrality Indices (right) of EVFAM-BR (z-score).

For betweenness and closeness, item 2 “Is money short to meet household needs?” and item 11 “Has anyone in your household been abandoned by the family?” presented the best standardized values, indicating that both offer the best connection with the items of their dimension and those that favor the transfer of information between the nodes. For strength/degree, item 8 “Does anyone in your household need help accomplishing daily healthcare procedures?”, item 9 “Did anyone in your household have an absent mother in childhood?”, and item 14 “Is there any violence happening in your home?” These three items have the strongest connection in the network, with cumulative influence on the configuration of the model.

Figure 3 shows the final version of EVFAM-BR obtained from the evidence found in this study.

Figure 3
Family Vulnerability Scale (EVFAM-BR).

DISCUSSION

The results of this study confirm the EVFAM-BR is a consistent and reliable model and reinforce the contribution of the information obtained with a combination of techniques to the development of an instrument that measures family vulnerability.

The adoption of multiple tests to adjust a model (instrument) met contemporary recommendations for validity evidence1313. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, The standards for educational and psychological testing. Washington, DC: American Psychological Association; 2014., which has highlighted and recommended the need and contribution of models tested using multiple techniques. This combination seeks to improve instrument precision and quality by adding much more information to the model3232. Pollard B, Dixon D, Dieppe P, Johnston M. Measuring the ICF components of impairment, activity limitation and participation restriction: an item analysis using classical test theory and item response theory. Health Qual Life Outcomes. 2009 May;7(41):41. https://doi.org/10.1186/1477-7525-7-41
https://doi.org/10.1186/1477-7525-7-41...
,3333. Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015 Jan;18(1):25-34. https://doi.org/10.1016/j.jval.2014.10.005
https://doi.org/10.1016/j.jval.2014.10.0...
. It also helps determine the best model when many potential solutions are available3434. Alvarenga WA, Nascimento LC, Rebustini F, Santos CB, Muehlan H, Schmidt S, et al. Evidence of validity of internal structure of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp-12) in Brazilian adolescents with chronic health conditions. Front Psychol. 2022 Sep;13:991771. https://doi.org/10.3389/fpsyg.2022.991771
https://doi.org/10.3389/fpsyg.2022.99177...
. In addition, our study highlights the option of using the same sample in the exploratory factor analysis from the previous study1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
and in the analyses presented here, understanding the techniques analyze data in a different and complementary way, and ensuring consistency of the final model of the instrument. In this sense, the literature shows that using more than one technique with the same database provides more information about the parameters and the functioning of the models3232. Pollard B, Dixon D, Dieppe P, Johnston M. Measuring the ICF components of impairment, activity limitation and participation restriction: an item analysis using classical test theory and item response theory. Health Qual Life Outcomes. 2009 May;7(41):41. https://doi.org/10.1186/1477-7525-7-41
https://doi.org/10.1186/1477-7525-7-41...
,3333. Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015 Jan;18(1):25-34. https://doi.org/10.1016/j.jval.2014.10.005
https://doi.org/10.1016/j.jval.2014.10.0...
. In this context, the EVFAM-BR is a concise instrument with consistent evidence of validity.

The need for a validated scale that would allow the measurement of family vulnerability in different Brazilian scenarios appeared in the context of organizing work processes in PHC through the PAS, such as population registration, identification of subpopulations at risk, and stratification of family risk44. Evangelista MJ, Guimarães AM, Dourado EM, Vale FL, Lins MZ, Matos MA, et al. O planejamento e a construção das redes de atenção à saúde no DF, Brasil. Cien Saude Colet. 2019;24(6):2115-24. https://doi.org/10.1590/1413-81232018246.08882019
https://doi.org/10.1590/1413-81232018246...
. The organization of these aspects is critical considering that it is necessary to learn about the population and identify groups of health vulnerability in order to plan care using a population-based management model. Based on the PAS theoretical-methodological framework, which consists of implementing the Chronic Care Model22. Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019. to support the organization of PHC work processes, the development of a scale that qualifies the process to prioritize needs and plan care using a population-based management model contributes to this objective.

In essence, the scale was designed as a working instrument for community health agents (CHAs), who are Family Health Strategy (FHS) professionals recognized for their experience with the territory and connection with the enrolled families. In this perspective, it is easier for CHAs to communicate and identify problems in family dynamics, representing one of the most important channels for population-service communication3535. Ministério da Saúde (BR). Portaria Nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). Brasília, DF: Ministério da Saúde; 2017 [citado 15 nov 2022]. Disponível em: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
https://bvsms.saude.gov.br/bvs/saudelegi...
. In this context, EVFAM-BR is a tool with potential applicability by CHAs during home visits (as interviewers, since the questions are answered by a family member). The scale application can be appropriate at the time of family registration, qualifying the information obtained for population-based management. However, a wide range of professionals from PHC teams can measure family vulnerability using various tools (paper, application, electronic form, among others), settings (service visit, home visit, others) or even the self-application by the patient (for example, by text application on a smartphone). Of note, the information derived from the scale can contribute to the decision-making process in different areas of care.

EVFAM-BR is a tool that can support the work dynamics in PHC, providing opportunities for collaborative practice and comprehensive and equitable care, which helps overcome some challenges foreseen in the Sustainable Development Goals (SDGs) issued by the World Health Organization, in particular SDG 3 (Health and well-being), ensuring equitable access to quality health; and SDG 10 (Reduction of inequalities), promoting equal opportunities and reducing inequalities in health outcomes3636. Nações Unidas Brasil. Objetivos de desenvolvimento sustentável. Brasília, DF: Casa ONU Brasil; 2023 [cited 2022 Nov 14]. Available from: https://brasil.un.org/pt-br/sdgs
https://brasil.un.org/pt-br/sdgs...
.

The scale covers dimensions of social importance, such as income, health care, family, and violence1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
. Then, the interpretation of family vulnerability strata foreseen in EVFAM-BR1212. Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
https://doi.org/10.1371/journal.pone.028...
can be incorporated into different actions and activities in PHC, enriching dynamic maps of the territory, organization of social and community actions, team discussions and planning of services that meet the needs of the population at local, regional, and national levels1010. Savassi LC, Lage JL, Coelho FL. Sistematização de um instrumento de estratificação de risco familiar: escala de risco familiar de Coelho-Savassi. J Manag Prim Health Care. 2012;3(2):179-85. https://doi.org/10.14295/jmphc.v3i2.155.
https://doi.org/10.14295/jmphc.v3i2.155...
,3737. Peres J, Mendes KL, Wada RS, Sousa MD. Relação entre classificações de risco utilizadas para organização da demanda em saúde bucal em município de pequeno porte de São Paulo, Brasil. Cien Saude Colet. 2017 Jun;22(6):1905-11. https://doi.org/10.1590/1413-81232017226.00702016
https://doi.org/10.1590/1413-81232017226...
,3838. Nakata PT, Koltermann LI, Vargas KR, Moreira PW, Duarte ER, Rosset-Cruz I. Classificação de risco familiar em uma Unidade de Saúde da Família. Rev Lat Am Enfermagem. 2013;21(5). https://doi.org/10.1590/S0104-11692013000500011
https://doi.org/10.1590/S0104-1169201300...
. Considering the dynamics of the PHC territory and the possibility of periodic and systematic updating of the EVFAM-BR, its use can be helpful for monitoring the distribution of high and moderate vulnerability families in the territory, contributing to the assessment of adequacy and potential redistribution required in the territory.

Although the EVFAM-BR information is not included in health information systems, which would speed up the stratification process of enrolled families1010. Savassi LC, Lage JL, Coelho FL. Sistematização de um instrumento de estratificação de risco familiar: escala de risco familiar de Coelho-Savassi. J Manag Prim Health Care. 2012;3(2):179-85. https://doi.org/10.14295/jmphc.v3i2.155.
https://doi.org/10.14295/jmphc.v3i2.155...
, the scale items help identify other aspects of the family nucleus that impact the demand for health care beside those traditionally observed by teams and added to electronic records, such as the presence of a chronic condition, acute events, age group, sex, among others3939. Ministério da Saúde (BR). e-SUS APS. Brasília, df: Ministério da Saúde; 2022 [cited 2022 Nov 14]. Available from: https://sisaps.saude.gov.br/esus/
https://sisaps.saude.gov.br/esus/...
.

CONCLUSION

The territory vision by family vulnerability strata and care planning focused on identified needs are within the scope of the organization of PHC processes for population-based management, as recommended by PAS. In this context, the robust validity evidence presented by EVFAM-BR covering the national context constitutes a concise instrument that can measure family vulnerability with potential broad application by professionals in Brazil.

REFERENCES

  • 1
    Giovanella L. Atenção básica ou atenção primária à saúde? Cad Saude Publica. 2018 Aug;34(8):e00029818. https://doi.org/10.1590/0102-311x00029818
    » https://doi.org/10.1590/0102-311x00029818
  • 2
    Mendes EV, Matos MA, Evangelista MJ, Barra RP. A construção social da Atenção Primária à Saúde. 2nd ed. Brasília, DF: CONASS; 2019.
  • 3
    Conselho Nacional de Secretários de Saúde. Planificação da Atenção à Saúde: um instrumento de gestão e organização da atenção primária à saúde e da atenção ambulatorial especializada nas redes de atenção à saúde. Brasília, DF: CONASS; 2018 [cited 2022 Nov 3]. (Conass documenta 31). Available from: https://www.conass.org.br/biblioteca/caderno-conass-documenta-n-31/
    » https://www.conass.org.br/biblioteca/caderno-conass-documenta-n-31/
  • 4
    Evangelista MJ, Guimarães AM, Dourado EM, Vale FL, Lins MZ, Matos MA, et al. O planejamento e a construção das redes de atenção à saúde no DF, Brasil. Cien Saude Colet. 2019;24(6):2115-24. https://doi.org/10.1590/1413-81232018246.08882019
    » https://doi.org/10.1590/1413-81232018246.08882019
  • 5
    Mendes EV. As redes de atenção à saúde. Brasília, DF: Organização Pan-Americana da Saúde; 2011 [cited 2022 Nov 3]. Available from: https://www.conass.org.br/biblioteca/as-redes-de-atencao-a-saude/
    » https://www.conass.org.br/biblioteca/as-redes-de-atencao-a-saude/
  • 6
    Ayres JR, Calazans GJ, Saletti Filho HC, França I Junior. Risco, vulnerabilidade e práticas de prevenção e promoção da saúde. In: Campos GWS, Bonfim JRA, Minayo MCS, Akerman M, Drumond Junior M, Carvalho YM, organizadores. Tratado de saúde coletiva. São Paulo: Hucitec; 2016. p. 399-442.
  • 7
    Ayres JR, França I Junior, Calazans GJ, Saletti Filho HC. O conceito de vulnerabilidade e as práticas de saúde: novas perspectivas e desafios. Czeresnia D, Freitas CM, editores. Promoção da saúde: conceitos, reflexões, tendências. Rio de Janeiro: Fiocruz; 2003. p. 117-39.
  • 8
    Ayres JR, Paiva V, França I Jr, Gravato N, Lacerda R, Della Negra M, et al. Vulnerability, human rights, and comprehensive health care needs of young people living with HIV/AIDS. Am J Public Health. 2006 Jun;96(6):1001-6. [ https://doi.org/10.2105/AJPH.2004.060905
    » https://doi.org/10.2105/AJPH.2004.060905
  • 9
    Nichiata LY, Bertolozzi MR, Takahashi RF, Fracolli LA. A utilização do conceito "vulnerabilidade" pela enfermagem. Rev Latino-Am Enferm.2008;6(5):923-28. https://doi.org/10.1590/S0104-11692008000500020
    » https://doi.org/10.1590/S0104-11692008000500020
  • 10
    Savassi LC, Lage JL, Coelho FL. Sistematização de um instrumento de estratificação de risco familiar: escala de risco familiar de Coelho-Savassi. J Manag Prim Health Care. 2012;3(2):179-85. https://doi.org/10.14295/jmphc.v3i2.155
    » https://doi.org/10.14295/jmphc.v3i2.155
  • 11
    Amendola F, Alvarenga MR, Latorre MD, Oliveira MA. Índice de vulnerabilidade a incapacidades e dependência (IVF-ID), segundo condições sociais e de saúde [Internet]. Cien Saude Colet. 2017 Jun;22(6):2063-71. https://doi.org/10.1590/1413-81232017226.03432016
    » https://doi.org/10.1590/1413-81232017226.03432016
  • 12
    Souza EL, Eshriqui I, Rebustini F, Masuda ET, Paiva Neto FT, Lima RM, et al. Family Vulnerability Scale: evidence of content and internal structure validity. PLOS ONE. 2023;18(10):e280857. https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
    » https://doi.org/10.1371/journal.pone.0280857. eCollection 2023
  • 13
    American Educational Research Association, American Psychological Association, National Council on Measurement in Education, The standards for educational and psychological testing. Washington, DC: American Psychological Association; 2014.
  • 14
    Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019 Jul;95:103208. https://doi.org/10.1016/j.jbi.2019.103208
    » https://doi.org/10.1016/j.jbi.2019.103208
  • 15
    Crobach LJ. Coefficient alpha and the internal structure of tests [Internet]. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF02310555
    » https://doi.org/10.1007/BF02310555
  • 16
    Woodhouse B, Jackson PH. Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound. Psychometrika. 1977;42(4):579-91. https://doi.org/10.1007/BF02295980
    » https://doi.org/10.1007/BF02295980
  • 17
    McDonald RP. Test theory: a unified treatment. New York: Psychology Press; 2013.
  • 18
    Pfadt JM, Bergh DV, Sijtsma K, Wagenmakers EJ. A tutorial on Bayesian single-test reliability analysis with JASP. Behav Res Methods. 2022;55:1069-78. https://doi.org/10.3758/s13428-021-01778-0
    » https://doi.org/10.3758/s13428-021-01778-0
  • 19
    Mullarkey MC, Marchetti I, Beevers CG. Using Network Analysis to identify central symptoms of adolescent depression. J Clin Child Adolesc Psychol. 2019;48(4):656-68. https://doi.org/10.1080/15374416.2018.1437735
    » https://doi.org/10.1080/15374416.2018.1437735
  • 20
    Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. 2018 Feb;50(1):195-212. https://doi.org/10.3758/s13428-017-0862-1
    » https://doi.org/10.3758/s13428-017-0862-1
  • 21
    Yuan GF, Shi W, Elhai JD, Montag C, Chang K, Jackson T, et al. Gaming to cope: applying network analysis to understand the relationship between posttraumatic stress symptoms and internet gaming disorder symptoms among disaster-exposed Chinese young adults. Addict Behav. 2022 Jan;124:107096. https://doi.org/10.1016/j.addbeh.2021.107096
    » https://doi.org/10.1016/j.addbeh.2021.107096
  • 22
    Borsboom D. Possible futures for network psychometrics. Psychometrika. 2022 Mar;87(1):253-65. https://doi.org/10.1007/s11336-022-09851-z
    » https://doi.org/10.1007/s11336-022-09851-z
  • 23
    Marsman M, Rhemtulla M. Guest editors' introduction to the special issue "network psychometrics in action": methodological innovations inspired by empirical problems. Psychometrika. 2022 Mar;87(1):1-11. https://doi.org/10.1007/s11336-022-09861-x
    » https://doi.org/10.1007/s11336-022-09861-x
  • 24
    Marsman M, Borsboom D, Kruis J, Epskamp S, Bork R, Waldorp LJ, et al. An introduction to network psychometrics: relating ising network models to item response theory models. Multivariate Behav Res. 2018;53(1):15-35. https://doi.org/10.1080/00273171.2017.1379379
    » https://doi.org/10.1080/00273171.2017.1379379
  • 25
    Newman M. Networks: an introduction. Oxford: Oxford University Press; 2010.
  • 26
    Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L. The huge package for high-dimensional undirected graph estimation in R. J Mach Learn Res. 2012 Apr;13:1059-62.
  • 27
    Meinshausen N, Bühlmann P. High-Dimensional Graphs and Variable Selection with the Lasso. Ann Stat. 2006;34(3):1436-62. https://doi.org/10.1214/009053606000000281
    » https://doi.org/10.1214/009053606000000281
  • 28
    Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul;9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045
    » https://doi.org/10.1093/biostatistics/kxm045
  • 29
    Fruchterman TM, Reingold EM. Graph drawing by force-directed placement. Softw Pract Exp. 1991;21(11):1129-1164. DOI. https://doi.org/10.1002/spe.4380211102
    » https://doi.org/10.1002/spe.4380211102
  • 30
    Valente TW. Network interventions. Science. 2012 Jul;337(6090):49-53. https://doi.org/10.1126/science.1217330
    » https://doi.org/10.1126/science.1217330
  • 31
    Robinaugh DJ, Millner AJ, McNally RJ. Identifying highly influential nodes in the complicated grief network. J Abnorm Psychol. 2016 Aug;125(6):747-57. https://doi.org/10.1037/abn0000181
    » https://doi.org/10.1037/abn0000181
  • 32
    Pollard B, Dixon D, Dieppe P, Johnston M. Measuring the ICF components of impairment, activity limitation and participation restriction: an item analysis using classical test theory and item response theory. Health Qual Life Outcomes. 2009 May;7(41):41. https://doi.org/10.1186/1477-7525-7-41
    » https://doi.org/10.1186/1477-7525-7-41
  • 33
    Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015 Jan;18(1):25-34. https://doi.org/10.1016/j.jval.2014.10.005
    » https://doi.org/10.1016/j.jval.2014.10.005
  • 34
    Alvarenga WA, Nascimento LC, Rebustini F, Santos CB, Muehlan H, Schmidt S, et al. Evidence of validity of internal structure of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being Scale (FACIT-Sp-12) in Brazilian adolescents with chronic health conditions. Front Psychol. 2022 Sep;13:991771. https://doi.org/10.3389/fpsyg.2022.991771
    » https://doi.org/10.3389/fpsyg.2022.991771
  • 35
    Ministério da Saúde (BR). Portaria Nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). Brasília, DF: Ministério da Saúde; 2017 [citado 15 nov 2022]. Disponível em: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
    » https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
  • 36
    Nações Unidas Brasil. Objetivos de desenvolvimento sustentável. Brasília, DF: Casa ONU Brasil; 2023 [cited 2022 Nov 14]. Available from: https://brasil.un.org/pt-br/sdgs
    » https://brasil.un.org/pt-br/sdgs
  • 37
    Peres J, Mendes KL, Wada RS, Sousa MD. Relação entre classificações de risco utilizadas para organização da demanda em saúde bucal em município de pequeno porte de São Paulo, Brasil. Cien Saude Colet. 2017 Jun;22(6):1905-11. https://doi.org/10.1590/1413-81232017226.00702016
    » https://doi.org/10.1590/1413-81232017226.00702016
  • 38
    Nakata PT, Koltermann LI, Vargas KR, Moreira PW, Duarte ER, Rosset-Cruz I. Classificação de risco familiar em uma Unidade de Saúde da Família. Rev Lat Am Enfermagem. 2013;21(5). https://doi.org/10.1590/S0104-11692013000500011
    » https://doi.org/10.1590/S0104-11692013000500011
  • 39
    Ministério da Saúde (BR). e-SUS APS. Brasília, df: Ministério da Saúde; 2022 [cited 2022 Nov 14]. Available from: https://sisaps.saude.gov.br/esus/
    » https://sisaps.saude.gov.br/esus/

  • Financing: Programa de Apoio ao Desenvolvimento Institucional do Sistema Único de Saúde (PROADI-SUS – Technical report nº 2/2021 - GGAP/DESF/SAPS/MS (0019478128) and report SAPS/GAB/SAPS/MS (0019480381).

Publication Dates

  • Publication in this collection
    15 Apr 2024
  • Date of issue
    2023

History

  • Received
    13 Jan 2023
  • Accepted
    13 Oct 2023
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br