Concordance between two instruments for health literacy assessment **Study financed with resources from the Research Support Foundation of the State of Bahia (Fapesb) - Processes No. 4452/2018 and No. 5111/2019 - and from the National Council for Scientific and Technological Development (CNPq) / Ministry of Science, Technology, Innovations and Communications (MCTIC) - Processes No. 156099/2017 and No. 147970/2018.

Luana Resende Cangussú Eduardo Antonio Sartori Alho Felipe Esdras Lucas Cardoso Adirlene Pontes de Oliveira Tenório Romero Henrique de Almeida Barbosa Johnnatas Mikael Lopes Matheus Rodrigues Lopes About the authors

Abstract

Objetivo

To determine agreement between the Short Test of Functional Health Literacy in Adults (S-TOFHLA) and the Short Assessment of Health Literacy for Portuguese-speaking Adults (SAHLPA-18) measurement instruments as a strategy for estimating concurrent validity.

Methods

This was a cross-sectional study conducted with users of the Brazilian National Health System. An agreement approach using a weighted Kappa test for qualitative data was applied in order to test for concurrent validity.

Results

372 individuals participated. It was found that 66% and 62% of them did not have an adequate level of literacy according to SAHLPA-18 and S-TOFHLA, respectively. There was strong correlation between the instruments (p<0.001; r=0.60), although the 65.3% agreement of correct answers found was considered weak (Kappa=0.35; p<0.001).

Conclusion

The SAHLPA-18 and S-TOFHLA instruments have different constructs and poor agreement. Use of different instruments is indicated in research intended to measure level of literacy, as is the development of instruments specific to health conditions that allow results close to the real context of individuals to be obtained.

Keywords:
Health Literacy; Public Health; Reproducibility of Results; Self Care; Noncommunicable Diseases; Health Education

Introduction

In their clinical practice healthcare professionals constantly provide documents and information that require numerical, communication and reading skills from service users in order for them to achieve better health self-care management. Socio-educational barriers, which interfere with the simultaneous use of these skills, are frequent and limit autonomy among people in whom limited health literacy stands out.11. Marques SRL, Lemos SMA. Health literacy assessment instruments: literature review. Audiol Commun Res [Internet]. 2017 Jul [cited 2020 Aug 16];22:e1757. Available from: https://doi.org/10.1590/2317-6431-2016-1757
https://doi.org/10.1590/2317-6431-2016-1...
,22. Maragno CAD, Mengue SS, Moraes CG, Rebelo MVD, Guimarães AMM, Pizzol TSD. Test of health literacy for Portuguese-speaking adults. Rev Bras Epidemiol [Internet]. 2019 Apr [cited 2020 Aug 10];22:e190025. Available from: https://doi.org/10.1590/1980-549720190025
https://doi.org/10.1590/1980-54972019002...

Health literacy is defined as the set of cognitive and social skills that determine the individual’s ability to obtain, process and understand health information in order to use it in his or her daily life.33. Sampaio HAC, Carioca AAF, Sabry MOD, Santos PM, Coelho MAM, Passamai MPB. Letramento em saúde de diabéticos tipo 2: fatores associados e controle glicêmico. Ciênc Saúde Coletiva [Internet]. 2015 mar [citado 2020 ago 03];20(3):865-74. Disponível em: https://doi.org/10.1590/1413-81232015203.12392014
https://doi.org/10.1590/1413-81232015203...
Despite education and health concepts being discussed, sometimes, in isolation, there is interdependence of these basic citizenship rights in this definition of health literacy.44. Salci MA, Maceno P, Rozza SG, Silva DMGV, Boehs AE, Heidemann ITSB. Health education and its theoretical perspectives: a few reflections. Texto contexto - enferm [Internet]. 2013 Jan-Mar [cited 2020 Jul 22];22(1):224-30. Available from: https://doi.org/10.1590/S0104-07072013000100027
https://doi.org/10.1590/S0104-0707201300...
Inadequate literacy is a neglected public health problem, although it negatively impacts the individual´s clinical outcome.55. Rababah JA, Al-Hammouri MM, Drew BL, Aldalaykeh M. Health literacy: exploring disparities among college students. BMC Public Health [Internet]. 2019 Oct [cited 2020 Dec 7];19(1):1401. Available from: https://doi.org/10.1186/s12889-019-7781-2
https://doi.org/10.1186/s12889-019-7781-...

6. Yue MG, Feng Z. Medication literacy in a cohort of Chinese patients discharged with essential hypertension. Front Public Health [Internet]. 2020 Jan [cited 2020 Ago 5];7:385. Available from: https://doi.org/10.3389/fpubh.2019.00385
https://doi.org/10.3389/fpubh.2019.00385...
-77. Levin-Zamir D, Baron-Epel OB, Cohen V, Elhayany A. The association of health literacy with health behavior, socioeconomic indicators, and self-assessed health from a national adult survey in Israel. J Health Commun [Internet]. 2016 [cited 2020 Dec 7];21(Supl 2):61-8. Available from: https://doi.org/10.1080/10810730.2016.1207115
https://doi.org/10.1080/10810730.2016.12...
Thus, literacy is a condition for self-care and therapeutic effectiveness and it is therefore recommended that health professionals stratify, in the clinical context, people who will need greater instructional support, in order to provide equitable care.88. Lopes JM. Modelos de atenção primária e assistência fisioterapêutica. In: Lopes JM, Guedes MBOG, editores. Fisioterapia na atenção primária à saúde: manual de práticas baseado em evidência. Rio de Janeiro: Atheneu; 2019.

Assessing something that is not tangible, such as knowledge or literacy, requires psychometric tools to be selected and applied in each situation. Some instruments have been created in an attempt to better measure individuals health literacy level, and thus outline intervention strategies. Rapid Estimate of Adult Literacy in Medicine (REALM) and the Test of Functional Health Literacy in Adults (TOFHLA) are the most described instruments in the literature.

TOFHLA, first published in 1995,99. Parker RM, Baker DW, Williams MV, Nurss JR. The test of functional health literacy in adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med [Internet]. 1995 Oct [cited 2020 Dec 8];10(10):537-41. Available from: https://doi.org/10.1007/bf02640361
https://doi.org/10.1007/bf02640361...
has been translated and cross-culturally adapted by other countries. In view of the long time taken to administer it, a shorter version of TOPHLA was developed: the Short Test of Functional Health Literacy in Adults (S-TOFHLA).1010. Baker DW, Williams MV, Parker RM, Gazmararian JA, Nurss J. Development of a brief test to measure functional health literacy. Patient Educ Couns [Internet]. 1999 Sep [cited 2020 Dec 8];38(1):33-42. Available from: https://doi.org/10.1016/s0738-3991(98)00116-5
https://doi.org/10.1016/s0738-3991(98)00...
REALM, developed in the 1990s,1111. Murphy PW, Davis TC, Long SW, Jackson RH, Decker BC. Rapid estimate of adult literacy in medicine (REALM): a quick reading test for patients. J Reading [Internet]. 1993 Oct [cited 2020 Dec 8];37(2):124-30. Available from: https://www.jstor.org/stable/40033408
https://www.jstor.org/stable/40033408...
consists of a questionnaire that assesses the ability to recognize, read and pronounce. The Short Assessment of Health Literacy for Spanish-speaking Adults (SAHLSA) was developed inspired by REALM.1212. Lee SYD, Bender DE, Ruiz RE, Cho YI. Development of an easy-to-use Spanish health literacy test. Health Serv Res [Internet]. 2006 Aug [cited 2020 Dec 8];41(4 Pt 1):1392-412. Available from: https://doi.org/10.1111/j.1475-6773.2006.00532.x
https://doi.org/10.1111/j.1475-6773.2006...
The adapted version for the Portuguese language, the Short Assessment of Health Literacy for Portuguese-speaking Adults (SAHLPA-18)1313. Housten AJ, Hoover DS, Correa-Fernández V, Strong LL, Heppenr WL, Vinci C, et al. Associations of acculturation with English-and Spanish-language health literacy among bilingual latino adults. Health Lit Res Pract [Internet]. 2019 Apr [cited 2020 Aug 15];3(2):e81-9. Available from: https://doi.org/10.3928/24748307-20190219-01
https://doi.org/10.3928/24748307-2019021...
,1414. Apolinario D, Braga RCOP, Magaldi RM, Busse AL, Campora F, Brucki S, et al. Short assessment of health literacy for Portuguese-speaking adults. Rev Saúde Pública [Internet]. 2012 Jul [cited 2020 Dec 8];46(4):702-11. Available from: https://doi.org/10.1590/S0034-89102012005000047
https://doi.org/10.1590/S0034-8910201200...
was based on SAHLSA-50.

The existence of these various instruments and the absence of a ‘gold standard’ instrument makes it difficult to compare studies in different countries and alerts, furthermore, as to the need to create new health literacy assessment tools.1515. Altin SV, Finke I, Kautz-Freimuth S, Stock S. The evolution of health literacy assessment tools: a systematic review. BMC Public Health [Internet]. 2014 Nov [cited 2020 Dec 8];14:1207. Available from: https://dx.doi.org/10.1186%2F1471-2458-14-1207
https://dx.doi.org/10.1186%2F1471-2458-1...
,1616. Nguyen TH, Park H, Han H-R, Chan KS, Paasche-Orlow M, Haun J, et al. State of the science of health literacy measures: validity implications for minority populations. Patient Educ Couns [Internet]. 2015 Jul [cited 2020 Dec 8];98(12):1492-512. Avaialable from: https://doi.org/10.1016/j.pec.2015.07.013
https://doi.org/10.1016/j.pec.2015.07.01...

In Brazil there are few studies on cultural adaptation of literacy assessment instruments. Knowing how similar or different health literacy psychometric instrument classifications are, among diverse subpopulations with distinct social and health conditions, would help health care workers to use them more adequately. SAHLPA-18 is an easy-to-use instrument and could be used more often as a screening test in clinical practice.

The objective of this study was to determine agreement between the S-TOFHLA and SAHLPA-18 psychometric measurement instruments, as a strategy for estimating concurrent validity.

Methods

This was a study of agreement between instruments, with a cross-sectional design, conducted in the city of Paulo Afonso, state of Bahia, between August 2017 and March 2020.

Paulo Afonso is located in the Northeast region of Brazil, in the backland of Bahia. In 2019, the municipality had a population of 117,782 inhabitants, average monthly income of formal workers was 2.2 minimum wages and 43.6% of the population had per capita income of up to 0.5 minimum wage. The municipal schooling rate for the 6-14 age group is 96.4%. The municipality has a structured health service network, with all levels of care.1716. Nguyen TH, Park H, Han H-R, Chan KS, Paasche-Orlow M, Haun J, et al. State of the science of health literacy measures: validity implications for minority populations. Patient Educ Couns [Internet]. 2015 Jul [cited 2020 Dec 8];98(12):1492-512. Avaialable from: https://doi.org/10.1016/j.pec.2015.07.013
https://doi.org/10.1016/j.pec.2015.07.01...

Users of 22 primary health care units (PHU), including urban and rural areas, a municipal medical specialty outpatient department and a renal replacement therapy center, were eligible for the study. Data collection was carried out weekly, in these health establishments, throughout the study period.

The participants of the study were selected based on the following criteria: being 18 years old or over; being literate; and being a registered Primary Health Care service user in the city. The exclusion criteria were self-reported use of drugs that affect cognition, and the absence of a minimum of visual acuity or adequate hearing to perform the tests or the presence of manifestations of neurological or cognitive disorders, checked using simple attention, location and temporality questions performed by the researchers.

A non-probabilistic random sample was used. Recruitment took place before the consultation, prioritizing the last individuals on the waiting list, in order to optimize time and favor greater adherence to the study. Losses and refusals were not recorded.

The minimum sample size to estimate good or high agreement (Kappa index > 0.6) and to reduce possible type II errors was 110 participants. Equal absolute agreement for adequate and inadequate literacy, as well as for disagreement, which was nine times lower, was taken into account.

The variables studied were:

  1. sex (male; female);

  2. age group (in years: up to 30; 30 to 59; 60 or over);

  3. education (elementary school, high school or higher education, complete or incomplete); and

  4. economic classification of the respondent (according to the Brazilian Economic Classification Criteria - Brazilian Criteria 2019), of the Brazilian Market Research Association [ABEP]: A; B1; B2; C1; C2; D-E).1818. Associação Brasileira de Empresas de Pesquisa - ABEP. Critério de classificação econômica Brasil: critério Brasil [Internet]. São Paulo: Associação Brasileira de Empresas de Pesquisa; 2019 [citado 2020 ago 22]. Disponível em: http://www.abep.org/criterio-brasil
    http://www.abep.org/criterio-brasil...

The interview was conducted by the researchers, after adequate prior training on the specifics of each test, and conducted in a room exclusively reserved for this purpose. Interviews were performed using questionnaires. The level of health literacy was assessed by SAHLPA-18 and S-TOFHLA tests.

SAHLPA-18, validated from SAHLSA, was the first instrument used.1414. Apolinario D, Braga RCOP, Magaldi RM, Busse AL, Campora F, Brucki S, et al. Short assessment of health literacy for Portuguese-speaking adults. Rev Saúde Pública [Internet]. 2012 Jul [cited 2020 Dec 8];46(4):702-11. Available from: https://doi.org/10.1590/S0034-89102012005000047
https://doi.org/10.1590/S0034-8910201200...
18 cards were prepared, containing different medical terms, to assess the pronunciation and understanding skills of popular medical terms. The interviewee was asked to read the highlighted term on the card aloud so that the interviewer could evaluate his or her pronunciation. Then, the interviewee had to associate the term read with one of the answer options. This is a type of questionnaire that can be administered in about three minutes, by trained professionals. For each correct answer 1 mark was awarded, and literacy was considered adequate when the individual got a number of correct answers equal to or greater than 15 points.1414. Apolinario D, Braga RCOP, Magaldi RM, Busse AL, Campora F, Brucki S, et al. Short assessment of health literacy for Portuguese-speaking adults. Rev Saúde Pública [Internet]. 2012 Jul [cited 2020 Dec 8];46(4):702-11. Available from: https://doi.org/10.1590/S0034-89102012005000047
https://doi.org/10.1590/S0034-8910201200...

Following this, S-TOFHLA was applied. This instrument, translated and adapted from the original version,1919. Carthery-Goulart MT, Anghinah R, Areza-Fegyveres R, Bahia VS, Brucki SMD, Damin A, et al. Performance of a Brazilian population on the test of functional health literacy in adults. Rev Saúde Pública [Internet]. 2009 May [cited 2020 Dec 8];43(4):631-8. Available from: https://doi.org/10.1590/S0034-89102009005000031
https://doi.org/10.1590/S0034-8910200900...
had an estimated completion time of 12 minutes, by a trained professional; its questionnaire was comprised of 36 multiple choice items for reading comprehension, and 2 marks were awarded for each correct answer. In the numerical skill assessment, four cards requiring correct interpretation of everyday health situations were presented, 7 marks were awarded for each one. Depending on the score, each individual’s level of health literacy was classified as follows: scores between 0 and 53, inadequate; scores between 54 and 66, borderline; and scores between 67 and 100, adequate.22. Maragno CAD, Mengue SS, Moraes CG, Rebelo MVD, Guimarães AMM, Pizzol TSD. Test of health literacy for Portuguese-speaking adults. Rev Bras Epidemiol [Internet]. 2019 Apr [cited 2020 Aug 10];22:e190025. Available from: https://doi.org/10.1590/1980-549720190025
https://doi.org/10.1590/1980-54972019002...

The data were analyzed descriptively, in the form of absolute and relative frequency, for the health literacy classifications. Pearson’s correlation test was calculated to check the relationship between scores according to the instrument.

The weighted Kappa statistic was calculated to analyze concurrent validity between the literacy measurement instruments, considering: Kappa <0.40 as weak agreement; from 0.41 to 0.60, regular agreement; from 0.61 to 0.80, good; and Kappa ≥0.81, excellent agreement.2020. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med [Internet]. 2012 Oct [cited 2020 Dec 8];22(3):276-82. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900052/
https://www.ncbi.nlm.nih.gov/pmc/article...
Concordance analysis was applied to both the overall sample and the stratified sample, the latter according to specific chronic disease subpopulations and also by sex, age and economic classification, aiming to minimize secondary selection bias and intervening characteristics. Of this, the type of multivariate approach of this analysis consists, possible to reveal interactions between these predictors. In the case of such inferences, it will only be emphasized, as long as the main effect is present.

The chi-square test was applied to estimate the probability associated with the null hypothesis and the Kappa agreement measure. A significance level of 5% was adopted.

An authorization was requested, for the execution of this study, from the Municipal Health Department of Paulo Afonso and the Research Ethics Committee of the Federal University of Vale do São Francisco (CEP/UFVASF), granted following Opinion No. 2,228,427, issued on August 19, 2017. All participants were invited to sign the Free and Informed Consent Form after the explanation about the objectives of the study. Only the researchers directly involved with the interviews had access to the data and signed a term making the commitment to maintain confidentiality and secrecy about all the information collected.

Results

372 individuals were included and divided into four distinct groups (Figure 1). The average time of diagnosis of the individuals in the group with hypertension was 11.9 ± 7.6 years, with kidney disease, 5.6 ± 5.9 years, and in the group with diabetes, 10.3 ± 8.6 years (data not shown in table).

Figure 1
Distribution of study participants (n=372), Paulo Afonso, Bahia, 2020

The sample was predominantly composed of female (72.8%), and the mean age was 49.2 years (standard deviation: 15.6). Only 26.9% of the elderly have an adequate literacy level by SAHLPA-18 and 7.5% by S-TOFHLA. Individuals of economic classification D and E got worse results for the level of literacy, in both instruments. With regard to education, 39.2% of the respondents did not finish elementary school, an outcome reflected in literacy: 13% of those with less education had an adequate level using SALHPA-18, and only 11% using S-TOFHLA. On the other hand, 88.9% of individuals with higher education were successful in SALHPA-18 and 77.8% in S-TOFHLA (Table 1). Concentration of individuals with low education was found in the groups of economic classification up to stratum C, and in contrast, presence of high education in the groups classified as A and B (p<0.001). People with low education were common in the groups with kidney disease and diabetes (p=0.010), and there were no statistical differences in groups with hypertension or without a diagnosis of chronic diseases.

Table 1
Socio-demographic and clinical characteristics and level of health literacy of the study participants (n=372), Paulo Afonso, Bahia, 2020

Nominally, 66% of individuals had an inadequate level of health literacy by SAHLPA-18 and 62% did not have adequate literacy by S-TOHLA; of these, 11% had borderline literacy and 51% inadequate literacy. It could be seen a statistically strong positive correlation between SAHLPA-18 and S-TOFHLA (p <0.001; r=0.60) (Figure 2). The instruments showed 65.3% agreement of correct answers in the identification of adequate and inadequate literacy: weak agreement (Kappa=0.35; p <0.001), as shown in Table 2.

Figure 2
Correlation between the Short Assessment of Health Literacy for Portuguese-speaking Adults (SAHLPA-18) and the Short Test of Functional Health Literacy in Adults (S-TOFHLA) instruments (n=372), Paulo Afonso, Bahia, 2020

Table 2
Analysis of agreement between Short Assessment of Health Literacy for Portuguese-speaking Adults (SAHLPA-18) and Short Test of Functional Health Literacy in Adults (S-TOFHLA) in individuals without previous disease, with hypertension, chronic kidney disease or diabetes (n=372), Paulo Afonso, Bahia, 2020

Among individuals with hypertension, the agreement of correct answers in the classification as adequate or inadequate, was 65.6%, while with diabetes, 73.5%, considered regular agreement of correct answers: Kappa=0.40 and Kappa=0.45, respectively; p <0.001. However, participants with kidney disease and those without previous disease showed alignments of 67.4% (Kappa=0.27) and 52.9% (Kappa=0.21), respectively, considered weak agreement (Table 2).

When stratifying the analysis by the social conditions ‘sex’, ‘age’ and ‘economic classification’, the interaction between them and their influence on the level of agreement between the instruments was found (Table 3). Thus, the inferences took into account just this aspect of the analysis.

Table 3
Agreement between the Short Assessment of Health Literacy for Portuguese-speaking Adults (SAHLPA-18) and the Short Test of Functional Health Literacy in Adults (S-TOFHLA) stratified by sex, age group and economic classification in patients without previous disease, with hypertension, chronic kidney disease or diabetes (n=372), Paulo Afonso, Bahia, 2020

In a group of participants without previous disease, excellent agreement could be seen in men aged 31 to 59 years of economic classification A and B (Kappa=1.00), and regular agreement in those of economic classification C, D and E (Kappa=0.50). There was also excellent agreement in classification A and B (Kappa=1.00) and regular agreement in classification C, D and E (Kappa=0.48) (Table 3), in individuals with kidney disease, still in the same age group and sex.

With regard to hypertensive patients in economic classification A and B, among women, there was regular agreement in the 31-59 age group (Kappa=0.59) and good agreement (Kappa=0.66) in those over 60 years old; among hypertensive men in the same economic classification (A and B), agreement was regular only in those over 60 years old (Kappa=0.58). In economic classification C, D and E, agreement was regular only among women between 31 and 59 years old (Kappa=0.31).

In the group of individuals with diabetes, in classification A and B, there was good agreement among women in general (Kappa=0.70). In classification C, D and E, agreement was regular among men (Kappa=0.57) and among women (Kappa=0.40) between 31 and 59 years old; in participants over 60 years old, from the same economic class (C, D and E), the instruments showed excellent agreement in men (Kappa=1.00) and poor agreement in women (Kappa=0.14) (Table 3).

Discussion

SAHLPA-18 and S-TOFHLA had poor agreement in the analysis conducted with the total sample, and heterogeneous agreement when stratifying by socio-demographic subgroups and health status.

The sampling process adopted was non-probabilistic, furthermore, the number of individuals who refused to participate or were excluded from the research was not reported, limiting the representativeness of the consulted sample. The absence of sample planning for the health condition subgroups, on the other hand, restricts the capacity to minimize possible false negative errors.

Health literacy measurement instruments aim to assess the effect of various variables that contribute to the development and use of skills in the care context. The great limitation of this task is the absence of an instrument capable of assessing functional and interactive health literacy, either at the individual level, or in the context of specific groups or populations.2121. Haun JN, Valerio MA, McCormack LA, Sorensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instruments. J Health Commun [Internet]. 2014 [cited 2020 Dec 8];19 Supl 2:302-33. Available from: https://doi.org/10.1080/10810730.2014.936571
https://doi.org/10.1080/10810730.2014.93...
,2222. Guzys D, Kenny A, Dickson-Swift V, Threlkeld G. A critical review of population health literacy assessment. BMC Public Health [Internet]. 2015 Mar [cited 2020 Dec 8];15(1):215. Available from: https://doi.org/10.1186/s12889-015-1551-6
https://doi.org/10.1186/s12889-015-1551-...

The SAHLPA-18 and S-TOFHLA instruments showed statistically significant positive correlation in this study. Statistical correlation techniques only indicate whether the variation in the values of one variable follows the variation in the values of another. R can be understood as the degree of proximity of the pairs of points X and Y (the individual’s score on the two literacy instruments) to a random straight line, not necessarily to the 45º line; therefore, the linear correlation found does not, by itself, mean agreement between the instruments.

In order to analyze agreement, aside from correlation, there must also be coincidence between values. Measures of agreement are generally lower than the correlation coefficients when applied to the data set.2323. Miot HA. Agreement analysis in clinical and experimental trials. J Vasc Bras [Internet]. 2016 Apr-Jun [cited 2020 Aug 5];15(2):89-92. Available from: https://doi.org/10.1590/1677-5449.004216
https://doi.org/10.1590/1677-5449.004216...

Poor agreement was found between the two instruments used. This result was probably due to the fact that the analyzed questionnaires measured different constructs of health literacy; SAHLPA focuses on word recognition and pronunciation, while TOFHLA aims to assess an individual’s numerical ability and reading comprehension about health information.2222. Guzys D, Kenny A, Dickson-Swift V, Threlkeld G. A critical review of population health literacy assessment. BMC Public Health [Internet]. 2015 Mar [cited 2020 Dec 8];15(1):215. Available from: https://doi.org/10.1186/s12889-015-1551-6
https://doi.org/10.1186/s12889-015-1551-...

Advanced age is a relevant factor for level of health literacy, given that, throughout the aging process, cognitive changes may occur that interfere with the person’s degree of understanding.77. Levin-Zamir D, Baron-Epel OB, Cohen V, Elhayany A. The association of health literacy with health behavior, socioeconomic indicators, and self-assessed health from a national adult survey in Israel. J Health Commun [Internet]. 2016 [cited 2020 Dec 7];21(Supl 2):61-8. Available from: https://doi.org/10.1080/10810730.2016.1207115
https://doi.org/10.1080/10810730.2016.12...
This fact was found in this study, in which a low proportion of elderly showed an adequate level of literacy, as well as having interfered in the agreement between the instruments used. Educational level, in isolation, is an inaccurate tool for assessing health literacy: it quantifies the time spent in years of study in formal education, without considering the individual’s real learning.2424. Veiga FNA, Oliveira Martins-Reis V, Santos JN. A influência positiva do letramento na percepção da saúde e dos atendimentos em saúde recebidos pela população adulta e idosa. NBC [Internet]. 2017 jun [citado 2020 15 ago];7(13). Disponível em: https://www.metodista.br/revistas/revistas-izabela/index.php/bio/article/view/1535/887
https://www.metodista.br/revistas/revist...
An individual can master writing and reading skills without being able to put them into use in daily practice, for example, to understand a medical prescription, package insert, information poster or test results.2525. Levy H, Janke A. Health literacy and access to care. J Health Commun [Internet]. 2016 [cited 2020 Dec 8];21 Suppl 1:43-50. Available from: https://doi.org/10.1080/10810730.2015.1131776
https://doi.org/10.1080/10810730.2015.11...
It could be seen that only a very small proportion of the participants with incomplete elementary education showed adequate literacy levels, using the SAHLPA-18 and S-TOFHLA instruments. Higher levels of education were also not a guarantee of good performance as assessed by the two instruments.

Having a high level of education does not necessarily imply adequate health literacy.2626. World Health Organization, Kickbusch I, Pelikan JM, Apfel F, Tsouros AD, Editors. Health literacy: the solid facts [Internet]. Genebra: World Health Organization; 2013 [cited 2020 Aug 20]. Available from: https://www.euro.who.int/__data/assets/pdf_file/0008/190655/e96854.pdf?ua=1
https://www.euro.who.int/__data/assets/p...
For individuals with kidney disease, it can be seen that the instruments examined do not show better agreement among wealthier individuals, with better educational level, such as being an expert in aviation procedures or having early childhood education does not guarantee that the individual has minimal knowledge on self-care, it just makes learning easier.

The trend of finding a better level of literacy in the higher economic classifications could be attributed to the fact that people with higher income have greater opportunities for study and intellectual development. The functional literacy indicator shows that the proportion of illiterate people and people with a rudimentary level of literacy decreases significantly as income increases.2727. Todorovic N, Jovic-Vranes A, Djikanovic B, Pilipovic-Broceta N, Vasiljevic N, Racic M. Health literacy: current status and challenges in the work of family doctors in Bosnia and Herzegovina. Int J Environ Res Public Health [Internet]. 2019 Apr [cited 2020 Dec 8];16(8):1324. Available from: https://dx.doi.org/10.3390%2Fijerph16081324
https://dx.doi.org/10.3390%2Fijerph16081...
,2828. Instituto Paulo Montenegro, Lima A, Catelli Jr R. Indicador de alfabetismo funcional Brasil 2018: resultados preliminares [Internet]. [S.l.]: Instituto Paulo Montenegro; 2018 [citado 2020 ago 16]. Disponível em: https://acaoeducativa.org.br/wp-content/uploads/2018/08/Inaf2018_Relatório-Resultados-Preliminares_v08Ago2018.pdf
https://acaoeducativa.org.br/wp-content/...

Despite the existence of these individual determinants, the wide range of this theme does not allow limited health literacy to be attributed solely to individual competence.2929. Hersh L, Salzman B, Snyderman D. Health literacy in primary care practice. Am Fam Physician [Internet]. 2015 Jul [cited 2020 Dec 8];92(2):118-24. Available from: https://www.aafp.org/afp/2015/0715/p118.html
https://www.aafp.org/afp/2015/0715/p118....
Sometimes health systems are overloaded, constantly resulting in the time for consultations being reduced, as such the information provided to the service user is not appropriately transmitted. Furthermore, healthcare professionals tend to use complex and technical terms that are difficult for the population to understand, especially when they are not concerned with adapting this vocabulary to the socio-educational condition of each person receiving medical care. Given these factors, we can conclude that health care involves shared responsibility, for example, between a doctor and the patient.2727. Todorovic N, Jovic-Vranes A, Djikanovic B, Pilipovic-Broceta N, Vasiljevic N, Racic M. Health literacy: current status and challenges in the work of family doctors in Bosnia and Herzegovina. Int J Environ Res Public Health [Internet]. 2019 Apr [cited 2020 Dec 8];16(8):1324. Available from: https://dx.doi.org/10.3390%2Fijerph16081324
https://dx.doi.org/10.3390%2Fijerph16081...
Most of the work on health literacy in Brazil is recent and highlights the need to better explore the instruments used, in the context of the country’s socio-cultural reality.3030. Rocha PC, Lemos SMA. Conceptual aspects and factors associated with functional health literacy: a literary review. Rev CEFAC [Internet]. 2016 Jan-Feb [cited 2020 Aug 11];18(1):214-24. Available from: https://doi.org/10.1590/1982-021620161819615
https://doi.org/10.1590/1982-02162016181...
In addition to the adequacy of the instrument for the population, it is essential to ensure that the results obtained are faithful to the proposed measurement objective, and that they can also be used in comparison with other population studies or in guiding work practices and public policies.

Poor agreement was found between SAHLPA-18 and S-TOFHLA in measuring the level of health literacy. Therefore, the use of more than one measurement instrument in research to assess the global level of health literacy is indicated. For clinical practice and use in services, the development and validation of specific instruments, appropriate to the health conditions present, that allow results to be closer to the context of individuals, is indicated.

References

  • 1
    Marques SRL, Lemos SMA. Health literacy assessment instruments: literature review. Audiol Commun Res [Internet]. 2017 Jul [cited 2020 Aug 16];22:e1757. Available from: https://doi.org/10.1590/2317-6431-2016-1757
    » https://doi.org/10.1590/2317-6431-2016-1757
  • 2
    Maragno CAD, Mengue SS, Moraes CG, Rebelo MVD, Guimarães AMM, Pizzol TSD. Test of health literacy for Portuguese-speaking adults. Rev Bras Epidemiol [Internet]. 2019 Apr [cited 2020 Aug 10];22:e190025. Available from: https://doi.org/10.1590/1980-549720190025
    » https://doi.org/10.1590/1980-549720190025
  • 3
    Sampaio HAC, Carioca AAF, Sabry MOD, Santos PM, Coelho MAM, Passamai MPB. Letramento em saúde de diabéticos tipo 2: fatores associados e controle glicêmico. Ciênc Saúde Coletiva [Internet]. 2015 mar [citado 2020 ago 03];20(3):865-74. Disponível em: https://doi.org/10.1590/1413-81232015203.12392014
    » https://doi.org/10.1590/1413-81232015203.12392014
  • 4
    Salci MA, Maceno P, Rozza SG, Silva DMGV, Boehs AE, Heidemann ITSB. Health education and its theoretical perspectives: a few reflections. Texto contexto - enferm [Internet]. 2013 Jan-Mar [cited 2020 Jul 22];22(1):224-30. Available from: https://doi.org/10.1590/S0104-07072013000100027
    » https://doi.org/10.1590/S0104-07072013000100027
  • 5
    Rababah JA, Al-Hammouri MM, Drew BL, Aldalaykeh M. Health literacy: exploring disparities among college students. BMC Public Health [Internet]. 2019 Oct [cited 2020 Dec 7];19(1):1401. Available from: https://doi.org/10.1186/s12889-019-7781-2
    » https://doi.org/10.1186/s12889-019-7781-2
  • 6
    Yue MG, Feng Z. Medication literacy in a cohort of Chinese patients discharged with essential hypertension. Front Public Health [Internet]. 2020 Jan [cited 2020 Ago 5];7:385. Available from: https://doi.org/10.3389/fpubh.2019.00385
    » https://doi.org/10.3389/fpubh.2019.00385
  • 7
    Levin-Zamir D, Baron-Epel OB, Cohen V, Elhayany A. The association of health literacy with health behavior, socioeconomic indicators, and self-assessed health from a national adult survey in Israel. J Health Commun [Internet]. 2016 [cited 2020 Dec 7];21(Supl 2):61-8. Available from: https://doi.org/10.1080/10810730.2016.1207115
    » https://doi.org/10.1080/10810730.2016.1207115
  • 8
    Lopes JM. Modelos de atenção primária e assistência fisioterapêutica. In: Lopes JM, Guedes MBOG, editores. Fisioterapia na atenção primária à saúde: manual de práticas baseado em evidência. Rio de Janeiro: Atheneu; 2019.
  • 9
    Parker RM, Baker DW, Williams MV, Nurss JR. The test of functional health literacy in adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med [Internet]. 1995 Oct [cited 2020 Dec 8];10(10):537-41. Available from: https://doi.org/10.1007/bf02640361
    » https://doi.org/10.1007/bf02640361
  • 10
    Baker DW, Williams MV, Parker RM, Gazmararian JA, Nurss J. Development of a brief test to measure functional health literacy. Patient Educ Couns [Internet]. 1999 Sep [cited 2020 Dec 8];38(1):33-42. Available from: https://doi.org/10.1016/s0738-3991(98)00116-5
    » https://doi.org/10.1016/s0738-3991(98)00116-5
  • 11
    Murphy PW, Davis TC, Long SW, Jackson RH, Decker BC. Rapid estimate of adult literacy in medicine (REALM): a quick reading test for patients. J Reading [Internet]. 1993 Oct [cited 2020 Dec 8];37(2):124-30. Available from: https://www.jstor.org/stable/40033408
    » https://www.jstor.org/stable/40033408
  • 12
    Lee SYD, Bender DE, Ruiz RE, Cho YI. Development of an easy-to-use Spanish health literacy test. Health Serv Res [Internet]. 2006 Aug [cited 2020 Dec 8];41(4 Pt 1):1392-412. Available from: https://doi.org/10.1111/j.1475-6773.2006.00532.x
    » https://doi.org/10.1111/j.1475-6773.2006.00532.x
  • 13
    Housten AJ, Hoover DS, Correa-Fernández V, Strong LL, Heppenr WL, Vinci C, et al. Associations of acculturation with English-and Spanish-language health literacy among bilingual latino adults. Health Lit Res Pract [Internet]. 2019 Apr [cited 2020 Aug 15];3(2):e81-9. Available from: https://doi.org/10.3928/24748307-20190219-01
    » https://doi.org/10.3928/24748307-20190219-01
  • 14
    Apolinario D, Braga RCOP, Magaldi RM, Busse AL, Campora F, Brucki S, et al. Short assessment of health literacy for Portuguese-speaking adults. Rev Saúde Pública [Internet]. 2012 Jul [cited 2020 Dec 8];46(4):702-11. Available from: https://doi.org/10.1590/S0034-89102012005000047
    » https://doi.org/10.1590/S0034-89102012005000047
  • 15
    Altin SV, Finke I, Kautz-Freimuth S, Stock S. The evolution of health literacy assessment tools: a systematic review. BMC Public Health [Internet]. 2014 Nov [cited 2020 Dec 8];14:1207. Available from: https://dx.doi.org/10.1186%2F1471-2458-14-1207
    » https://dx.doi.org/10.1186%2F1471-2458-14-1207
  • 16
    Nguyen TH, Park H, Han H-R, Chan KS, Paasche-Orlow M, Haun J, et al. State of the science of health literacy measures: validity implications for minority populations. Patient Educ Couns [Internet]. 2015 Jul [cited 2020 Dec 8];98(12):1492-512. Avaialable from: https://doi.org/10.1016/j.pec.2015.07.013
    » https://doi.org/10.1016/j.pec.2015.07.013
  • 17
    Instituto Brasileiro de Geografia e Estatística - IBGE. Panorama das cidades brasileiras: Paulo Afonso/Bahia [Internet]. Rio de Janeiro: Instituto Brasileiro de Geografia e Estatística; 2020 [citado 2020 ago 21]. Disponível em: https://cidades.ibge.gov.br/brasil/ba/paulo-afonso/panorama
    » https://cidades.ibge.gov.br/brasil/ba/paulo-afonso/panorama
  • 18
    Associação Brasileira de Empresas de Pesquisa - ABEP. Critério de classificação econômica Brasil: critério Brasil [Internet]. São Paulo: Associação Brasileira de Empresas de Pesquisa; 2019 [citado 2020 ago 22]. Disponível em: http://www.abep.org/criterio-brasil
    » http://www.abep.org/criterio-brasil
  • 19
    Carthery-Goulart MT, Anghinah R, Areza-Fegyveres R, Bahia VS, Brucki SMD, Damin A, et al. Performance of a Brazilian population on the test of functional health literacy in adults. Rev Saúde Pública [Internet]. 2009 May [cited 2020 Dec 8];43(4):631-8. Available from: https://doi.org/10.1590/S0034-89102009005000031
    » https://doi.org/10.1590/S0034-89102009005000031
  • 20
    McHugh ML. Interrater reliability: the kappa statistic. Biochem Med [Internet]. 2012 Oct [cited 2020 Dec 8];22(3):276-82. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900052/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900052/
  • 21
    Haun JN, Valerio MA, McCormack LA, Sorensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instruments. J Health Commun [Internet]. 2014 [cited 2020 Dec 8];19 Supl 2:302-33. Available from: https://doi.org/10.1080/10810730.2014.936571
    » https://doi.org/10.1080/10810730.2014.936571
  • 22
    Guzys D, Kenny A, Dickson-Swift V, Threlkeld G. A critical review of population health literacy assessment. BMC Public Health [Internet]. 2015 Mar [cited 2020 Dec 8];15(1):215. Available from: https://doi.org/10.1186/s12889-015-1551-6
    » https://doi.org/10.1186/s12889-015-1551-6
  • 23
    Miot HA. Agreement analysis in clinical and experimental trials. J Vasc Bras [Internet]. 2016 Apr-Jun [cited 2020 Aug 5];15(2):89-92. Available from: https://doi.org/10.1590/1677-5449.004216
    » https://doi.org/10.1590/1677-5449.004216
  • 24
    Veiga FNA, Oliveira Martins-Reis V, Santos JN. A influência positiva do letramento na percepção da saúde e dos atendimentos em saúde recebidos pela população adulta e idosa. NBC [Internet]. 2017 jun [citado 2020 15 ago];7(13). Disponível em: https://www.metodista.br/revistas/revistas-izabela/index.php/bio/article/view/1535/887
    » https://www.metodista.br/revistas/revistas-izabela/index.php/bio/article/view/1535/887
  • 25
    Levy H, Janke A. Health literacy and access to care. J Health Commun [Internet]. 2016 [cited 2020 Dec 8];21 Suppl 1:43-50. Available from: https://doi.org/10.1080/10810730.2015.1131776
    » https://doi.org/10.1080/10810730.2015.1131776
  • 26
    World Health Organization, Kickbusch I, Pelikan JM, Apfel F, Tsouros AD, Editors. Health literacy: the solid facts [Internet]. Genebra: World Health Organization; 2013 [cited 2020 Aug 20]. Available from: https://www.euro.who.int/__data/assets/pdf_file/0008/190655/e96854.pdf?ua=1
    » https://www.euro.who.int/__data/assets/pdf_file/0008/190655/e96854.pdf?ua=1
  • 27
    Todorovic N, Jovic-Vranes A, Djikanovic B, Pilipovic-Broceta N, Vasiljevic N, Racic M. Health literacy: current status and challenges in the work of family doctors in Bosnia and Herzegovina. Int J Environ Res Public Health [Internet]. 2019 Apr [cited 2020 Dec 8];16(8):1324. Available from: https://dx.doi.org/10.3390%2Fijerph16081324
    » https://dx.doi.org/10.3390%2Fijerph16081324
  • 28
    Instituto Paulo Montenegro, Lima A, Catelli Jr R. Indicador de alfabetismo funcional Brasil 2018: resultados preliminares [Internet]. [S.l.]: Instituto Paulo Montenegro; 2018 [citado 2020 ago 16]. Disponível em: https://acaoeducativa.org.br/wp-content/uploads/2018/08/Inaf2018_Relatório-Resultados-Preliminares_v08Ago2018.pdf
    » https://acaoeducativa.org.br/wp-content/uploads/2018/08/Inaf2018_Relatório-Resultados-Preliminares_v08Ago2018.pdf
  • 29
    Hersh L, Salzman B, Snyderman D. Health literacy in primary care practice. Am Fam Physician [Internet]. 2015 Jul [cited 2020 Dec 8];92(2):118-24. Available from: https://www.aafp.org/afp/2015/0715/p118.html
    » https://www.aafp.org/afp/2015/0715/p118.html
  • 30
    Rocha PC, Lemos SMA. Conceptual aspects and factors associated with functional health literacy: a literary review. Rev CEFAC [Internet]. 2016 Jan-Feb [cited 2020 Aug 11];18(1):214-24. Available from: https://doi.org/10.1590/1982-021620161819615
    » https://doi.org/10.1590/1982-021620161819615

  • *
    Study financed with resources from the Research Support Foundation of the State of Bahia (Fapesb) - Processes No. 4452/2018 and No. 5111/2019 - and from the National Council for Scientific and Technological Development (CNPq) / Ministry of Science, Technology, Innovations and Communications (MCTIC) - Processes No. 156099/2017 and No. 147970/2018.

Publication Dates

  • Publication in this collection
    07 May 2021
  • Date of issue
    2021

History

  • Received
    27 July 2020
  • Accepted
    24 Oct 2020
Secretaria de Vigilância em Saúde e Ambiente - Ministério da Saúde do Brasil Brasília - Distrito Federal - Brazil
E-mail: ress.svs@gmail.com