Pool of items to measure Primary Health Care workers’ knowledge on healthy eating

Lígia Cardoso dos Reis Patricia Constante Jaime About the authors

ABSTRACT

OBJECTIVE

To develop and validate a self-applicable instrument for measuring primary health care (PHC) workers’ knowledge on healthy eating.

METHODS

A six-step methodological study to develop and validate a measurement instrument: item development based on the Brazilian Dietary Guidelines’ chapters; content validation with a panel of experts; face validation with potential instrument users; online instrument reevaluation by participants of the content and face validation panels; online application of the instrument with PHC workers; confirmatory factor analysis for construct validation.

RESULTS

A first version with 25 items underwent content and semantic changes in the content and face validation panels, being reorganized into a second version with 22 items. In the reevaluation, participants considered 21 questions to be clear and representative of the Brazilian Dietary Guidelines, with one being excluded. This third version of the instrument underwent confirmatory factor analysis after being applied online with 209 PHC workers from all Brazilian macroregions. We excluded five items in this analysis: four due to bivariate empty cells and one due to low discrimination capacity. The final model, with 16 items loaded onto one dimension, returned good fit indices [χ2(104) = 119.047, p = 0.1486; RMSEA = 0.026 (90% CI = 0.000 to 0.046), Cfit = 0.979; CFI = 0.924; TLI = 0.913]; its information peak was below average.

CONCLUSIONS

The instrument proved to be valid and accurate for assessing PHC workers with below average knowledge of the Brazilian Dietary Guidelines. It might contribute to improving actions to promote healthy eating in Brazilian PHC settings by identifying the need for training health professionals.

Health Personnel; Health Knowledge, Attitudes, Practice; Diet, Healthy; Surveys and Questionnaires; Validation Study

INTRODUCTION

Published by the Ministry of Health in 2014, the second edition of the Brazilian Dietary Guidelines (BDG) had the challenge of including, in its recommendations, the interface between the human right to adequate food and health promotion and disease prevention actions. Adopted in Brazil as an instrument to support programs and policies for promoting adequate and healthy eating11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
, the BDG11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
were made available online in Portuguese, English, and Spanish, being recognized internationally for their content and for incorporating sustainability22. Ahmed S, Downs S, Fanzo J. Advancing an integrative framework to evaluate sustainability in National Dietary Guidelines. Front Sustain Food Syst. 2019;3:76. https://doi.org/10.3389/fsufs.2019.00076
https://doi.org/10.3389/fsufs.2019.00076...
. Their chapters address food choices based on a classification that includes the extent and purpose of food processing, with recommendations on culinary preparations, ways of eating, and obstacles to healthy eating, while considering social and environmental sustainability as one of their principles33. Monteiro CA, Cannon G, Moubarac JC, Martins APB, Martins CA, Garzillo J, et al. Dietary guidelines to nourish humanity and the planet in the twenty-first century. A blueprint from Brazil. Public Health Nutr. 2015;18(13):2311-22. https://doi.org/
https://doi.org/...
.

Although addressed to the population as a whole, BDG target readers are health workers and other health promotion professionals, since they play a key role in disseminating messages to the population33. Monteiro CA, Cannon G, Moubarac JC, Martins APB, Martins CA, Garzillo J, et al. Dietary guidelines to nourish humanity and the planet in the twenty-first century. A blueprint from Brazil. Public Health Nutr. 2015;18(13):2311-22. https://doi.org/
https://doi.org/...
. For United Nations’ Food and Agriculture Organization (FAO)44. Organización de las Naciones Unidas para la Alimentación y la Agricultura. El estado de las guías alimentarias baseadas en alimentos en América Latina y el Caribe: 21 años después de la Conferencia Internacional sobre Nutrición. Roma: FAO; 2014 [cited 2020 Oct 2]. Available from: https://bit.ly/2GlbNIj
https://bit.ly/2GlbNIj...
, dietitians are not the only health professionals who should help disseminate the guidelines; efforts should also be made for the continuing education of all health workers involved in promoting healthy eating.

Both the World Health Organization and the United Nations Children’s Fund55. World Health Organization; United Nations Children’s Fund. A vision for Primary Health Care in the 21st century. Towards universal health coverage and the Sustainable Development Goals. Geneva: (CH): WHO; UNICEF; 2018 [cited 2020 Oct 2]. Available from: https://bit.ly/33mPrio
https://bit.ly/33mPrio...
have highlighted the potential for Primary Health Care (PHC) professionals to meet the main health needs of the population near their homes, especially regarding their demand for food. This would require qualified and (ideally) multiprofessional teams.

For Vanderlee et al.66. Vanderlee L, McCrory C, Hammond D. Awareness and knowledge of recommendations from Canada’s Food Guide. Can J Diet Pract Res. 2015;76(3):146-9. https://doi.org/10.3148/cjdpr-2015-014
https://doi.org/10.3148/cjdpr-2015-014...
, although knowledge is only one of many factors influencing food intake, it would be unrealistic to expect people to follow the recommendations of dietary guidelines without knowing their content. Although FAO44. Organización de las Naciones Unidas para la Alimentación y la Agricultura. El estado de las guías alimentarias baseadas en alimentos en América Latina y el Caribe: 21 años después de la Conferencia Internacional sobre Nutrición. Roma: FAO; 2014 [cited 2020 Oct 2]. Available from: https://bit.ly/2GlbNIj
https://bit.ly/2GlbNIj...
has recognized dietary guidelines as the expression of food and nutrition education principles, to date, no tools are available in the literature to assess health workers’ knowledge on their content. Since the publication of the BDG, only one instrument has been published recently to assess the population’s adherence to their recommendations77. Gabe KT, Jaime PC. Development and testing of a scale to evaluate diet according to the recommendations of the Dietary Guidelines for the Brazilian Population. Public Health Nutr. 2019;22(5):785-96. https://doi.org/
https://doi.org/...
.

Thus, this study aims to develop and validate an instrument to measure PHC professionals’ knowledge about the content of the BDG.

METHODS

Theoretical Background

This paper describes the process of developing and validating a self-applied online instrument to measure PHC professionals’ knowledge about the BDG content.

The literature highlight knowledge of food and nutrition as an attribute of food literacy88. Truman E, Lane D, Elliott C. Defining food literacy: a scoping review. Appetite. 2017;116:365-71. https://doi.org/10.1016/j.appet.2017.05.007
https://doi.org/10.1016/j.appet.2017.05....
,99. Krause C, Sommerhalder K, Beer-Borst S, Abel T. Just a subtle difference? Findings from a systematic review on definitions of nutrition literacy and food literacy. Health Promot Int. 2018;33(3):378-89. https://doi.org/10.1093/heapro/daw084
https://doi.org/10.1093/heapro/daw084...
. According to the Social Cognitive Theory1010. Bandura A. Health promotion by social cognitive means. Health Educ Behav. 2004;31(2):143-64. https://doi.org/
https://doi.org/...
, developed by Albert Bandura, this concept is a precondition for a shift towards health promotion through social cognitive means, thus helping individuals to find reasons for behavior change. A systematic review by Krause et al.99. Krause C, Sommerhalder K, Beer-Borst S, Abel T. Just a subtle difference? Findings from a systematic review on definitions of nutrition literacy and food literacy. Health Promot Int. 2018;33(3):378-89. https://doi.org/10.1093/heapro/daw084
https://doi.org/10.1093/heapro/daw084...
points out that the central conceptual framework of food literacy includes practical knowledge and skills to regulate food intake, such as meal planning, food selection and preparation.

The BDG11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
, theoretical framework used to develop the items of the instrument, recommends choosing and planning meals autonomously and critically, while recognizing the social, cultural, environmental, and economic dimensions of healthy eating.

Its first chapter (Principles) presents the guiding principles of their recommendations. Chapter 2 (Choosing foods) makes general recommendations for choosing fresh or minimally processed foods as the basis of diets, showing a classification of foods based on the extent and purpose of processing. Chapter 3 (From foods to meals) provides advice on how to combine foods in meals, based primarily on fresh and minimally processed foods. Chapter 4 (Ways of eating) addresses the circumstances that influence food metabolism and the pleasure of eating. Chapter 5 (Understanding and overcoming obstacles) lists potential obstacles to proper and healthy eating. A summary of the main BDG recommendations can be found at the end of the publication, listed as “Ten Steps to Healthy Diets”11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
.

Instrument Development and Validation

We adopted a six-step methodological procedure to develop and validate the instrument: item development (step 1); content validation with a panel of experts (step 2); face validation by a focus group of potential instrument users (step 3); online instrument reevaluation by the participants in steps 2 and 3 (step 4); online application of the instrument to PHC professionals (step 5); confirmatory factor analysis for construct validation (step 6).

We first developed a 25-item instrument (step 1), each with a three response option (True; False; Do not know), to cover the five chapters of the BDG11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
.

Eight experts were then invited to analyze the instrument and validate its content (step 2) in a face-to-face panel, but only seven attended: four BDG experts, one psychometrics expert, one health promotion expert, and one food and nutrition education expert. All participants were familiar with the BDG and received, in addition to a copy of this document, the first version of the instrument.

The experts were instructed to relate each item on the instrument to at least one chapter of the BDG, rating each item based on representativeness (1 = item is not representative of the BDG; 2 = item needs major revisions; 3 = item needs minor revisions; 4 = item is representative of the BDG content) and clarity (1 = item is unclear; 2 = item needs major revisions; 3 = item needs minor revisions, 4 = item is clear). Following Hall et al.’s method1111. Hall E, Chai W, Koszewski W, Albrecht J. Development and validation of a social cognitive theory-based survey for elementary nutrition education program. Int J Behav Nutr Phys Act. 2015;12:47. https://doi.org/10.1186/s12966-015-0206-4
https://doi.org/10.1186/s12966-015-0206-...
, we also asked the experts to explain their reasons for not considering a particular item representative or clear, as well as to suggest changes and provide additional comments on repetition, difficulty and adequacy of the instrument to measure the proposed construct.

We calculated an average rating for representativeness and clarity, removing items with score lower than 3.0 from the instrument; items scoring between 3.0 and 4.0 were either removed or edited based on the experts’ comments and suggestions after concluding step 3 (face validation).

This third step aimed to measure whether the items are appropriate “at face value,” that is, if they are clear enough to their target audience1212. Pasquali L. Validade dos testes psicológicos: será possível reencontrar o caminho? Psic Teor Pesq. 2007;23 Nº esp:99-107. https://doi.org/10.1590/S0102-37722007000500019
https://doi.org/10.1590/S0102-3772200700...
. Eight potential instrument users (health professionals with previous PHC experience) were invited to validate the first version, but only six participated: three dietitians, one physical educator, one doctor and one speech therapist. The instrument was qualitatively evaluated by this focus group regarding its structure, response pattern, method of application, usefulness, and any semantic changes to make the items clearer. Participants for steps 2 and 3 were selected according to Nunally & Bernstein1313. Nunally JC, Bernstein IH. Psychometric theory. 3. ed. New York: McGraw-Hill; 1994.to obtain a sample of professionals from different fields related to the purpose of the instrument (content validation) and primary health care professionals that could assess its clarity (face validation).

After the assessment and considerations made by the content and face validation panels, the instrument underwent changes resulting in a second version. This corrected version was sent electronically, via Google Forms, to the same experts and health professionals (step 4).

The participants were instructed to evaluate the instrument using the same method as the content validation step, assigning a score from 1 to 4 for the representativeness and clarity of the items. The platform also offered fields for comments on the items and the instrument as a whole.

We received six assessments from the participants: three from the content validation panel and three from the face validation panel. The average scores assigned to each item were calculated using the same method for excluding/revising the items from the content validation step.

After making adjustments based on the suggestions received, we applied a third and final version of the instrument to a sample of PHC professionals with at least 1 year of experience in this field (step 5) calculated by estimating five to ten observations per variable (item), as recommended by Nunally & Bernstein1313. Nunally JC, Bernstein IH. Psychometric theory. 3. ed. New York: McGraw-Hill; 1994..

Respondents were recruited using the researchers’ social media and the university’s website until we reached the desired sample size. A website was designed and programmed to record the IP address of respondents’ computers, thus avoiding duplicate entries, besides providing information on the research and fields for the respondent to fill with personal and professional data. The website was launched in April 2017, and data collection for construct validation of the instrument with confirmatory factor analysis (step 6) was completed in June 2017.

Data Analysis

Confirmatory factor analysis was used to provide construct validity of the instrument, which consisted of dichotomous items (correct/incorrect responses); thus, answers recorded as “I don’t know” were coded as incorrect. The analysis assumed that the items, as a whole, would respond to a single dimension (knowledge of the BDG).

Categorical data was analyzed by an appropriate estimator1414. Muthén LK, Muthén BO. Mplus: the comprehensive modelling program for applied researchers: user’s guide. Los Angeles, CA: Muthén and Muthén; 2012., where the weighted least squares estimator (WLSMV) estimates the magnitude of factor loadings more accurately when compared with maximum likelihood estimators1515. Beauducel A, Herzberg PY. On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Struct Equ Modeling. 2006;13(2):186-203. https://doi.org/10.1207/s15328007sem1302_2
https://doi.org/10.1207/s15328007sem1302...
.

The models were run on Mplus version 8.0, with goodness of fit being assessed by the CFI (Comparative Fit Index), TLI (Tucker-Lewis Index) and RMSEA (Root Mean Square Error Approximation) indices. The goodness of fit cut-off points were CFI and TLI > 0.90, and RMSEA < 0.081616. Little TD. Longitudinal structural equation modeling. New York: Guilford Press; 2013.. RMSEA close fit (Cfit) values above 0.05 indicated a good fitted model.

Item Response Theory (theta parameterization) was used to estimate the discrimination (a parameter ) and difficulty (b parameter) item parameters, with cut-off points available in Baker & Kim1717. Baker FB, Kim SH. Item response theory: parameter estimation techniques. 2. ed. Boca Raton, FL: CRC Press; 2004.. Since the respondents lived in different macro-regions of Brazil (non-independent/multilevel structure), we considered the proposal of Asparouhov1818. Asparouhov T. Sampling weights in latent variable modeling. Struct Equ Modeling. 2005;12(3):411-34. https://doi.org/10.1207/s15328007sem1203_4
https://doi.org/10.1207/s15328007sem1203...
and Asparouhov1919. Asparouhov T. General multi-level modeling with sampling weights. Commun Stat Theory Methods. 2006;35(3):439-60. https://doi.org/10.1080/03610920500476598
https://doi.org/10.1080/0361092050047659...
for the standard errors and the Chi-square test of the model fit.

The total information curve was designed to identify at which interval of the evaluated construct (knowledge) the instrument works best.

This research was approved by the Research Ethics Committee of the School of Public Health, University of São Paulo, under protocol number 56303716.6.0000.5421. Participation was voluntary and all participants signed an informed consent form.

RESULTS

Instrument Development and Content and Face Validation

Our first instrument comprised 25 items. After the content and face validation panels, we excluded fours items, reworded 18 based on the comments made by the experts, and added one item to include content from chapter 4 of the BDG (Ways of eating). The changes resulted in a second version of the instrument with 22 items.

This second version underwent re-evaluation by the participants of the content and face validation panels. All experts found the instrument items clear and representative of the BDG content, excepting item 16 (Beans prepared with instant seasoning - powders or broths in tablet form - have more sodium than beans made with salt, garlic and bay leaf.), which was excluded for its averages below 3.0 for clarity and representativeness. Its third version thus comprised 21 items (see additional file) and underwent construct validation with factor analysis.

Construct Validation

We invited health professionals who have been providing PHC services in Brazil for at least 1 year to answer the instrument on the research website, collecting data from 209 PHC workers from all macroregions of Brazil (Table 1).

Table 1
Characteristics of participants in the construct validation of the instrument. São Paulo, 2017.

The initial 21-item model loaded onto one dimension returned empty bivariate cells between some pairs of items. Empty bivariate cells imply a perfect correlation (r = 1) and therefore one of the items – in which this perfect correlation is observed – should be excluded. We thus excluded items 1, 7, 19 and 20 (see additional file) to make the model admissible.

After an initial inspection, the model returned excellent fit indices – χ2(119) = 137.774, p = 0.114; RMSEA = 0.027 (90% CI = 0.000 to 0.046), Cfit = 0.982, CFI = 0.905, TLI = 0.891 –, although TLI was below the cutoff point (> 0.90) for a model with good fit. After inspecting the discrimination parameters for the remaining 17 items, we found that item 12 “Intake of rice and beans for lunch or dinner increases satiety” had the lowest discriminant value according to the degree of knowledge (a = 0.521, p = 0.009). After its exclusion from the instrument, all fit indices improved and returned a well-fitting model: χ2(104)= 119.047, p = 0.1486; RMSEA = 0.026 (90% CI = 0.000 to 0.046), Cfit = 0.979, CFI = 0.924, TLI = 0.913.

Table 2 shows the discrimination and difficulty, with their respective standard errors, of the 16 items of the unidimensional model (final version of the instrument). Regarding difficulty (Table 2), 13 of the remaining 16 items of the final version of the instrument presented values below -1, indicating that they are easy to answer. Items 13 and 21 showed difficulty parameters below -3 (b = -3.630 and b = -3.5, respectively), thus being the easiest to answer, while item 2 appeared to be the most difficult (see additional file). But since its difficulty is close to zero (b = -0.211, p < 0.001), one could argue that item 2 has an average degree of difficulty.

Table 2
Discrimination and Difficulty of the items in the final version of the instrument. São Paulo, 2017.

The Figure shows the total information curve of the instrument, where the X-axis describes the respondents’ amount of knowledge in z-score (mean at 0) and the Y-axis shows the amount of information (accuracy) of the instrument. The instrument is more accurate (information peak) for those with below average knowledge about the BDG.

Figure
X axis describes the amount of knowledge of respondents in z-score (mean at 0) and the Y axis shows the amount of information (precision) of the instrument.

DISCUSSION

This study developed and validated an instrument to measure PHC professionals’ knowledge of the Brazilian Dietary Guidelines11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
, which proved accurate for assessing professionals whose knowledge is below average. Such psychometric feature suggests that the tool should be used to evaluate professionals who require continuing education on promoting proper and healthy eating.

Psychometrics has been widely used as a method to develop and validate food and nutrition tools77. Gabe KT, Jaime PC. Development and testing of a scale to evaluate diet according to the recommendations of the Dietary Guidelines for the Brazilian Population. Public Health Nutr. 2019;22(5):785-96. https://doi.org/
https://doi.org/...
,2020. Pinho L, Moura PHT, Silveira MF, Botelho ACC, Caldeira AP. Development and validity of a questionnaire to test the knowledge of primary care personnel regarding nutrition in obese adolescents. BMC Fam Pract. 2013;14:102. https://doi.org/
https://doi.org/...
. The content and semantic changes made before the construct validation, based on the suggestions made by experts and potential instrument users in the initial steps, resulted in an easy-to-apply 16-item instrument. After the confirmatory factor analysis, we excluded four items for model-fitting purposes: item 1 explored the BDG principles; item 7, the recommendations on meal composition; items 19 and 20 explored the obstacles “advertising” and “time” for adequate and healthy eating. Despite these exclusions, other items covering the five chapters of the guidelines remained in the instrument. The item “Intake of rice and beans for lunch or dinner increases satiety” had the lowest discrimination value in the pool of items, being excluded from the instrument for a good model fit. This suggests that the relationship between eating rice and beans and satiety is well known and established among respondents. As these foods are part of the traditional Brazilian dietary pattern, such an information must be empirically known to health professionals. Content on meal composition appeared in other items of the instrument.

To our knowledge, since the BDG has been published, there are no tools available in the literature to assess PHC professionals’ knowledge on healthy eating recommendations and guidelines. These tools can help PHC service managers and other parties involved in workforce training to promote proper and healthy eating when diagnosing and monitoring the implementation of dietary guidelines, as recommended by FAO2121. Food and Agriculture Organization of the United Nations. Developing food-based dietary guidelines: a manual from the English-speaking Caribbean. Rome (IT): FAO; 2007 [cited 2020 Oct 2]. Available from: https://bit.ly/2Sn1wxY
https://bit.ly/2Sn1wxY...
. For this organization, one of the lessons learned over the past decades is the need to develop mechanisms to implement dietary guidelines that go beyond visual icons, thus suggesting that policy makers develop plans for implementing, evaluating, monitoring and redesigning these tools2222. Hawkes C. Promoting healthy diets through nutrition education and changes in the food environment: an international review of actions and their effectiveness. Rome (IT): FAO; 2013 [cited 2020 Oct 2]. Available from: http://www.fao.org/3/i3235e/i3235e.pdf
http://www.fao.org/3/i3235e/i3235e.pdf...
.

The qualification of health workers regarding food and nutrition education and prevention of public health problems related to food and nutrition is crucial to promote the health of the population2323. Kris-Etherton PM, Akabas SR, Douglas P, Kohlmeier M, Laur C, Lenders CM, et al. Nutrition competencies in health professionals’ education and training: a new paradigm. Adv Nutr. 2015;6(1):83-7. https://doi.org/10.3945/an.114.006734
https://doi.org/10.3945/an.114.006734...
. A recent assessment of food consumption patterns from 195 nations showed that dietary improvements can prevent 1 in 5 deaths worldwide. These findings showed that poor diets may cause more deaths than any other risk factor (including smoking), indicating the urgency of population-level dietary interventions2424. GBD 2017 Diet Collaborators. Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2019;393(10184):1958-72. https://doi.org/10.1016/S0140-6736(19)30041-8
https://doi.org/10.1016/S0140-6736(19)30...
.

FAO44. Organización de las Naciones Unidas para la Alimentación y la Agricultura. El estado de las guías alimentarias baseadas en alimentos en América Latina y el Caribe: 21 años después de la Conferencia Internacional sobre Nutrición. Roma: FAO; 2014 [cited 2020 Oct 2]. Available from: https://bit.ly/2GlbNIj
https://bit.ly/2GlbNIj...
recognizes professional training as a key element to implement dietary guidelines and highlights the importance of assessing the impact of implementing these tools in Latin American and Caribbean countries. Brazil, for example, has a public policy that includes food and nutrition education in the Unified Health System through the services provided by PHC workers. Although the Brazilian food and nutrition education guidelines infer that these actions should be taken by all health workers, research shows that dietitians remain the key actors in this situation2525. Florindo AA, Nakamura PM, Farias Júnior JC, Siqueira FV, Reis RS, Cruz DKA, et al. Promotion of physical activity, healthy eating and family health in municipalities with health gym. Rev Bras Educ Fís Esporte. 2016;30(4):925-36. https://doi.org/10.1590/1807-55092016000400913
https://doi.org/10.1590/1807-55092016000...
.

Several studies in nations that adopt dietary guidelines in their agendas to promote adequate and healthy eating have reported poor adherence to these recommendations2626. Rodríguez-Rodríguez E, Aparicio A, Aranceta-Bartrina J, Gil A, González-Gross M, Serra-Majem L, et al. Low adherence to dietary guidelines in Spain, especially in the overweight/obese population: The ANIBES Study. J Am Coll Nutr. 2017;36(4):240-7. https://doi.org/10.1080/07315724.2016.1248246
https://doi.org/10.1080/07315724.2016.12...

27. Canella DS, Louzada MLC, Claro RM, Costa JC, Bandoni DH, Levy RB, et al. Consumption of vegetables and their relation with ultra-processed foods in Brazil. Rev Saude Publica. 2018;52:50. https://doi.org/10.11606/s1518-8787.2018052000111
https://doi.org/10.11606/s1518-8787.2018...
-2828. Schuh DS, Pellanda LC, Guessous I, Marques-Vidal P. Trends and determinants of change in compliance to dietary guidelines in a Swiss community-dwelling sample. Prev Med. 2018; 111:198-203. https://doi.org/10.1016/j.ypmed.2018.03.008
https://doi.org/10.1016/j.ypmed.2018.03....
. Considering the role of health professionals in disseminating information on healthy eating, as advised by dietary guidelines44. Organización de las Naciones Unidas para la Alimentación y la Agricultura. El estado de las guías alimentarias baseadas en alimentos en América Latina y el Caribe: 21 años después de la Conferencia Internacional sobre Nutrición. Roma: FAO; 2014 [cited 2020 Oct 2]. Available from: https://bit.ly/2GlbNIj
https://bit.ly/2GlbNIj...
, we expect that the instrument proposed in this study to be useful for planning and implementing continuing education activities that can change this scenario.

Brazil’s public health system stands out for the attention given in recent years to the reorganization of PHC, taking on the challenge of adopting a health care model based on health promotion2929. Paim J, Travassos C, Almeida C, Bahia L, Macinko J. The Brazilian health system: history, advances, and challenges. Lancet. 2011;377(9779):1778-97. https://doi.org/10.1016/S0140-6736(11)60054-8
https://doi.org/10.1016/S0140-6736(11)60...
. The instrument proposed in this study can therefore help Brazil to reorganize activities to promote adequate and healthy food in PHC from this perspective.

Designed by the Ministry of Health as a theoretical reference for the Unified Health System to promote adequate and healthy eating, the BDG supports the development of personal skills and the reorientation of health services from the perspective of health promotion11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
. To this end, the literature suggests that health literacy should be more explicitly addressed in public policies and holistic interventions, thus ensuring that all population groups make informed and autonomous decisions3030. Baur C. New directions in research on public health and health literacy. J Health Commun. 2010;15 Suppl 2:42-50. https://doi.org/10.1080/10810730.2010.499989
https://doi.org/10.1080/10810730.2010.49...
. As the absence of tools can hinder assessing and monitoring the health professionals’ food literacy, and evaluating interventions focused on it, the instrument proposed in this study may fill a gap in the literature regarding the availability of validated instruments to measure PHC health workers’ skills for dissemination of BDG recommendations, and may inspire researchers from other nations.

Krause et al.99. Krause C, Sommerhalder K, Beer-Borst S, Abel T. Just a subtle difference? Findings from a systematic review on definitions of nutrition literacy and food literacy. Health Promot Int. 2018;33(3):378-89. https://doi.org/10.1093/heapro/daw084
https://doi.org/10.1093/heapro/daw084...
suggested that, in measuring food literacy, one should consider the following skills and competences: reading, understanding, and judging the quality of information; accumulating and exchanging knowledge on food and nutrition; practical skills about purchasing food and preparing meals; thinking critically about factors that influence food choices; and understanding the impact of those choices on society. Importantly, the chapters of the BDG11. Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
https://bit.ly/3l9pVDu...
make recommendations for critical and conscious food choice to prepare and eat healthy, tasty, culturally referenced, and socially and environmentally sustainable meals. The guidelines also present ways to overcome potential obstacles to adequate and healthy eating at the individual, collective, and public policy levels to ensure the human right to adequate food. For Vanderlee et al.66. Vanderlee L, McCrory C, Hammond D. Awareness and knowledge of recommendations from Canada’s Food Guide. Can J Diet Pract Res. 2015;76(3):146-9. https://doi.org/10.3148/cjdpr-2015-014
https://doi.org/10.3148/cjdpr-2015-014...
, the BDG stands out because its messages are less complex; people can thus more easily understand and engage with the principles of healthy eating.

An important limitation of this study was the lack of participation of nurses in the face validation step, as these professionals play an important role in PHC practices and their adherence could make a significant contribution to the construct validation step. Moreover, other parameters must be used for instrument validity. We suggest that future research focus on further analyzing the internal consistency of the instrument, since to our knowledge, this is the first study to present a validated instrument to measure PHC workers’ knowledge on the recommendations of a national food guide. The developed instrument has been shown to have content, face and construct validity to assess primary health care professionals whose BDG knowledge is below average.

REFERENCES

  • 1
    Ministry of Health (BR), Secretariat of Health Care, Primary Health Care Department. Dietary guidelines for the Brazilian population. Brasília, DF: Ministry of Health; 2015 [cited 2020 Oct 2]. Available from: https://bit.ly/3l9pVDu
    » https://bit.ly/3l9pVDu
  • 2
    Ahmed S, Downs S, Fanzo J. Advancing an integrative framework to evaluate sustainability in National Dietary Guidelines. Front Sustain Food Syst. 2019;3:76. https://doi.org/10.3389/fsufs.2019.00076
    » https://doi.org/10.3389/fsufs.2019.00076
  • 3
    Monteiro CA, Cannon G, Moubarac JC, Martins APB, Martins CA, Garzillo J, et al. Dietary guidelines to nourish humanity and the planet in the twenty-first century. A blueprint from Brazil. Public Health Nutr. 2015;18(13):2311-22. https://doi.org/
    » https://doi.org/
  • 4
    Organización de las Naciones Unidas para la Alimentación y la Agricultura. El estado de las guías alimentarias baseadas en alimentos en América Latina y el Caribe: 21 años después de la Conferencia Internacional sobre Nutrición. Roma: FAO; 2014 [cited 2020 Oct 2]. Available from: https://bit.ly/2GlbNIj
    » https://bit.ly/2GlbNIj
  • 5
    World Health Organization; United Nations Children’s Fund. A vision for Primary Health Care in the 21st century. Towards universal health coverage and the Sustainable Development Goals. Geneva: (CH): WHO; UNICEF; 2018 [cited 2020 Oct 2]. Available from: https://bit.ly/33mPrio
    » https://bit.ly/33mPrio
  • 6
    Vanderlee L, McCrory C, Hammond D. Awareness and knowledge of recommendations from Canada’s Food Guide. Can J Diet Pract Res. 2015;76(3):146-9. https://doi.org/10.3148/cjdpr-2015-014
    » https://doi.org/10.3148/cjdpr-2015-014
  • 7
    Gabe KT, Jaime PC. Development and testing of a scale to evaluate diet according to the recommendations of the Dietary Guidelines for the Brazilian Population. Public Health Nutr. 2019;22(5):785-96. https://doi.org/
    » https://doi.org/
  • 8
    Truman E, Lane D, Elliott C. Defining food literacy: a scoping review. Appetite. 2017;116:365-71. https://doi.org/10.1016/j.appet.2017.05.007
    » https://doi.org/10.1016/j.appet.2017.05.007
  • 9
    Krause C, Sommerhalder K, Beer-Borst S, Abel T. Just a subtle difference? Findings from a systematic review on definitions of nutrition literacy and food literacy. Health Promot Int. 2018;33(3):378-89. https://doi.org/10.1093/heapro/daw084
    » https://doi.org/10.1093/heapro/daw084
  • 10
    Bandura A. Health promotion by social cognitive means. Health Educ Behav. 2004;31(2):143-64. https://doi.org/
    » https://doi.org/
  • 11
    Hall E, Chai W, Koszewski W, Albrecht J. Development and validation of a social cognitive theory-based survey for elementary nutrition education program. Int J Behav Nutr Phys Act. 2015;12:47. https://doi.org/10.1186/s12966-015-0206-4
    » https://doi.org/10.1186/s12966-015-0206-4
  • 12
    Pasquali L. Validade dos testes psicológicos: será possível reencontrar o caminho? Psic Teor Pesq. 2007;23 Nº esp:99-107. https://doi.org/10.1590/S0102-37722007000500019
    » https://doi.org/10.1590/S0102-37722007000500019
  • 13
    Nunally JC, Bernstein IH. Psychometric theory. 3. ed. New York: McGraw-Hill; 1994.
  • 14
    Muthén LK, Muthén BO. Mplus: the comprehensive modelling program for applied researchers: user’s guide. Los Angeles, CA: Muthén and Muthén; 2012.
  • 15
    Beauducel A, Herzberg PY. On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Struct Equ Modeling. 2006;13(2):186-203. https://doi.org/10.1207/s15328007sem1302_2
    » https://doi.org/10.1207/s15328007sem1302_2
  • 16
    Little TD. Longitudinal structural equation modeling. New York: Guilford Press; 2013.
  • 17
    Baker FB, Kim SH. Item response theory: parameter estimation techniques. 2. ed. Boca Raton, FL: CRC Press; 2004.
  • 18
    Asparouhov T. Sampling weights in latent variable modeling. Struct Equ Modeling. 2005;12(3):411-34. https://doi.org/10.1207/s15328007sem1203_4
    » https://doi.org/10.1207/s15328007sem1203_4
  • 19
    Asparouhov T. General multi-level modeling with sampling weights. Commun Stat Theory Methods. 2006;35(3):439-60. https://doi.org/10.1080/03610920500476598
    » https://doi.org/10.1080/03610920500476598
  • 20
    Pinho L, Moura PHT, Silveira MF, Botelho ACC, Caldeira AP. Development and validity of a questionnaire to test the knowledge of primary care personnel regarding nutrition in obese adolescents. BMC Fam Pract. 2013;14:102. https://doi.org/
    » https://doi.org/
  • 21
    Food and Agriculture Organization of the United Nations. Developing food-based dietary guidelines: a manual from the English-speaking Caribbean. Rome (IT): FAO; 2007 [cited 2020 Oct 2]. Available from: https://bit.ly/2Sn1wxY
    » https://bit.ly/2Sn1wxY
  • 22
    Hawkes C. Promoting healthy diets through nutrition education and changes in the food environment: an international review of actions and their effectiveness. Rome (IT): FAO; 2013 [cited 2020 Oct 2]. Available from: http://www.fao.org/3/i3235e/i3235e.pdf
    » http://www.fao.org/3/i3235e/i3235e.pdf
  • 23
    Kris-Etherton PM, Akabas SR, Douglas P, Kohlmeier M, Laur C, Lenders CM, et al. Nutrition competencies in health professionals’ education and training: a new paradigm. Adv Nutr. 2015;6(1):83-7. https://doi.org/10.3945/an.114.006734
    » https://doi.org/10.3945/an.114.006734
  • 24
    GBD 2017 Diet Collaborators. Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2019;393(10184):1958-72. https://doi.org/10.1016/S0140-6736(19)30041-8
    » https://doi.org/10.1016/S0140-6736(19)30041-8
  • 25
    Florindo AA, Nakamura PM, Farias Júnior JC, Siqueira FV, Reis RS, Cruz DKA, et al. Promotion of physical activity, healthy eating and family health in municipalities with health gym. Rev Bras Educ Fís Esporte. 2016;30(4):925-36. https://doi.org/10.1590/1807-55092016000400913
    » https://doi.org/10.1590/1807-55092016000400913
  • 26
    Rodríguez-Rodríguez E, Aparicio A, Aranceta-Bartrina J, Gil A, González-Gross M, Serra-Majem L, et al. Low adherence to dietary guidelines in Spain, especially in the overweight/obese population: The ANIBES Study. J Am Coll Nutr. 2017;36(4):240-7. https://doi.org/10.1080/07315724.2016.1248246
    » https://doi.org/10.1080/07315724.2016.1248246
  • 27
    Canella DS, Louzada MLC, Claro RM, Costa JC, Bandoni DH, Levy RB, et al. Consumption of vegetables and their relation with ultra-processed foods in Brazil. Rev Saude Publica. 2018;52:50. https://doi.org/10.11606/s1518-8787.2018052000111
    » https://doi.org/10.11606/s1518-8787.2018052000111
  • 28
    Schuh DS, Pellanda LC, Guessous I, Marques-Vidal P. Trends and determinants of change in compliance to dietary guidelines in a Swiss community-dwelling sample. Prev Med. 2018; 111:198-203. https://doi.org/10.1016/j.ypmed.2018.03.008
    » https://doi.org/10.1016/j.ypmed.2018.03.008
  • 29
    Paim J, Travassos C, Almeida C, Bahia L, Macinko J. The Brazilian health system: history, advances, and challenges. Lancet. 2011;377(9779):1778-97. https://doi.org/10.1016/S0140-6736(11)60054-8
    » https://doi.org/10.1016/S0140-6736(11)60054-8
  • 30
    Baur C. New directions in research on public health and health literacy. J Health Commun. 2010;15 Suppl 2:42-50. https://doi.org/10.1080/10810730.2010.499989
    » https://doi.org/10.1080/10810730.2010.499989

  • Funding: International Development Research Centre (IDRC - grant CR-23447). National Council for Scientific and Technological Development (CNPq - grant 409733/2016-4).

Publication Dates

  • Publication in this collection
    22 Nov 2021
  • Date of issue
    2021

History

  • Received
    5 Oct 2020
  • Accepted
    9 Dec 2020
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br