Weight bias in nutritional practice: a study with nutrition students

Angélica Almeida Obara Sandra Roberta Gouvea Ferreira Vivolo Marle dos Santos Alvarenga About the authors

Abstract:

Obesity is associated with psychosocial problems like stigma, discrimination, and bias. Studies have found that nutritionists and nutrition students display negative attitudes and biases toward obese individuals. This study examined the existence of nutrition students’ bias toward obese individuals. The students answered questionnaires by completing on-line forms with demographic data and self-reported weight and height and were assigned to one of four randomly selected hypothetical cases of patients referred to a nutritionist after receiving a diagnosis of lactose intolerance (normal weight man; normal weight woman; obese man; and obese woman). Except for weight, body mass index (BMI), and daily energy intake, all information on diet, habits, and health conditions were identical for profiles of the same sex. The questionnaire included questions on the indication of procedures and approaches during the consultation, consultation time, counseling strategies, dietary and health evaluation, and students’ affective and behavioral reactions. Three hundred and thirty-five students participated, mostly women, with mean BMI of 23kg/m². Patient’s weight influenced consultation time and students’ perceptions and treatment approaches and strategies. The study revealed biases and negative attitudes mainly involving the students’ perceptions and reactions to obese patients, and obese women generally received the worse evaluations.

Keywords:
Prejudice; Obesity; Students; Nutritionists

Introduction

Obesity is a major public health problem, due not only to the increased risk of cardiometabolic diseases, but also to psychosocial problems such as body dissatisfaction, eating disorders, stigma, discrimination, and bias 11. World Health Organization. Obesity: preventing and managing the global epidemic. Report of a WHO consultation on obesity. Geneva: World Health Organization; 1999. (WHO Technical Report Series, 894),,22. World Health Organization. Global status report on noncommunicable diseases, 2010. Geneva: World Health Organization; 2011..

Bias toward obesity includes negative attitudes (feelings, stereotypes, attributes), beliefs, and behaviors toward an individual perceived as obese or “fat” 33. Daníelsdóttir S, O'Brien KS, Ciaoc A. Anti-fat prejudice reduction: a review of published studies. Obes Facts 2010; 3:47-58.,44. Macpherson-Sánchez AE. Integrating fundamental concepts of obesity and eating disorders: implications for the obesity epidemic. Am J Public Health 2015; 105:e71-85.. Stigma is defined as a negative attribute assigned to an individual, who suffers discrimination through associations between given attributes and stereotypes (the cognitive component of stigma) 55. Goffman E. Stigma: notes on the management of spoiled identity. New York: Symon and Schuster Inc.; 1963. - the behavioral manifestation of bias, even when manifested unconsciously. Bias is the affective component of stigma 44. Macpherson-Sánchez AE. Integrating fundamental concepts of obesity and eating disorders: implications for the obesity epidemic. Am J Public Health 2015; 105:e71-85..

The term “weight bias” 66. Schwartz MB, Chambliss HO, Brownell KD, Blair SN, Billington C. Weight bias among health professionals specializing in obesity. Obes Res 2003; 11:1033-9.,77. Puhl RM, Latner J. Weight bias: new science on an significant social problem. Obesity (Silver Spring) 2008; 16 Suppl 2:S1-2.,88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.,99. Swift JA, Hanlon S, El-Redy L, Puhl RM, Glazebrook C. Weight bias among UK trainee dietitians, doctors, nurses and nutritionists. J Hum Nutr Diet 2012; 26:395-402.,1010. Lee M, Ata RN, Brannick MT. Malleability of weight-biased attitudes and beliefs: a meta-analysis of weight bias reduction interventions. Body Image 2014; 11:251-9.,1111. Puhl RM, Latner JD, O'Brien K, Luedicke J, Danielsdottir S, Forhan M. A multinational examination of weight bias: predictors of anti-fat attitudes across four countries. Int J Obes (Lond) 2015; 39:1166-73.,1212. Tomiyama AJ, Finch LE, Belsky ACI, Buss J, Finley C, Schwartz MB, et al. Weight bias in 2001 versus 2013: contradictory attitudes among obesity researchers and health professionals. Obesity 2015; 23:46-53. has been applied to the bias itself (attitudinal component), stereotypes (components related to beliefs concerning the etiology and maintenance of obesity), and discrimination, manifested through acts and behaviors 44. Macpherson-Sánchez AE. Integrating fundamental concepts of obesity and eating disorders: implications for the obesity epidemic. Am J Public Health 2015; 105:e71-85.,1010. Lee M, Ata RN, Brannick MT. Malleability of weight-biased attitudes and beliefs: a meta-analysis of weight bias reduction interventions. Body Image 2014; 11:251-9..

Studies show that weight-related discrimination and bias are commonplace in many countries 1111. Puhl RM, Latner JD, O'Brien K, Luedicke J, Danielsdottir S, Forhan M. A multinational examination of weight bias: predictors of anti-fat attitudes across four countries. Int J Obes (Lond) 2015; 39:1166-73. and are growing 1313. Andreyeva T, Puhl RM, Brownell KD. Changes in perceived weight discrimination among Americans, 1995-1996 through 2004-2006. Obesity 2008; 16:1129-34.. Stigma is often used as a tool for social control on grounds of discouraging unhealthy behaviors and improving the health of stigmatized obese individuals, who are held responsible for their own excess weight 1414. Puhl RM, Heuer CA. Obesity stigma: important considerations for public health. Am J Public Health 2010; 100:1019-28.,1515. Vartanian LR, Smyth JM. Primum non nocere: obesity stigma and public health. J Bioeth Inq 2013; 10:49-57.,1616. Abuh-Odeh D. Fat stigma and the public health: a theoretical framework and ethical analysis. Kennedy Inst Ethics J 2014; 24:247-65.. In fact, however, research has shown the rise in obesity rates in the presence of stigma, along with an increase in binge eating and vulnerability to depression, low self-esteem, anxiety, and lower levels of physical activity in individuals that are stigmatized because of their weight 1414. Puhl RM, Heuer CA. Obesity stigma: important considerations for public health. Am J Public Health 2010; 100:1019-28., who are also less inclined to seek healthcare services preventively, besides showing worse outcomes in weight 1717. O'Brien KS, Puhl RM, Latner JD, Mir AS, Hunter JA. Reducing anti-fat prejudice in preservice health students: a randomized trial. Obesity 2010; 18:2138-44. and being subject to greater cardiometabolic risk to the extent that they introject the bias 1818. Pearl RL, Wadden TA, Hopkins CM, Shaw JA, Hayes MR, Bakizada ZM, et al. Association between weight bias internalization and metabolic syndrome among treatment-seeking individuals with obesity. Obesity 2017; 25:317-22..

Healthcare professionals are cited by obese individuals as one of the most common sources of weight bias. Patients report inappropriate and disrespectful remarks, in addition to feeling misunderstood 1919. Puhl RM, Heuer CA. The stigma of obesity: a review and update. Obesity 2009; 17:941-64.. Nutritionists are among the professionals cited 2020. Oberrieder H, Walker R, Monroe D, Adeyanju M. Attitude of dietetics students and registered dietitians toward obesity. J Am Diet Assoc 1995; 95:914-6.,2121. Harvey EL, Summerbell CD, Kirk SFL, Hill AJ. Dietitians' views of overweight and obese people and reported management practices. J Hum Nutr Diet 2002; 15:331-47., and bias rates can be high even among experts in obesity treatment 66. Schwartz MB, Chambliss HO, Brownell KD, Blair SN, Billington C. Weight bias among health professionals specializing in obesity. Obes Res 2003; 11:1033-9.. Likewise, negative attitudes and bias toward obese individuals have been reported in undergraduate students in nutrition 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.,2020. Oberrieder H, Walker R, Monroe D, Adeyanju M. Attitude of dietetics students and registered dietitians toward obesity. J Am Diet Assoc 1995; 95:914-6.,2222. Berryman DE, Dubale GM, Manchester DS, Mittelstaedt R. Dietetics students possess negative attitudes toward obesity similar to nondietetics students. J Am Diet Assoc 2006; 106:1678-82., which is troublesome considering that they will be treating obesity in the future at various levels of healthcare.

Some studies have explored the attitudes of nutrition students 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.,99. Swift JA, Hanlon S, El-Redy L, Puhl RM, Glazebrook C. Weight bias among UK trainee dietitians, doctors, nurses and nutritionists. J Hum Nutr Diet 2012; 26:395-402.,2020. Oberrieder H, Walker R, Monroe D, Adeyanju M. Attitude of dietetics students and registered dietitians toward obesity. J Am Diet Assoc 1995; 95:914-6.,2222. Berryman DE, Dubale GM, Manchester DS, Mittelstaedt R. Dietetics students possess negative attitudes toward obesity similar to nondietetics students. J Am Diet Assoc 2006; 106:1678-82., including evaluation of attitudes in simulated cases or mock consultations with obese patients 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.,2323. Wigton RS, McGaghie WC. The effect of obesity on medical students' approach to patients with abdominal pain. J Gen Intern Med 2001; 16:262-5.,2424. Persky S, Eccleston CP. Medical student bias and care recommendations for an obese versus non-obese virtual patient. Int J Obes (Lond) 2011; 35:728-35.. In Brazil, studies have explored the issue of weight-related stigma and bias from the obese individual’s perspective through qualitative methodologies 2525. Mattos RS, Luz MT. Sobrevivendo ao estigma da gordura: um estudo socioantropológico sobre obesidade. Physis (Rio J.) 2009; 19:489-507.,2626. Pinto MS, Bosi MLM. Muito mais do que pe(n)sam: percepções e experiências acerca da obesidade entre usuárias da rede pública de saúde de um município do Nordeste do Brasil. Physis (Rio J.) 2010; 20:443-57.,2727. Cruz CAG, Bastos LC. Histórias de uma obesa: a teoria dos posicionamentos e a (re)construção discursiva das identidades. Linguagem em (Dis)curso 2015; 15:367-84., but the literature also includes a cross-sectional study on the occurrence of discrimination reported by adolescents in a cohort study 2828. Gonçalves H, Dumith SC, González DA, Menezes AMB, Araújo CLP, Hallal PC, et al. Discriminação autorrelatada por adolescentes de uma coorte de nascimentos brasileira: prevalência e associações. Rev Panam Salud Pública 2012; 31:204-10., a systematic review of healthcare professionals’ beliefs and practices toward obesity (which did not include any study conducted in Brazil) 2929. Teixeira FV, Pais-Ribeiro JL, Maia ARPC. Crenças e práticas dos profissionais de saúde face à obesidade: uma revisão sistemática. Rev Assoc Med Bras (1992) 2012; 58:254-62., and only one qualitative study analyzing the perspectives of healthcare professionals and patients concerning obesity 3030. Grejanin DKM, Pezzo TH, Nastri V, Sanches VPP, Nascimento DDG, Quevedo MP. As percepções sobre o "ser obeso" sob a ótica do paciente e dos profissionais de saúde. Rev Bras Crescimento Desenvolv Hum 2007; 17:37-47.. On the issue of bias toward obesity among nutritionists, there is a single study on nutritionists’ opinions concerning the factors involved in the development of obesity and the characteristics attributed to obese persons 3131. Cori GC, Petty MLB, Alvarenga MS. Atitudes de nutricionistas em relação a indivíduos obesos - um estudo exploratório. Ciênc Saúde Coletiva 2015; 20:9-20..

Considering the theme’s relevance, the importance of nutritionists’ work in treating obesity, and the shortage of studies on weight bias among health professionals and students in Brazil, the aim of this study was to assess the existence of bias toward obese individuals among nutrition students, based on an analysis of the influence of individual body weight on nutritional practices, perceptions, and evaluation of health aspects in a hypothetical case of lactose intolerance (a problem clinically unrelated to nutritional status).

Methods

The study was part of the project Nutritionists’ Health Study - NutriHS of the School of Public Health, University of São Paulo (FSP/USP), Brazil. Details of the objectives and methods have been published elsewhere 3232. Folchetti LD, Silva IT, Almeida Pititto B, Ferreira SR. The e-NutriHS: a web-based system for a Brazilian cohort study. Stud Health Technol Inform 2015; 216:876..

The study was announced to undergraduate nutrition students enrolled in public and private schools and universities in the State of São Paulo, after approval by the institutions and via Internet, social networks, and the FSP/USP website. Inclusion criteria were age 18 to 40 years and current enrollment in undergraduate nutrition. The NutriHS research project was approved by the Institutional Review Board and complied with the guidelines of Resolution n. 196/1996 of the Brazilian National Health Council 3333. Conselho Nacional de Saúde. Resolução nº 196 de 10 de outubro de 1996. Diretrizes e normas regulamentadoras de pesquisa envolvendo seres humanos. Diário Oficial da União 1996; 16 out., and participants consented on-line to participate before they initiated completion of the study instruments.

The sample size was calculated with a size effect of 15% and 80% power, resulting in a sample of 218. An additional 15% was included to cover possible losses, totaling 251 students.

By accessing the study online, students completed the demographic data (sex, date of birth, skin color, undergraduate school year, marital status, father’s or guardian’s level of schooling, family income, type of teaching institution), self-reported weight and height, and other life history data. Anthropometric data were used to classify their nutritional status according to body mass index or BMI (weight/height²), as per World Health Organization guidelines 3434. World Health Organization. Global database on Body Mass Index. http://apps.who.int/bmi/index.jsp?introPage=intro_3.html (acessado em 03/Set/2013).
http://apps.who.int/bmi/index.jsp?introP...
.

Attitudes toward obesity were assessed by answers to hypothetical case studies of patients referred to a nutritionist after receiving a diagnosis of lactose intolerance, adapted from Puhl et al. 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.. Questions included indication of procedures and approaches during the consultation, consultation time, counseling strategies and/or orientation offered to the patient, evaluation of the patient’s diet and health, and affective and behavioral reactions toward patients, using questions adapted from studies by Campbell & Crawford 3535. Campbell K, Crawford D. Management of obesity: attitudes and practices of Australian dietitians. Int J Obes Relat Metab Disord 2000; 24:701-10., Hebl & Xu 3636. Hebl MR, Xu J. Weighing the care: physicians' reactions to the size of a patient. Int J Obes Relat Metab Disord 2001; 25:1246-52., Harvey et al. 2121. Harvey EL, Summerbell CD, Kirk SFL, Hill AJ. Dietitians' views of overweight and obese people and reported management practices. J Hum Nutr Diet 2002; 15:331-47., and Foster et al. 3737. Foster GD, Wadden TA, Makris AP, Davidson D, Sanderson RS, Alisson DB, et al. Primary care physicians' attitudes about obesity and its treatment. Obes Res 2003; 11:1168-77..

The main purpose of the study - to assess the existence de bias toward obese individuals - was not disclosed to the students, since it might have influenced the results. The program that housed the on-line survey randomly selected one out of four hypothetical cases for each participant: (1) normal weight man (BMI = 23kg/m2); (2) normal weight woman (BMI = 23kg/m2); (3) obese man (BMI = 31kg/m2); and (4) obese woman (BMI = 31kg/m2). The profiles of the four cases provided demographic and anthropometric data, laboratory test results, blood pressure, dietary data, and life habits (sleep and physical activity) - with normal values according to the prevailing guidelines. With the exception of weight, BMI, and daily energy intake (which only differed between females and males), all the information was identical for the profiles of the same sex (Table 1).

Table 1
Demographic and anthropometric data, laboratory results, blood pressure, diet, and life habits of four hypothetical cases of patients presented to undergraduate nutrition students. NutriHS Study, Brazil, 2015.

The answer to consultation time was given in minutes spent in the first consultation with the hypothetical patient. For the procedures, approaches, and counseling strategies and/or orientation, the students were instructed to check the ones they would use in the hypothetical situation, among the various possibilities listed in the questionnaire (they could check as many procedures and approaches as they felt necessary, assessed according to the frequency of the choice among the students).

Evaluation of the patient’s diet and health in the items on quality of diet, overall health status, and energy intake used a five-point scale (1 - very bad; 2 - bad; 3 - fair; 4 - good; and 5 - excellent). In these items, the goal was to analyze whether the patient’s weight would negatively influence the recommended approaches and evaluation of the patient’s health status, even if the data suggested healthy life habits, which would denote prejudgment by students based on the only characteristic that differed between the cases, namely body weight, an important dimension of weight bias.

The reactions and perceptions toward the patient were assessed with questions concerning the extent to which the students believed in the food intake as reported by the patient, health-related perceptions, self-care, and discipline, seriousness of the health problem, the patient’s expectations concerning the consultation, and the need for referral to psychological follow-up. The choices in a five-point scale were (1 - not at all; 2 - very little; 3 - a little; 4 - a lot; and 5 - extremely). These questions explored the student’s feelings, beliefs, and attitudes toward the obese individual.

Statistical analysis

Random distribution of the hypothetical cases (1 - normal-weight woman; 2 - obese woman; 3 - normal-weight man; 4 - obese man) among the students was tested with the chi-square test. There was no statistically significant difference in random distribution of the hypothetical cases (N1 = 82, N2 = 93, N3 = 80, and N4 = 80) among the students (χ2 = 0.707), and no differences were identified in the students’ characteristics (age, BMI, race, family income, undergraduate year) according to the randomly selected hypothetical case.

Comparison of the students’ answers on the patient’s consultation time (in minutes) was analyzed by means and standard deviations. Evaluation of health status, quality of diet, and energy intake, plus reactions and perceptions toward patients (on scales from 1 to 5) are ordinal variables, but they were also assessed by means and standard deviations. Comparison of the answers concerning magnitude of the evaluation or agreement used comparative analyses of the mean of the four cases, with the Kruskal-Wallis test followed by the multiple comparisons test to identify differences.

For the variables “procedures and approaches” and “treatment strategies”, the frequencies of “yes” answers were compared between the four cases, analyzed by Fisher’s exact test.

The analyses were performed with SPSS 17.0 (SPSS Inc., Chicago, USA), with significant set at 5%.

Results

Participation totaled 335 students, the majority women (93.7%), mean age 23.5 years (standard deviation - SD = 4.9), 65.1% white, 86.6% single, 32.8% for whom the head-of-family had a complete secondary education, 58.2% with family income between one and five times the minimum wage, 78.5% (n = 263) enrolled in private institutions, 39.7% (n = 133) enrolled in the 1st undergraduate year. 20.9% (n = 70) in the 2nd year, 18.5% (n = 62) in the 3rd year, 17.3% (n=58) in the 4th year, and 3.6% (n = 12) in the 5th year (only one university offered an undergraduate nutrition course lasting five years).

Mean BMI was 23 kg/m² (22.9kg/m² in females and 24.8kg/m² in males), the majority (66.4%) with normal weight, followed by overweight (20.7%), low weight (7.5%), and obesity (5.4%).

Table 2 shows the answers to the hypothetical patient cases (1 - normal-weight woman; 2 - obese woman; 3 - normal-weight man; and 4 - obese man) in relation to consultation time, patient evaluation, and student’s reactions.

Table 2
Answers by undergraduate nutrition students (N = 335) concerning consultation time, evaluation, reactions, and perceptions in relation to a hypothetical patient. NutriHS Study, Brazil, 2015.

The consultation time reported by students for obese patients of both sexes was longer than in normal-weight female patients, but not in relation to normal-weight male patients.

Evaluation of female patients’ dietary quality was worse for obese female patients, while there was no difference between obese and normal-weight males; however, the evaluation of normal-weight male patients’ dietary quality was significantly better than for obese female patients.

Evaluation of the amount of energy intake and overall health status was also worse for obese female patients when compared with normal-weight female patients, and the same was true for obese men compared to normal-weight men. There was no difference in the evaluation of these factors between obese patients.

The perception of self-reported food consumption was only worse for obese female patients, while there was no difference in male patients. However, the evaluation of obese women was also worse than both normal-weight and obese men. The nutrition students also manifested worse perceptions of obese versus normal-weight female patients in relation to “staying healthy”, self-care, and discipline, but the same was not true for male patients.

On questions 5, 9, and 10, the students stated that they would need to be stricter and more patient with obese patients and that they would feel more bothered by obese patients when compared to normal-weight patients of both sexes (Table 2).

When compared to normal-weight patients of both sexes, the nutrition students showed a worse perception of obese male patients on the question, “To what extent do you believe this patient will follow your nutritional recommendations?”. There was no difference between obese and normal-weight female patients on this question. On question 13, students thought that obese female patients would benefit more from psychological follow-up, when compared to normal-weight females and normal-weight and obese male patients (Table 2).

Table 3 shows the answers on procedures and approaches that the students would adopt with the hypothetical patients.

Table 3
Frequency of procedures and approaches that undergraduate nutrition students (N = 335) would adopt during the first consultation with a randomly selected hypothetical patient. NutriHS Study, Brazil, 2015.

Students that responded to hypothetical cases involving obese patients (of both sexes) were more likely to plan to “explore the patient’s weight history” and “discuss the need to lose weight”. There was no difference between cases in the other procedures and approaches (Table 3).

Table 4 shows the treatment strategies recommended by students for the hypothetical cases.

In relation to recommendation of treatment strategies, the students that responded to hypothetical cases of obese patients (of both sexes) were more likely to use the strategies “keeping a food diary with information on perceived hunger” and “orientation to reduce calorie intake and consume less caloric foods”. However, they would recommend the strategy of “individual follow-up” more often for obese men than for obese women (Table 4).

Table 4
Frequency of treatment strategies that undergraduate nutrition students (N = 335) would recommend during the first consultation with a randomly selected hypothetical patient. NutriHS Study, Brazil, 2015.

Discussion

To our knowledge this is the first study in Brazil to explore weight bias in nutrition students. By addressing students’ approaches and perceptions in relation to hypothetical cases, we found that the patient’s weight influenced the time spent in the initial consultation, the evaluations of diet quality, amount of energy intake, and overall health status, perceptions and attitudes, and treatment approaches and strategies.

Importantly, the hypothetical patients came to the mock consultation with a recent diagnosis of lactose intolerance, a problem bearing no relationship to nutritional status. Thus, the findings corroborate a real difference in case management according to the patient’s weight, since all the other parameters were identical and bore no relationship to the diagnosis of lactose intolerance.

The sample of nutrition students consisted mainly of females, normal-weight, single, white, with family income from one to five times the minimum wage, enrolled in private institution, and mostly enrolled in the first and second undergraduate years in nutrition. The undergraduate course in nutrition traditionally consists mostly of female students. Other studies in undergraduate nutrition students (to investigate various issues) found more than 80% of women 3838. Souza QJOV, Rodrigues AM. Comportamento de risco para ortorexia nervosa em estudantes de nutrição. J Bras Psiquiatr 2014; 63:200-4.,3939. Baraldi S, Bampi LNS, Pereira MF, Guilhem DB, Mariath AB, Campos ACO. Avaliação da qualidade de vida de estudantes de nutrição. Trab Educ Saúde 2015; 13:515-31., and some studies used gender as an exclusion criterion due to the overwhelming majority of female students 4040. Silva JD, Silva ABJ, Oliveira AVK, Nemer ASA. Influência do estado nutricional no risco para transtornos alimentares em estudantes de nutrição. Ciênc Saúde Coletiva 2012; 17:3399-406.,4141. Bosi MLM, Luiz RR, Morgado CMC, Costa MLS, Carvalho RJ. Autopercepção da imagem corporal entre estudantes de nutrição: um estudo no Município do Rio de Janeiro. J Bras Psiquiatr 2006; 55:108-13..

In their answers to the randomly distributed cases, students took more time on average in consultations with obese women (51 minutes) than with normal-weight women, but this difference was not seen with male patients. According to a study by Harvey et al. 2121. Harvey EL, Summerbell CD, Kirk SFL, Hill AJ. Dietitians' views of overweight and obese people and reported management practices. J Hum Nutr Diet 2002; 15:331-47. in English nutritionists, the mean consultation time at the first visit did not differ between overweight and obese patients (about 35 minutes). On the other hand, according to the study by Hebl & Xu 3636. Hebl MR, Xu J. Weighing the care: physicians' reactions to the size of a patient. Int J Obes Relat Metab Disord 2001; 25:1246-52. in American physicians, consultation time was shorter for overweight (25 minutes) and obese patients (22 minutes) than for normal-weight patients (31 minutes). Using more time in an initial consultation with an obese individual can be positive, since it may mean greater attention, opportunities for interaction, and more individualized care, but it could also mean that students consider obese patients more complex than normal-weight patients, thus requiring more time. The complexity of eating is not related to the individual’s weight, but to the way people live their experiences and their relationship with food.

The students’ evaluation of obese patients’ diet strongly suggests the presence of bias. They expressed a worse assessment of the quality of diet, amount of energy intake, and overall health status of obese female patients when compared to normal-weight female patients, besides worse assessment of energy intake and health status in obese men. This finding is highly relevant, since the evaluations of obese patients were worse even when the objective data on life habits, calorie intake, and dietary characteristics were identical to those of normal-weight patients. The result indicates that the nutrition students draw conclusions automatically when in contact with an obese patient and reinforces the theory that healthcare professionals equate the obese individual with certain negative stereotypes 3131. Cori GC, Petty MLB, Alvarenga MS. Atitudes de nutricionistas em relação a indivíduos obesos - um estudo exploratório. Ciênc Saúde Coletiva 2015; 20:9-20.,3737. Foster GD, Wadden TA, Makris AP, Davidson D, Sanderson RS, Alisson DB, et al. Primary care physicians' attitudes about obesity and its treatment. Obes Res 2003; 11:1168-77.,4242. Brown I. Nurses' attitudes towards adult patients who are obese: literature review. J Adv Nurs 2006; 53:221-32.. Likewise, Puhl et al. 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44. found that American nutrition students gave a worse assessment to the same aspects in obese patients when compared to normal-weight patients (except for energy intake in obese women).

To assume that an individual is unhealthy or fails to adopt healthy life habits because of their body weight is a form of bias that can interfere in the health professional’s approach to the obese patient. Although obesity is related to various comorbidities, there are situations in which it bears no relationship to metabolic complications, as demonstrated by recent studies on metabolically healthy obese individuals 4343. Després JP. What is "metabolically healthy obesity"?: from epidemiology to pathophysiological insights. J Clin Endocrinol Metab 2012; 97:2283-5.,4444. Hamer M, Stamatakis E. Metabolically healthy obesity and risk of all-cause and cardiovascular disease mortality. J Clin Endocrinol Metab 2012; 97:2482-8.,4545. Denis GV, Obin MS. 'Metabolically healthy obesit': origins and implications. Mol Aspects Med 2013; 34:59-70.,4646. Berezina A, Belvaeva O, Berkovich O, Baranova E, Karonova T, Bazhenova E, et al. Prevalence risk factors, and genetic traits in metabolically healthy and uhealthy obese individuals. Biomed Res Int. 2015.,4747. Ruiz JR, Labayen I, Ortega FB. Letter to the editor: metabolically healthy (and fit?) obesity. J Clin Endocrinol Metab 2017; 102:1084-5..

As regards students’ reactions and perceptions, our study showed that they believe less in the food consumption reported by obese female patients than by any other patients, suggesting an influence not only from weight, but also from the patient’s gender. The students’ worse evaluations of the amount of energy intake (“Do you believe the patient’s reported food intake?”) for obese patients could also be associated with disbelief in the reported food intake, but this was only confirmed in female patients. In fact, there are studies that associate greater occurrence of underreporting of energy intake among women 4848. Tomoyasu NJ, Toth MJ, Poehlman ET. Misreporting of total energy intake in older men and women. J Am Geriatr Soc 1999; 47:710-5.,4949. Scagliusi FB, Lancha Jr. AH. Subnotificação da ingestão energética na avaliação do consumo alimentar. Rev Nutr 2003; 16:471-81. and even among obese individuals 5050. Taren DL, Tobar M, Hill A, Howell W, Shisslak C, Bell I, et al. The association of energy intake bias with psychological scores of women. Eur J Clin Nutr 1999; 53:570-8.,5151. Mendez MA, Wynter S, Wilks R, Forrester T. Under- and overreporting of energy is related to obesity, lifestyle factors and food group intakes in Jamaican adults. Public Health Nutr 2004; 7:9-19.. But it is worthwhile considering that both women in general and obese individuals are more subject to preoccupation with the body and weight and practicing restrictive diets - aspects that also increase the susceptibility to underreporting 4949. Scagliusi FB, Lancha Jr. AH. Subnotificação da ingestão energética na avaliação do consumo alimentar. Rev Nutr 2003; 16:471-81. - and that factors like age, desire for social acceptance, ethnicity, diet, and education also affect this phenomenon 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44..

Likewise, the students also gave a more negative assessment to “how healthy” the person was, “self-care”, and “discipline” in the obese female patient when compared to the normal-weight female, but the same was not true for obese men. Hebl & Xu 3636. Hebl MR, Xu J. Weighing the care: physicians' reactions to the size of a patient. Int J Obes Relat Metab Disord 2001; 25:1246-52. also found worse perceptions among physicians toward overweight and obese patients on the three items, but they did not investigate the impact of gender.

Interestingly, the current study’s sample consisted mainly of female students, and obese female patients generated worse perception on their part when compared to normal-weight female patients, but the same was not true for male patients. The reasons for such findings are not clear, but they may be related to gender issues, excessive preoccupation with body shape, and adherence to weight-loss diets, all frequent experiences in women 5252. Germov J, Williams L. The epidemic of dieting women: the need for a sociological approach to food and nutrition. Appetite 1996; 27:97-108.. Historically, women were associated with consuming little food, attributed to the fact that food was the only terrain considered “legitimately female”, besides the existence of canons for the female body and beauty standards; even in historical times when such standards were associated with more curvaceous bodies, they placed greater value on the body’s proportions and not on excessive fat 5353. Asfora W. Comer como um passarinho, cozinhar como uma feiticeira: a herança edênica na construção da relação entre gênero e comida. Cadernos Pagu 2012; 39:431-45.. According to Menucci et al. 5454. Menucci LS, Timerman F, Alvarenga MS. Como a subjetividade influencia o comportamento alimentar? In: Alvarenga MS, Antonaccio CMA, Timerman F, Figueiredo M, organizadores. Nutrição comportamental. Barueri: Edições Manole; 2015. p. 51-68., the feeling of inappropriateness, inadequacy, and individual guilt vis-à-vis ideals of beauty and the unattainable body images propagated by the mass media constitute a strategy of domination and diminishment through the devaluation of bodies, of which women are the greatest victims. The students also felt that they would need to be stricter with obese patients of both sexes, besides feeling that such patients would be more “bothersome/tedious/annoying” and that they would need more patience to deal with them. Such findings are problematic, because in professional practice, obese individuals could feel judged, and that a stricter and more unyielding stance could affect treatment negatively, thus undermining adherence.

The students were also less inclined to believe that obese men would follow their nutritional recommendations. This finding is curious, since some studies have associated male gender with lower treatment dropout rates 5555. García-Galbis MR, Castell EC, Baeza MR, Hervás AG. The variability in adherence to dietary treatment and quality of weight loss: overweight and obesity. Nutr Hosp 2015; 31:2017-24.. Presnell et al. 5656. Presnell K, Pells J, Stout A, Musante G. Sex differences in the relation of weight loss self-efficacy, binge eating, and depressive symptoms to weight loss success in a residential obesity treatment program. Eat Behav 2008; 9:170-80., in a study of predictive factors for weight loss, found that men demonstrated self-efficacy (considered themselves more capable of changing life habits) before the intervention, besides displaying fewer depressive symptoms and less binge eating than women (factors related to greater weight loss).

Women are usually considered more prone to emotional and affective interferences in the weight loss process 5757. Orbach S. Fat is a feminist issue. New York: Paddington Press; 1978., corroborated by the students’ perception that obese female patients would benefit more than any other patients from psychological follow-up. In Hebl & Xu 3636. Hebl MR, Xu J. Weighing the care: physicians' reactions to the size of a patient. Int J Obes Relat Metab Disord 2001; 25:1246-52., physicians also referred overweight and obese patients more often to psychological care when compared to normal-weight patients, but they did not analyze the difference between sexes.

The other reactions and perceptions toward the seriousness of the hypothetical health problem (lactose intolerance) - such as “considering the patient consultation a waste of time”, “professional satisfaction”, and “extent of personal desire to help the patient and optimism” - were similar for obese and normal-weight patients, corroborating findings by Puhl et al. 88. Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44..

There were few differences in the recommended procedures, approaches, and treatment strategies. The students highlighted “exploring the patient’s weight history” and “discussing the need to lose weight” more often for obese patients of both sexes than for normal-weight patients, suggesting that even when the patient seeks nutritional treatment for other reasons (e.g., lactose intolerance), body weight becomes a key focus of the consultation 5858. Puhl RM, Brownell KD. Bias, discrimination, and obesity. Obes Res 2001; 9:788-805.. Besides, the importance of exploring weight history is not limited to obese patients, since normal-weight patients can present relevant variations in body weight.

Interestingly, more than 20% of the students reported discussing the need to lose weight and 35% recommended lower calorie intake even in normal-weight patients. This finding may relate to their understanding of the nutritionist’s role as “promoting weight loss” and “prescribing restrictive diets”. In a Brazilian qualitative study with healthcare professionals in the Family Health Strategy, some professionals voiced a rather narrow view of the nutritionist with such phrases as “a nutritionist is a professional who prescribes dieting” or “the nutritionist is for losing weight” and “the nutritionist controls patients’ diets” 5959. Camossa ACA, Telarolli Jr. R, Machado MLT. O fazer teórico-prático do nutricionista na Estratégia Saúde da Família: representações sociais dos profissionais das equipes. Rev Nutr 2012; 25:89-106..

The students also mentioned “keeping a food diary with information on hunger” and “orientation to reduce calorie intake” more often for obese patients of both sexes. A food diary recording perception of hunger is an interesting strategy for any individual with interest in or need to change their food habits, and not only for obese individuals 6060. Alvarenga MS, Polacow VO, Scagliusi FB. Dieta e seus efeitos no comportamento alimentar. In: Alvarenga MS, Figueiredo M, Timerman F, Antonaccio CMA, organizadores. Nutrição comportamental. Barueri: Edições Manole; 2015. p. 69-100.. The finding may be related to the students’ belief that obese patients are more “compulsive” and that they invariably eat worse.

Finally, the students recommended individual follow-up more frequently for obese men and less for obese women in comparison to their normal-weight gender peers. Since the study sample consisted mainly of female nutrition students, why would they recommend individual follow-up less for women than for men?

In short, patient’s weight influenced consultation time and students’ perceptions, approaches, and treatment strategies, with the identification of biases and negative attitudes mainly related to the future nutritionists’ perceptions and reactions toward obese patients, where obese women received the worst evaluations in general. Furthermore, the evaluation of weight’s influence on the students’ perceptions and approaches evidenced not only their bias toward obese individuals, but that such bias was even greater in the case of female patients. The stigma thus involves both weight and gender.

Although this was the first study of its kind in Brazil and it used an adequate sample size, it only evaluated university students in the state of São Paulo, enrolled in different undergraduate years. The NutriHS survey was also conducted on-line, so the answers to specific questions had a limited number of choices. Considering that the study used questionnaires and scales with the answers, one should consider the risk of desire for social acceptance, with answers given according to what the respondent thought was expected or most appropriate 6161. Scagliusi FB, Cordás TA, Polacow VO, Coelho D, Alvarenga M, Philippi ST, et al. Tradução da escala de desejo de aceitação social de Marlowe & Crowne para a língua portuguesa. Rev Psiquiatr Clín 2004; 31:272-8.. Other study designs could be useful for elucidating how attitudes toward obese individuals and obesity evolve over the course of undergraduate years or potentially undergo changes following interventions to reduce negative attitudes and bias.

Conclusion

Weight bias in relation to obese individuals exists among undergraduate nutrition students in this sample in São Paulo, corroborating international studies. Gender also influenced students’ perceptions, and the evaluations and attitudes were worse for obese female patients compared to obese males. Since a hypothetical patient’s body weight influences the perception and evaluation of their health and therapeutic approaches, the topic of bias, stigma, and discrimination toward obese individuals and obesity should be included in the undergraduate curriculum in nutrition, besides including it in continuing education for healthcare professionals.

Acknowledgments

The authors wish to thank the undergraduate students in nutrition who participated in the study.

References

  • 1
    World Health Organization. Obesity: preventing and managing the global epidemic. Report of a WHO consultation on obesity. Geneva: World Health Organization; 1999. (WHO Technical Report Series, 894),
  • 2
    World Health Organization. Global status report on noncommunicable diseases, 2010. Geneva: World Health Organization; 2011.
  • 3
    Daníelsdóttir S, O'Brien KS, Ciaoc A. Anti-fat prejudice reduction: a review of published studies. Obes Facts 2010; 3:47-58.
  • 4
    Macpherson-Sánchez AE. Integrating fundamental concepts of obesity and eating disorders: implications for the obesity epidemic. Am J Public Health 2015; 105:e71-85.
  • 5
    Goffman E. Stigma: notes on the management of spoiled identity. New York: Symon and Schuster Inc.; 1963.
  • 6
    Schwartz MB, Chambliss HO, Brownell KD, Blair SN, Billington C. Weight bias among health professionals specializing in obesity. Obes Res 2003; 11:1033-9.
  • 7
    Puhl RM, Latner J. Weight bias: new science on an significant social problem. Obesity (Silver Spring) 2008; 16 Suppl 2:S1-2.
  • 8
    Puhl RM, Wharton C, Heuer CA. Weight bias among dietetics students: implications for treatment practices. J Am Diet Assoc 2009; 109:438-44.
  • 9
    Swift JA, Hanlon S, El-Redy L, Puhl RM, Glazebrook C. Weight bias among UK trainee dietitians, doctors, nurses and nutritionists. J Hum Nutr Diet 2012; 26:395-402.
  • 10
    Lee M, Ata RN, Brannick MT. Malleability of weight-biased attitudes and beliefs: a meta-analysis of weight bias reduction interventions. Body Image 2014; 11:251-9.
  • 11
    Puhl RM, Latner JD, O'Brien K, Luedicke J, Danielsdottir S, Forhan M. A multinational examination of weight bias: predictors of anti-fat attitudes across four countries. Int J Obes (Lond) 2015; 39:1166-73.
  • 12
    Tomiyama AJ, Finch LE, Belsky ACI, Buss J, Finley C, Schwartz MB, et al. Weight bias in 2001 versus 2013: contradictory attitudes among obesity researchers and health professionals. Obesity 2015; 23:46-53.
  • 13
    Andreyeva T, Puhl RM, Brownell KD. Changes in perceived weight discrimination among Americans, 1995-1996 through 2004-2006. Obesity 2008; 16:1129-34.
  • 14
    Puhl RM, Heuer CA. Obesity stigma: important considerations for public health. Am J Public Health 2010; 100:1019-28.
  • 15
    Vartanian LR, Smyth JM. Primum non nocere: obesity stigma and public health. J Bioeth Inq 2013; 10:49-57.
  • 16
    Abuh-Odeh D. Fat stigma and the public health: a theoretical framework and ethical analysis. Kennedy Inst Ethics J 2014; 24:247-65.
  • 17
    O'Brien KS, Puhl RM, Latner JD, Mir AS, Hunter JA. Reducing anti-fat prejudice in preservice health students: a randomized trial. Obesity 2010; 18:2138-44.
  • 18
    Pearl RL, Wadden TA, Hopkins CM, Shaw JA, Hayes MR, Bakizada ZM, et al. Association between weight bias internalization and metabolic syndrome among treatment-seeking individuals with obesity. Obesity 2017; 25:317-22.
  • 19
    Puhl RM, Heuer CA. The stigma of obesity: a review and update. Obesity 2009; 17:941-64.
  • 20
    Oberrieder H, Walker R, Monroe D, Adeyanju M. Attitude of dietetics students and registered dietitians toward obesity. J Am Diet Assoc 1995; 95:914-6.
  • 21
    Harvey EL, Summerbell CD, Kirk SFL, Hill AJ. Dietitians' views of overweight and obese people and reported management practices. J Hum Nutr Diet 2002; 15:331-47.
  • 22
    Berryman DE, Dubale GM, Manchester DS, Mittelstaedt R. Dietetics students possess negative attitudes toward obesity similar to nondietetics students. J Am Diet Assoc 2006; 106:1678-82.
  • 23
    Wigton RS, McGaghie WC. The effect of obesity on medical students' approach to patients with abdominal pain. J Gen Intern Med 2001; 16:262-5.
  • 24
    Persky S, Eccleston CP. Medical student bias and care recommendations for an obese versus non-obese virtual patient. Int J Obes (Lond) 2011; 35:728-35.
  • 25
    Mattos RS, Luz MT. Sobrevivendo ao estigma da gordura: um estudo socioantropológico sobre obesidade. Physis (Rio J.) 2009; 19:489-507.
  • 26
    Pinto MS, Bosi MLM. Muito mais do que pe(n)sam: percepções e experiências acerca da obesidade entre usuárias da rede pública de saúde de um município do Nordeste do Brasil. Physis (Rio J.) 2010; 20:443-57.
  • 27
    Cruz CAG, Bastos LC. Histórias de uma obesa: a teoria dos posicionamentos e a (re)construção discursiva das identidades. Linguagem em (Dis)curso 2015; 15:367-84.
  • 28
    Gonçalves H, Dumith SC, González DA, Menezes AMB, Araújo CLP, Hallal PC, et al. Discriminação autorrelatada por adolescentes de uma coorte de nascimentos brasileira: prevalência e associações. Rev Panam Salud Pública 2012; 31:204-10.
  • 29
    Teixeira FV, Pais-Ribeiro JL, Maia ARPC. Crenças e práticas dos profissionais de saúde face à obesidade: uma revisão sistemática. Rev Assoc Med Bras (1992) 2012; 58:254-62.
  • 30
    Grejanin DKM, Pezzo TH, Nastri V, Sanches VPP, Nascimento DDG, Quevedo MP. As percepções sobre o "ser obeso" sob a ótica do paciente e dos profissionais de saúde. Rev Bras Crescimento Desenvolv Hum 2007; 17:37-47.
  • 31
    Cori GC, Petty MLB, Alvarenga MS. Atitudes de nutricionistas em relação a indivíduos obesos - um estudo exploratório. Ciênc Saúde Coletiva 2015; 20:9-20.
  • 32
    Folchetti LD, Silva IT, Almeida Pititto B, Ferreira SR. The e-NutriHS: a web-based system for a Brazilian cohort study. Stud Health Technol Inform 2015; 216:876.
  • 33
    Conselho Nacional de Saúde. Resolução nº 196 de 10 de outubro de 1996. Diretrizes e normas regulamentadoras de pesquisa envolvendo seres humanos. Diário Oficial da União 1996; 16 out.
  • 34
    World Health Organization. Global database on Body Mass Index. http://apps.who.int/bmi/index.jsp?introPage=intro_3.html (acessado em 03/Set/2013).
    » http://apps.who.int/bmi/index.jsp?introPage=intro_3.html
  • 35
    Campbell K, Crawford D. Management of obesity: attitudes and practices of Australian dietitians. Int J Obes Relat Metab Disord 2000; 24:701-10.
  • 36
    Hebl MR, Xu J. Weighing the care: physicians' reactions to the size of a patient. Int J Obes Relat Metab Disord 2001; 25:1246-52.
  • 37
    Foster GD, Wadden TA, Makris AP, Davidson D, Sanderson RS, Alisson DB, et al. Primary care physicians' attitudes about obesity and its treatment. Obes Res 2003; 11:1168-77.
  • 38
    Souza QJOV, Rodrigues AM. Comportamento de risco para ortorexia nervosa em estudantes de nutrição. J Bras Psiquiatr 2014; 63:200-4.
  • 39
    Baraldi S, Bampi LNS, Pereira MF, Guilhem DB, Mariath AB, Campos ACO. Avaliação da qualidade de vida de estudantes de nutrição. Trab Educ Saúde 2015; 13:515-31.
  • 40
    Silva JD, Silva ABJ, Oliveira AVK, Nemer ASA. Influência do estado nutricional no risco para transtornos alimentares em estudantes de nutrição. Ciênc Saúde Coletiva 2012; 17:3399-406.
  • 41
    Bosi MLM, Luiz RR, Morgado CMC, Costa MLS, Carvalho RJ. Autopercepção da imagem corporal entre estudantes de nutrição: um estudo no Município do Rio de Janeiro. J Bras Psiquiatr 2006; 55:108-13.
  • 42
    Brown I. Nurses' attitudes towards adult patients who are obese: literature review. J Adv Nurs 2006; 53:221-32.
  • 43
    Després JP. What is "metabolically healthy obesity"?: from epidemiology to pathophysiological insights. J Clin Endocrinol Metab 2012; 97:2283-5.
  • 44
    Hamer M, Stamatakis E. Metabolically healthy obesity and risk of all-cause and cardiovascular disease mortality. J Clin Endocrinol Metab 2012; 97:2482-8.
  • 45
    Denis GV, Obin MS. 'Metabolically healthy obesit': origins and implications. Mol Aspects Med 2013; 34:59-70.
  • 46
    Berezina A, Belvaeva O, Berkovich O, Baranova E, Karonova T, Bazhenova E, et al. Prevalence risk factors, and genetic traits in metabolically healthy and uhealthy obese individuals. Biomed Res Int. 2015.
  • 47
    Ruiz JR, Labayen I, Ortega FB. Letter to the editor: metabolically healthy (and fit?) obesity. J Clin Endocrinol Metab 2017; 102:1084-5.
  • 48
    Tomoyasu NJ, Toth MJ, Poehlman ET. Misreporting of total energy intake in older men and women. J Am Geriatr Soc 1999; 47:710-5.
  • 49
    Scagliusi FB, Lancha Jr. AH. Subnotificação da ingestão energética na avaliação do consumo alimentar. Rev Nutr 2003; 16:471-81.
  • 50
    Taren DL, Tobar M, Hill A, Howell W, Shisslak C, Bell I, et al. The association of energy intake bias with psychological scores of women. Eur J Clin Nutr 1999; 53:570-8.
  • 51
    Mendez MA, Wynter S, Wilks R, Forrester T. Under- and overreporting of energy is related to obesity, lifestyle factors and food group intakes in Jamaican adults. Public Health Nutr 2004; 7:9-19.
  • 52
    Germov J, Williams L. The epidemic of dieting women: the need for a sociological approach to food and nutrition. Appetite 1996; 27:97-108.
  • 53
    Asfora W. Comer como um passarinho, cozinhar como uma feiticeira: a herança edênica na construção da relação entre gênero e comida. Cadernos Pagu 2012; 39:431-45.
  • 54
    Menucci LS, Timerman F, Alvarenga MS. Como a subjetividade influencia o comportamento alimentar? In: Alvarenga MS, Antonaccio CMA, Timerman F, Figueiredo M, organizadores. Nutrição comportamental. Barueri: Edições Manole; 2015. p. 51-68.
  • 55
    García-Galbis MR, Castell EC, Baeza MR, Hervás AG. The variability in adherence to dietary treatment and quality of weight loss: overweight and obesity. Nutr Hosp 2015; 31:2017-24.
  • 56
    Presnell K, Pells J, Stout A, Musante G. Sex differences in the relation of weight loss self-efficacy, binge eating, and depressive symptoms to weight loss success in a residential obesity treatment program. Eat Behav 2008; 9:170-80.
  • 57
    Orbach S. Fat is a feminist issue. New York: Paddington Press; 1978.
  • 58
    Puhl RM, Brownell KD. Bias, discrimination, and obesity. Obes Res 2001; 9:788-805.
  • 59
    Camossa ACA, Telarolli Jr. R, Machado MLT. O fazer teórico-prático do nutricionista na Estratégia Saúde da Família: representações sociais dos profissionais das equipes. Rev Nutr 2012; 25:89-106.
  • 60
    Alvarenga MS, Polacow VO, Scagliusi FB. Dieta e seus efeitos no comportamento alimentar. In: Alvarenga MS, Figueiredo M, Timerman F, Antonaccio CMA, organizadores. Nutrição comportamental. Barueri: Edições Manole; 2015. p. 69-100.
  • 61
    Scagliusi FB, Cordás TA, Polacow VO, Coelho D, Alvarenga M, Philippi ST, et al. Tradução da escala de desejo de aceitação social de Marlowe & Crowne para a língua portuguesa. Rev Psiquiatr Clín 2004; 31:272-8.

Publication Dates

  • Publication in this collection
    20 Aug 2018

History

  • Received
    23 May 2017
  • Reviewed
    21 Nov 2017
  • Accepted
    18 Dec 2017
Escola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz Rio de Janeiro - RJ - Brazil
E-mail: cadernos@ensp.fiocruz.br