ARTIGO ARTICLE

 

Sources of variation of energy and nutrient intake among adolescents in São Paulo, Brazil

 

Fontes de variação da ingestão de energia e nutrientes entre adolescentes do Município de São Paulo, Brasil

 

 

Eliseu Verly Junior; Regina Mara Fisberg; Chester Luis Galvão Cesar; Dirce Maria Lobo Marchioni

Faculdade de Saúde Pública, Universidade de São Paulo, São Paulo, Brasil

Correspondence

 

 


ABSTRACT

The aim of the current study was to describe the sources of variation of energy and nutrient intake and to calculate the number of repetitions of diet measurements to estimate usual intake in adolescents from São Paulo, Brazil. Data was collected using 24-hour dietary recalls (24hR) in 273 adolescents between 2007 and 2008. Individuals completed a repeat 24hR around two months later. The sources of variation were estimated using the random effect model. Variance ratios (within-person to between-person variance ratio) and the number of repetitions of 24hR to estimate usual intake were calculated. The principal source of variation was due to within-person variance. The contribution of day of week and month of year was less than 8%. Variations ranged from 1.15 for calcium to 7.31 for vitamin E. The number of 24hR repeats required to estimate usual intake varied according to nutrient and gender, numbering 15 for males and 8 for females.

Eating; Energy Intake; Nutritional Epidemiology; Adolescent


RESUMO

Este estudo propôs-se a descrever as fontes de variação da ingestão de energia e nutrientes e calcular o número de dias necessários para a estimativa da ingestão habitual em adolescentes do Município de São Paulo, Brasil. Foi aplicado um recordatório alimentar de 24 horas (R24h) em 273 adolescentes, durante os anos de 2007 e 2008, e posteriormente cada indivíduo foi convidado a responder a outro R24h. Foram estimadas as fontes de variação da ingestão utilizando-se modelo de efeitos aleatórios. A variância intrapessoal foi o componente de variância que mais contribuiu para a variabilidade da ingestão de energia e nutrientes, ao passo que a contribuição do dia da semana e mês do ano foi pequena (< 8%) para a variabilidade total da ingestão. As razões de variância variaram de 1,15 para o cálcio a 7,31 para a vitamina E. O número de R24h necessário para estimar a ingestão habitual variou de acordo com o nutriente: em torno de 15 para o sexo masculino e 8 para o feminino.

Ingestão de Alimentos; Ingestão de Energia; Epidemiologia Nutricional; Adolescente


 

 

Introduction

Dietary information, collected using methods such as the 24-hour dietary recall (24hR) or food records, is extensively used in epidemiological studies for a number of different purposes including: (1) to estimate nutrient and energy intake 1; (2) to investigate the association between dietary patterns and health-related outcomes 2,3, and (3) to assess the performance of other methods, particularly the food frequency questionnaires (FFQ) 4.

For most epidemiological studies, usual intake, as opposed to intake on a single day or over the short-term, is the variable of interest. However, given that the 24hR and food records are highly sensitive to variations in day-to-day food intake, they are unable to provide a precise estimate of the usual intake of individuals or populations 5. An increase in overall intake variability as a result of variation in day-to-day consumption by an individual, i.e. intra-person variability, has been identified as a problem in the analysis and interpretation of dietary data 6,7. Studies which seek to calculate the prevalence of nutrient inadequacy without taking into account intra-person variance are likely to lead to biased results 1,8. Moreover, measures used to assess the diet-disease relationship such as regression coefficients and relative risk become attenuated 5,7,9. Increasing the number of the days of collection of dietary data these estimates become more accurate for each individual of the population 1,6. However, the number of collection days is determined according to the nutrient examined and the population studied 10.

Based on the ratio between intra- and inter-person variance (defined as the variance in consumption between one individual and another), it is possible to calculate the number of days needed to obtain usual intake for each nutrient 10. The estimates of intra- and inter-person variance can also be employed to correct the distribution of intake based on a single collection day, removing the effect of intra-personal variance and estimating usual intake for each nutrient 11,12. This represents a useful procedure, particularly given the high cost of conducting multiple 24hR collections in population-based studies.

Current data on intake variability of nutrients and energy are available for adults and the elderly in Canada 13,14 and Asian countries 15,16,17,18. Such studies in adolescents are rare however 19, with the only study of this kind conducted in Brazil being limited to macronutrient intake among adolescents of public schools in an interior municipal district of São Paulo 20. Since these components of variance are influenced by economic and social factors 7, the use of data obtained in other countries, whether applied in study planning or the analysis of dietary data, may not be appropriate.

Therefore, the aim of the present study was to describe the sources of variation in energy and nutrient intake, and to calculate the ratios of intra-person to inter-person variance in energy and nutrient intake, among adolescents from São Paulo. In addition, the number of days required to estimate usual intake of energy and nutrients was determined.

 

Methods

Study population

The adolescents who participated in the present study were recruited from a sample drawn from the project entitled Health Survey of São Paulo (ISA-Capital) conducted in 2003. The ISA-Capital was a transversal study devised to collect data on health status and access to health services, in addition to life habits, socio-economic levels and dietary conditions in a representative sample from São Paulo city. The sampling process entailed two stages: primary sampling units were census sectors, while secondary units were domiciles. Sampling selection was performed by grouping the sectors into three sub strata according to percentage of heads of households with University-level education: less than 5%, 5% to 24.9%, and 25% or greater. Eight sampling domains were defined by gender and age, for which equal numbers of interviews were planned: individuals aged younger than 1 year, 1 to 11 years, women aged 12 to 19 years, men from 12 to 19 years, men 20 to 59 years, women aged 20 to 59 years, men aged 60 years or older, and women aged 60 years or older.

An initial total of 813 adolescents were interviewed and those within the age bracket (younger than 20 years) at the start of data collection for the present study (March/2007) were invited to participate. This gave a sample of 412 adolescents, of whom 2.7% (n = 11) refused to take part, 15.3% (n = 63) had changed address and could not be located, and 15.3% (n = 65) were not home during three separate visits at different times and days of the week. The final sample therefore comprised 273 adolescents, 140 males and 133 females. The proportion of individuals in the three strata of schooling (head of household) in the initial sample did not differ between initial and final study samples (p = 0.19).

Data collection

The interviews were conducted at households by previously trained interviewers between 2007 and 2008. Food consumption data was collected using the 24hR method adopting the procedure recommended by Thompson & Byers 21. Intra-person intake variability was calculated by inviting all of the adolescents (n = 273) to answer another 24hR after an interval of approximately two months. The repeat data collection was carried out by telephone and the response rate was 57% (n = 80) and 62% (n = 83) for males and females, respectively. The median interval in days between the recalls was 68 days, with an interquartile interval of 35 days. The data collections, both at domiciles and by phone were carried out so as to cover all days of the week and months of the year. For the purpose of analysis, the days of the week were grouped into weekends (Friday, Saturday and Sunday) and week days (Monday to Thursday). Prior to keying in the food intake data gathered, the information contained in each data collection session were checked in order to monitor the quality of interviews and to define the standardization for quantity of foods and recipes of preparations reported.

Data analysis

Nutritional status was classified using the cut-off points for body mass index (BMI) by gender and age proposed by Cole et al 22. Reported consumption was converted into energy and nutrient values using the Nutrition Data System for Research - NDS -, 2007 version (Nutrition Coordinating Center, University of Minnesota, Minneapolis, USA) whose main database is the North American table of the United States Department of Agriculture (USDA Food and nutrition database for dietary studies 3.0. Beltsville, USA). Three nutrients were calculated based on their dietary equivalents: vitamin A (the sum of retinol and β-carotene equivalents) 23, niacin (the sum of niacin in mg and the quantity converted from tryptophan) 24 and folate (dietary folate equivalents) 24. For iron and folate, mandatory supplements in wheat and corn flour were considered, compulsory in Brazil since 2004.

Extreme intake values (outliers) were removed as described in the study by Thompson et al. 25 and the distribution of the intake of each nutrient was normalized using the box-cox transformation. The maximums of outliers removed were 5 for vitamin D (males) and 9 for vitamin K (females). The supposition of normality after transformation to normality was verified for each nutrient by the skewness-kurtosis test with a significance level of 5%. The ratio of intra- to inter-person variance was calculated for each nutrient by the formula and energy was estimated using the normalized data.

The sources of intake variance were: inter-person (variation between the intake of one individual and another); week day or weekend; month of the year; and intra-person (variation in day-to-day intake of the same individual). The data were analysed using the following random effects model 26,27,28:

where, μ: is mean nutrient and energy intake; individual: is the random variable representing intake variation among individuals; aj and bk: represents the random effects of day of the week and month of the year, respectively;: is the residual error representing intra-person variance. The intake of each nutrient was analyzed as a dependent variable using a model constructed for each gender. Variance components, namely, the percentage variation attributed to each factor, were obtained by estimating maximum likelihood, whereas variances were estimated using the XTMIXED routine of the Stata software, version 9.1 (Stata Corp., College Station, USA).

The formula by Black et al. was used to calculate the number of days needed to estimate subjects' usual intake. 10:

where, D: is number of collection days needed; : is the ratio of intra- to inter-person variance; and r: is the hypothetical correlation between actual and observed intake of nutrients, in this case assumed to be 0.9. Subsequently, the variance components and the number of days were calculated according to household head educational level, categorized into "up to Primary School complete" and "Secondary School incomplete and higher".

Differences in proportions among the categories nutritional status, alcohol consumption, tobacco use and household head educational level, by gender were verified by the chi-square test.

The study was approved by the Research Ethics Committee of the Faculty of Public Health of University of São Paulo.

 

Results

Table 1 shows the distribution of interviews by day of the week, end of the week and months of the year.

 

 

Table 2 shows the socio-demographic characteristics of the adolescents by gender. The mean age of adolescents studied was 17.8 years (standard-deviation - SD = 1.23) and 17.8 years (SD = 1.20) for male and female genders, respectively.

 

 

The transformation of dietary variables to normality yielded asymmetry and kurtosis values which were close to those expected for a normal distribution, i.e. asymmetry equal to 0 and kurtosis of around 3. The test detected normality in all cases exception for vitamins C and K (for female gender). However, visual inspection of the histograms of these variables revealed a near normal distribution.

Day of the week and month combined contributed to no more than 5% of total intake variance of each nutrient among males, and no more than 8% among females. In both genders, more than 50% of the variance observed was explained by intra-person variation, where this was greater for vitamin E and potassium among males, and vitamin B12 among females. The variance ratios for all nutrients were greater than 1, and higher mostly of cases among males compared to females. The higher the variance ratio, the greater the number of days of 24hR collection required. Thus, vitamin E and potassium for males, and vitamins B12 and K for females, were the nutrients that required the greatest number of days of 24hR application to estimate usual intake. The means and SD were obtained from data not transformed to normality (Tables 3 and 4).

The stratified analysis revealed lower variance ratios, and consequently fewer collection days, for the higher household educational level, although only for micronutrients. The mean days needed for the lower stratum was 14 days versus 10 days for the group with higher stratum.

 

Discussion

The present study sought to investigate the factors contributing to overall variability of intake and to calculate the variance ratios for nutrients and energy. Our results showed that total variance of consumption essentially involved two main sources: (i) inter-person variance, representing variation between one individual and another; (ii) and intra-person variance, representing an individual's variation over time. Lower relative contribution of inter-person variance leads to higher variance ratios for some nutrients.

In the present study, the variance ratios for males were higher than those for females for most nutrients. The same pattern was seen in American adolescents, although not in Russian adolescents 19. Overall, the variance ratios of Brazilian adolescents from São Paulo were much higher than the ratios of Russians and Americans counterparts. Among Russians for instance, the variance ratio ranged from 0.8 for energy to 1.7 for thiamin, American variance ratios ranged from 0.7 for magnesium to 2.2 for fats, while variance ratio reached 7.31 for vitamin E in the Brazilians of the present study.

In this and other studies involving other age groups 5,15,16,18,29,30, the intra-person variance component proved the greatest source of variation of nutrients and energy intake, yielding variance ratios of greater than 1. Exceptions include the studies by Herbert et al. 17 (in older adults) and by Janhs et al. 19 (in adolescents), which found variance ratios of less than 1 for the sodium, riboflavin, carbohydrate, magnesium, and energy.

Contribution to total variation in terms of day of the week and month of the year were small, similar to studies conducted in China 17,18,31. This finding indicates that variation in quantities of nutrients consumed over time is random and cannot be predicted for a specific day of the week or month of the year. The studies cited 5,17,18,31 also took into account interview sequence and interviewer effect, which were both found to be equally insignificant as sources of variation in nutrient and energy intake. Notably, gender was an important determinant of intake variation in the present study.

The results of this study have implications for both planning and analysis of dietary surveys. With regard to planning of studies in populations similar to the one studied, where there is a need to ascertain usual nutrient and energy intake, the analysis of the main sources of variation suggest that 24hR data can be collected randomly on any day of the week. Similarly, the inclusion of all the months of the year may be unnecessary for estimating the usual diet of adolescents given the low contribution of month to total variability. However, in view of a possible correlation amongst intakes of several consecutive days, data should ideally be collected on alternate days 32.

The high percentage contribution of intra-person variance implies a low level of precision for estimates of usual individual intake when these are based on only two measurements, as was the case in the present study. Although the mean intake of a group can be obtained based on a single measurement, the presence of intra-person variance may distort the percentiles above and below the mean by increasing total variance of the distribution 6,7.

A reduction in the effects of intra-individual variability, and consequently improved accuracy of the estimate, may be achieved by increasing the number of collection days for the same individual, i.e. by increasing the number of repetitions of dietary measurements 7 as opposed to increasing sample size 6. Therefore, the calculation of the number of days needed to estimate usual intake can serve to guide the planning of studies since this total is dependent on intra- and inter-person variances. As observed in the present study, around 15 repetitions of the 24hR will suffice for most nutrients in studies among male adolescents, whereas approximately eight replications appears to be sufficient in studies among women.

The fewer replications seen in females was due to the lower variance ratios observed. The nutrients vitamin E and potassium in males, and vitamin B12 in females, may require a greater number of repetitions. The high number of days needed to assess energy in males is noteworthy (17 days). This suggests a less stable pattern of caloric consumption in this group, characterized either by higher or lower intake. The same can be observed for other nutrients related to caloric intake such as fats and carbohydrates.

The correlation coefficient (r) used in the calculation of number of days measures the linearity between actual and observed consumption. The higher the value of r, the greater the proportion of individuals correctly ranked into their terciles, quartiles etc. of the true distribution of consumption. Thus, the higher the correlation desired, the greater the number of days needed. In the present study, the value of 0.9 was used for the correlation coefficient, by which over 75% of individuals are expected to be correctly classified into the extremes of the real distribution of consumption 29. The use of a lower r value will mean fewer days are needed for data collection, but will lead to a significant increase in errors classifying individuals, and to attenuation of measurements of effect in studies associating dietary pattern with outcomes.

Alternatively, several 24hR can be applied in each individual to estimate usual intake and dietary measures can be repeated in at least one subsample of the study population. When replication is precluded, the use of variance ratios obtained in studies on similar populations is recommended. Using statistical methods such as those proposed by the National Research Council 33 and by Iowa State University 34, intake distributions can be corrected based on variance components of the sample itself (when repeat measurements have been made) or by using external variance components, thereby generating more accurate estimates of usual ingestion 12,35. In studies of prevalence of nutrient intake inadequacy, the impact of correction is marked, since estimates based on distribution of non-adjusted intake are either under or overestimated owing to the influence of intra-person variability 31. The present study therefore gains relevance in providing appropriate variance ratios for correcting dietary data in adolescent studies.

The sample employed in the present study was based on a representative sample of a population of adolescents from São Paulo. However, because of the large number of individuals that came of age between the random selection of the initial sample in 2003 and the return to households to new data collection in 2007, the sample may have lost its representativeness. Nevertheless, of the 59 census sectors used in the original sample, 53 remained in the second collection, representing the many regions of the municipality of São Paulo in the same fashion. In addition, no statistical difference was found between the strata (according to percentage of heads of family with University-level education) obtained in the 2003 and 2007 samples.

The majority of studies on variability of nutrient intake have been carried out by applying several recalls in each individual from the sample. However, comparisons of surveys collecting 24, 12, 8 and 5 measurements per individual revealed similar variance components across the studies and little or no variation attributed to day of the week or time of the year. Moreover, the intra-individual variance can be obtained accurately through the use of at least two 24hR in a representative sub-sample of the study population 33,36.

 

Conclusion

Day-to-day variation was the greatest source of energy and nutrient intake variation. Hence, the ideal number of 24hR repetitions should be a priority consideration in planning studies which need to ascertain the usual energy and nutrient intake among adolescents. The proportional distribution for days of the week and months of the year in the application of dietary measurements carry less weight, where this knowledge may ultimately reduce data collection costs. Future studies in adolescents from populations with different sociodemographic characteristics are warranted, with special focus on results for macronutrients.

 

Contributors

E. Verly Junior participated in the writing of the manuscript and the statistical analyses. R. M. Fisberg and C. L. G. Cesar collaborated in the planning of the study and review of the manuscript. D. M. L. Marchioni contributed in the planning of the study, as well as the writing and review of the manuscript.

 

Acknowledgments

The authors would like to thank the São Paulo State Research Foundation (FAPESP) for their financial support of the study (grant nº. 07/51489-9 and 07/52119-0).

 

References

1. Carriquiry AL. Estimation of usual intake distributions of nutrients and foods. J Nutr 2003; 133: 601S-8S.         

2. Slimani N, Deharveng G, Charrondière RU, van Kappel AL, Ocké MC, Welch A, et al. Structure of the standardized computerized 24-h diet recall interview used as reference method in the 22 centers participating in the EPIC project. European Prospective Investigation into Cancer and Nutrition. Comput Methods Programs Biomed 1999; 58:251-66.         

3. Ross GW, Abbott RD, Petrovitch H, Morens DM, Grandinetti A, Tung KH, et al. Association of coffee and caffeine intake with the risk of Parkinson disease. JAMA 2000; 283:2674-9.         

4. Cade JT, Burley V, Warm D. Development, validation and utilization of food-frequency questionnaires: a review. Public Health Nutr 2002; 5:567-87.         

5. Beaton GH, Milner J, Corey P, McGuire V, Cousins M, Stewart E, et al. Sources of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation. Am J Clin Nutr 1979; 32:2546-59.         

6. Sempos CT, Looker AC, Johnson CL, Woteki CE. The importance of within-person variability in estimating prevalence. In: McDonald I, editor. Monitoring dietary intakes. New York: Springer-Verlag; 1991. p. 99-109.         

7. Willett WC. Nutritional epidemiology. 2nd Ed. New York: Oxford University Press; 1998.         

8. Institute of Medicine. Dietary reference intakes: applications in dietary assessment. Washington DC: National Academy Press; 2000.         

9. Paeratakul S, Popkin BM, Kohlmeier L, Hertz-Picciotto I, Guo X, Edwards LJ. Measurement error in dietary data: Implications for the epidemiologic study of the diet-disease relationship. Eur J Clin Nutr 1998; 52:722-7.         

10. Black AE, Cole TJ, Wiles SJ, White F. Daily variation in food intake of infants from 2 to 18 months. Hum Nutr Appl Nutr 1983; 37:448-58.         

11. Hoffman K, Boing H, Dufour A, Volatier JL, Telman J, Virtanem M, et al. Estimating the distribution of usual dietary intake by short-term measurements. Eur J Clin Nutr 2002; 56 Suppl2:53S-62.         

12. Jahns L, Arab L, Carriquiry AL, Popkin BM. The use of external within-person variance estimates to adjust nutrient intake distributions over time and across populations. Public Health Nutr 2005; 8: 69-76.         

13. Beaton GH, Milner J, McGuire V, Feather TE, Little A. Source of variation in 24-hour recall data: implications for nutrition study design and interpretation. Carbohydrate sources, vitamins and minerals. Am J Clin Nutr 1983; 37:986-95.         

14. Palaniappan U, Cue R, Payette H, Gray-Donald K. Implications of day-to-day variability on measurement of usual food and nutrient intakes. J Nutr 2003; 133:232-5.         

15. Ogawa K, Tsubono Y, Nishino Y, Watanabe Y, Ohkubo T, Watanabe T, et al. Inter- and intra-individual variation of food and nutrient consumption in a rural Japanese population. Eur J Clin Nutr 1999; 52:781-5.         

16. Oh SY, Hong MH. Within- and between-person variation of nutrient intakes of older people in Korea. Eur J Clin Nutr 1999; 53:625-9.         

17. Herbert JR, Gupta PC, Mehta H, Ebbeling DB, Bhonsle RR, Varghese F. Source of variation in two distinct regions of rural India: implications of nutrition study design and interpretation. Eur J Clin Nutr 2000; 54:479-86.         

18. Cai H, Yang G, Xiang YB, Herbert JR, Liu DK, Zheng W, et al. Source of variation among men in Shanghai, China. Public Health Nut 2005; 8:1293-9.         

19. Jahns L, Carriquiry A, Arab L, Mroz TA, Popkin BM. Within- and between-person variation in nutrient intakes of Russian and U.S. children differs by sex and age. J Nutr 2004; 134:3114-20.         

20. Costa MMF, Takeyama L, Voci SM, Slater B, Silva MV. Within- and between-person variations as determinant factors to calculate the number of observations to estimate usual dietary intake of adolescents. Rev Bras Epidemiol 2008; 11:541-8.         

21. Thompson FE, Byers T. Dietary assessment resource manual. J Nutr 1994; 124(11 Suppl):2245S-317S.         

22. Cole TJ, Bellizzi MC, Flegal KM, Dietz WH. Establishing a standard definition of child overweight and obesity worldwide: international survey. BMJ 2000; 320:1240-3.         

23. Institute of Medicine. Dietary reference intakes for vitamin A, vitamin K, arsenic, boron, chromium, copper, iodine, iron, manganese, molybdenum, nickel, silicon, vanadium, and zinc. Washington DC: National Academy Press; 2001.         

24. Institute of Medicine. Dietary Reference intakes for thiamin, riboflavin, niacin, vitamin B6, folate, vitamin B12, pantothenic acid, biotin, and choline. Washington DC: National Academy Press; 1998.         

25. Thompson FE, Kipnis V, Midthune D, Freedman LS, Carroll RJ, Subar AF, et al. Performance of a food-frequency questionnaire in the US NIH-AARP (National Institutes of Health-American Association of Retired Persons) Diet and Health Study. Public Health Nutr 2008; 11:183-95.         

26. Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York: Spring-Verlag; 2000. (Spring Series in Statistics).         

27. Littell RC, Milliken GA, Stroup WW, Wolfinger RD, Schabenberger O. SAS for mixed models. 2nd Ed. Cary: SAS Institute; 2006.         

28. Marchenko Y. Estimating variance components in Stata. Stata J 2006; 6:1-21.         

29. Nelson M, Black AE, Morns JA, Cole TJ. Between- and within-subject variation in nutrient intake from infancy to old age: estimating the number of days required to rank dietary intakes with desired precision. Am J Clin Nutr 1989; 50:155-67.         

30. Huybrechts I, Bacquer DD, Cox B, Temme EHM, Oyen HV, Backer GD, et al. Variation in energy and nutrient intakes among pre-school children: implications for study design. Eur J Public Health 2008; 18:509-16.         

31. Cai H, Shu XO, Herbert JR, Jin F, Yang G, Liu DK, et al. Variation in nutrient intakes among women in Shanghai, China. Eur J Clin Nutr 2004; 58: 1604-11.         

32. Carriquiry AL. Assessing the prevalence of nutrient inadequacy. Public Health Nutr 1999; 2:23-33.         

33. National Research Council. Nutrient adequacy: assessment using food consumption surveys. Washington DC: National Academy Press; 1986.         

34. Nusser SM, Carriquiry AL, Dodd KW, Fuller WA. A semiparametric transformation approach to estimating usual daily intake distributions. J Am Stat Assoc 1996; 91:1440-9.         

35. Goldman J. Within-individual variance estimates for nutrients from What We Eat in America, NHANES 2002. Washington DC: Agricultural Research Service, U.S. Department of Agriculture; 2005.         

36. Guenther PM, Philip SK, Carriquiry AL. Development of an approach for estimating usual nutrient intake distributions at the population level. J Nutr 1997; 127:1106-12.         

 

 

Correspondence:
D. M. L. Marchioni
Departamento de Nutrição, Faculdade de Saúde Pública, Universidade de São Paulo

Av. Dr. Arnaldo 715,
São Paulo, SP 01246-904, Brasil

marchioni@usp.br

Submitted on 29/Jul/2009
Final version resubmitted on 18/Feb/2010
Approved on 01/Mar/2010

Escola Nacional de Saúde Pública Sergio Arouca, Fundação Oswaldo Cruz Rio de Janeiro - RJ - Brazil
E-mail: cadernos@ensp.fiocruz.br