Association between inflammatory markers and hospitalizations: evidence from the Bambuí cohort of aging baseline

Raquel Moreira Greco Cosso Karen Cecília de Lima Torres Juliana Vaz de Melo Mambrini Sergio William Viana Peixoto Andréa Teixeira de Carvalho Olindo Assis Martins Filho Maria Fernanda Lima-Costa About the authors

ABSTRACT:

Introduction:

Inflammation plays an important role in the aging process.

Objective:

This cross-sectional study aims to examine the association between inflammatory markers and hospitalizations among older adults, considering as potential confounding factors the predisposing and enabling factors for the use of health services and health conditions.

Methods:

We used data from 1,393 participants (≥ 60 years) in the baseline cohort from Bambuí. The markers assessed were ten cytokines and chemokines [interleukin (IL)-1, IL-6, IL-10, IL-12, tumor necrosis factor (TNF), CCL2, CCL5, CXCL8, CXCL9, and CXCL10]. The outcome variable was one or more hospitalizations in the preceding 12 months.

Results:

Elevated serum levels of IL-6 were significantly associated with hospitalizations [prevalence ratio (PR) = 1.38; confidence interval of 95% (95%CI) 1.02 - 1.87 and PR = 1.38; 95%CI 1.01 - 1.88 for the intermediate and highest tertiles, respectively]. High levels of CXCL9 were also independently associated with the outcome (PR = 1.38; 95%CI 1.01 - 1.89 and PR = 1.46; 95%CI 1.07 - 2.00, respectively). Other markers showed no statistically significant association with hospitalizations.

Conclusion:

Among the ten markers analyzed, only IL-6 and CXCL9 were associated with hospitalizations.

Keywords:
Inflammation; Chemokines; Cytokines; Hospitalization; Aging

INTRODUCTION

Inflammation plays an important role in the aging process11. Franceschi C, Valensin S, Lecai F, Olivieri F, Licastro F, Grimaldi LM, et al. Neuroinflammation and the genetics of Alzheimer's disease: the search for a pro-inflammatory phenotype. Aging (Milano) 2001; 13(3): 163-70.. Previous researches show that the increase in serum levels of inflammatory markers, particularly interleukin-6 (IL-6) and/or tumor necrosis factor-alpha (TNF-alpha), is associated with the rise in mortality risk, as well as the higher incidence of cardiovascular diseases, diabetes, physical and cognitive decline, among other adverse events22. Singh T, Newman AB. Inflammatory markers in population studies of aging. Ageing Res Rev 2011; 10(3): 319-29.. This evidence suggests that inflammatory markers can be useful in stratifying the risk of adverse events among older adults, in order to identify vulnerable groups for early intervention and rehabilitation22. Singh T, Newman AB. Inflammatory markers in population studies of aging. Ageing Res Rev 2011; 10(3): 319-29.,33. Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.,44. Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61..

The prevalence and incidence of chronic diseases and functional limitation increase with old age, leading to a higher need for health care. According to the classic model by Andersen & Newman55. Andersen R, Newman JF. Societal and individual determinants of medical care utilization in the United States. Milbank Mem Fund Q Health Soc 1973; 51(1): 95-124., in addition to health needs, factors associated with the use of health services include predisposing (such as age and gender) and enabling (such as schooling and income) characteristics.

Two recent longitudinal studies suggest that the increase in serum levels of some inflammatory markers is associated with the rise in hospitalization risk among older adults. The first of these studies, conducted in Alabama, comprised 370 adults aged 65 years or older. The results showed that an inflammation score based on four markers, among them IL-6 and C-reactive protein, was associated with future hospitalizations, despite some predisposing and enabling factors33. Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.. A more recent study, held in Belgium, assessed the prognostic value of a battery of cytokines and chemokines in predicting hospitalization among 415 adults aged 80 years or older. The results indicated that only IL-6 had prognostic value for hospitalization in the study population44. Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61..

The exact mechanisms involved in these association are still not clear. Inflammation can lead to a higher risk of hospitalization by demonstrating the individual’s disease burden as it acts directly in the organism (for instance, the catabolic effect on muscle mass, predisposing the person to functional limitation) or due to a combination of these factors22. Singh T, Newman AB. Inflammatory markers in population studies of aging. Ageing Res Rev 2011; 10(3): 319-29.,33. Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.,44. Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61.. To the best of our knowledge, no study analyzed this association in Brazil and the literature on the topic is restricted to the two studies aforementioned, indicating the need for further investigations to confirm or deny these associations.

The present cross-sectional study used data from the baseline cohort of older adults from Bambuí with two objectives:

  1. examine the existing associations between multiple inflammatory markers (cytokines and chemokines) and hospitalizations;

  2. verify if these associations are independent of health conditions and predisposing and enabling factors for the use of health services.

METHODS

STUDY POPULATION

The Bambuí cohort was established in the city of the same name (with approximately 15,000 inhabitants), located in the state of Minas Gerais. Previous publications66. Lima-Costa MF, Firmo JO, Uchoa E. Cohort profile: the Bambui (Brazil) cohort study of ageing. Int J Epidemiol 2011; 40(4): 862-7.,77. Lima-Costa MF, Firmo JOA, Uchoa E. The Bambui Cohort Study of Aging: methodology and health profile of participants at baseline. Cad Saúde Pública 2011; 27(Suppl. 3): S327-35. described the recruitment of participants and the procedures used in the baseline cohort. Briefly, the eligible study population consisted of all city residents aged 60 years or older on January 1, 1997 (n = 1,742). Out of them, 1,660 participated in the baseline survey. The participants signed the Informed Consent Form. The Research Ethics Committee of Fundação Oswaldo Cruz, Rio de Janeiro, approved the baseline survey.

The Ethics Committee of Fundação Oswaldo Cruz, Rio de Janeiro, approved this cohort in 1996.

STUDY VARIABLES

The dependent variable of this study was the incidence of hospitalizations in the 12 months prior to the interview date of the baseline survey. Hospitalization was defined as at least one night of hospital stay and discharge.

The inflammatory markers included in this analysis were five cytokines (IL-1, IL-6, IL-10, IL-12, and TNF) and five chemokines (CCL2, CCL5, CXCL8, CXCL9, and CXCL10). The Cytometric Bead Array Assay (CBA immunoassay kit; Becton Dickinson Biosciences Pharmingen, San Diego, USA) performed the quantitative analysis of these markers. Data were collected using the flow cytometer FACSVerse (Becton Dickinson, USA) and the samples were analyzed with the aid of the software BD FCAP Array 3.0 (Becton Dickinson, USA). Standard curves determined marker concentrations and results were expressed in picograms per milliliter (pg/mL). Doses of those markers were stored in aliquots at -80°C, in 2014. The blood sample for these tests was collected during the baseline cohort survey.

The selection of potential confounding variables for the study followed the theoretical framework proposed by Andersen & Newman55. Andersen R, Newman JF. Societal and individual determinants of medical care utilization in the United States. Milbank Mem Fund Q Health Soc 1973; 51(1): 95-124., mentioned above. The predisposing and enabling factors for the use of health services considered in this study were age, gender, and schooling (categorized as < 4 and 4 years). Health needs were established by systolic blood pressure and total cholesterol levels, and presence of coronary heart disease (myocardial infarction or angina pectoris), stroke, heart failure, diabetes, and functional limitation. Systolic blood pressure was stipulated by the mean of two out of three blood pressure measurements, dismissing the first one. Coronary heart disease was determined using the Rose Questionnaire88. Rose GA. The diagnosis of ischaemic heart pain and intermittent claudication in field surveys. Bull World Health Organ 1962; 27(6): 645-58.. Medical history established the presence of myocardial infarction and stroke. Heart failure was associated to individuals with serum levels of B-type natriuretic peptide greater than 100 pg/mL, as recommended by the manufacturer (AxSYM MEIA; Abbott Laboratories, Inc., Abbott Park, Illinois). Diabetes mellitus was defined by fasting blood glucose > 126 mg/dL and/or use of oral hypoglycemic agents or insulin. Functional limitation was related to the report of major difficulty in performing the following basic activities of daily living: dressing, bathing/showering, toileting, feeding, ambulating - walking from one room to another on the same floor -, and transferring - moving from bed to chair. The blood sample for biochemical tests was collected early in the morning, with a recommendation of 12 hours of fasting. Cholesterol and glucose levels were measured based on traditional enzymatic methods (Merck, Darmstadt, Germany). More details can be found in a previous publication66. Lima-Costa MF, Firmo JO, Uchoa E. Cohort profile: the Bambui (Brazil) cohort study of ageing. Int J Epidemiol 2011; 40(4): 862-7..

STATISTICAL ANALYSIS

The unadjusted analysis used the χ2, Student’s t, and Kruskal-Wallis tests to assess the statistical significance of the differences between frequencies, means, and medians, respectively. These analyses considered the serum levels of IL-10, IL-12, TNF, and IL-1 as dichotomous variables (detected versus undetected), since their detection levels were very low. The other markers were evaluated as continuous variables, estimating the median and quartiles.

Markers that showed statistically significant associations (p < 0.05) with the outcome in the unadjusted analysis were selected for multivariate analyses. These analyses were based on prevalence ratios estimated by Poisson regression with robust variance99. Long S, Freese J. Regression models for categorical dependent variables using Stata. 2nd ed. College Station, TX: StataCorp LP; 2006., considering the distribution of each marker into tertiles. Initially, we estimated the prevalence ratios adjusted for age and gender. Next, the models included the other variables (enabling and need factors). Lastly, we used a binary logistic regression to estimate the predicted probability of hospitalization in different ages, according to serum levels (in tertiles) of the two markers (IL-6 and CXCL9) that remained associated with the outcome in previous analyses, and plotted these results. All analyses used the statistical package Stataâ (version 14.1).

RESULTS

This analysis included 1,393 participants in the Bambuí cohort who had complete information for all study variables. Table 1 presents the sociodemographic and health characteristics of these individuals, according to the incidence of hospitalizations. The mean age of the study participants was 69.9 years [standard deviation (SD) = 7.0)], 60.9% were women, and 64.9% had less than 4 years of schooling. The following variables showed positive and statistically significant associations (p < 0.05) with hospitalizations: age, gender, schooling, stroke, coronary heart disease, heart failure, and functional limitation.

Table 1.
Sociodemographic characteristics and health conditions of participants in the baseline cohort of older adults from Bambuí, according to the incidence of hospitalizations in the preceding 12 months.

Table 2 indicates the distribution of serum levels of inflammatory markers, according to the incidence of hospitalizations. Compared to non-hospitalized older adults, those who were hospitalized in the preceding 12 months had higher serum levels of IL-6 (median = 1.31 ­pg/­mL among hospitalized and 0.98 pg/mL among non-hospitalized; p = 0.003), CXCL9 (median = 2,973 ­pg/­mL and 2,135 pg/mL, respectively; p < 0.001), and CXCL10 (median = 3,336 pg/mL and 2,956 pg/mL, respectively; p = 0.033). Other cytokines and chemokines showed no statistically significant association with the outcome (p > 0.05 for all).

Table 2.
Distribution of serum levels of inflammatory markers among participants in the baseline cohort of older adults from Bambuí, according to the incidence of hospitalizations in the preceding 12 months.

As seen in Table 3, elevated serum levels of IL-6 were significantly associated with hospitalizations in the analysis adjusted for gender and age [prevalence ratio (PR) = 1.48; confidence interval of 95% (95%CI) 1.09 - 1.99 and PR = 1.52; 95%CI 1.12 - 2.05 for the highest tertile, compared to the lowest one], and the analysis subsequently adjusted for schooling and health conditions (PR = 1.38; 95%CI 1.02- 1.87 and PR = 1.38; 1.01 - 1.88, respectively). High levels of CXCL9 were also independently associated with the outcome, both in the analysis adjusted for gender and age (PR = 1.38; 95%CI 1.02 - 1.83 and PR = 1.55; 95%CI 1.14 - 2.10 for the intermediate and highest tertiles, respectively) and the analysis subsequently adjusted for other covariates (PR = 1.38; 95%CI 1.01 - 1.89 and PR = 1.46; 95%CI 1.07 - 2.00, respectively). With respect to CXCL10, the association previously identified in the unadjusted analysis lost statistical significance after adjustments for age and gender, and the lack of association persisted in the model adjusted for other covariates.

Table 3.
Multivariate analysis results of the association between selected inflammatory markers and hospitalizations in the preceding 12 months among participants in the baseline cohort of older adults from Bambuí.

Figure 1 illustrates the predicted probability of hospitalization, according to age and serum levels of IL-6 and CXCL9 in tertiles. In all ages, individuals with serum levels of IL-6 in the intermediate and highest tertiles had significantly higher chances of hospitalization, compared to their peers with values in the lowest tertile. CXCL9 presented a graded association, that is, the probability of hospitalization in all ages gradually increased from the lowest to the intermediate and highest tertiles, respectively.

Figure 1.
Predicted probability of hospitalizations in the preceding 12 months among participants in the baseline cohort of older adults from Bambuí, according to age and serum levels of inflammatory markers in tertiles.

DISCUSSION

The results of this study, conducted in a large population of older adults, revealed that, out of 10 inflammatory markers, only IL-6 and CXCL9 showed statistically significant associations with hospitalizations in the preceding 12 months. The associations found did not depend on predisposing and enabling factors for the use of health services, as well as indicators of health conditions and functional capacity.

IL-6 is a glycoprotein produced mainly by leukocytes, adipocytes, and endothelial cells in response to various inflammatory stimuli, such as toxins, infections, and other cytokines1010. Maggio M, Guralnik JM, Longo DL, Ferrucci L. Interleukin-6 in Aging and Chronic Disease: A Magni?cent Pathway. J Gerontol A Biol Sci Med Sci. 2006; 61(6): 575-84.. Several studies have demonstrated that the serum concentration of this marker increases with age and that it is involved in the development of the chronic inflammatory condition characteristic of aging1010. Maggio M, Guralnik JM, Longo DL, Ferrucci L. Interleukin-6 in Aging and Chronic Disease: A Magni?cent Pathway. J Gerontol A Biol Sci Med Sci. 2006; 61(6): 575-84.. High levels of IL-6 are also associated with cognitive decline, changes in respiratory function, increase in physical frailty, and a higher risk of cardiovascular, metabolic, and neoplastic diseases1010. Maggio M, Guralnik JM, Longo DL, Ferrucci L. Interleukin-6 in Aging and Chronic Disease: A Magni?cent Pathway. J Gerontol A Biol Sci Med Sci. 2006; 61(6): 575-84.,1111. Chang SS, Vaz Fragoso CA, Van Ness PH, Fried LP, Tinetti ME. Association between combined interleukin-6 and c-reactive protein levels and pulmonary function in older women: results from the Women's Health and Aging Studies I and II. J Am Geriatr Soc 2011; 59(1): 113-9.,1212. Volpato S, Guralnik JM, Ferrucci L, Balfour J, Chaves P, Fried LP, Harris TB. Cardiovascular disease, interleukin-6, and risk of mortality in older women the women's health and aging stud. Circulation 2001; 103(7): 947-53..

As previously mentioned, two longitudinal studies showed that IL-6 has prognostic value for hospitalizations among older adults33. Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.,44. Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61.. Therefore, its association with a higher incidence of hospitalizations in the study population is not unexpected. Our results add to previous studies by showing that adjustments for important indicators of health conditions reduce the strength of this association, but it remains statistically significant. Also, we underline that relatively low levels of IL-6 (> 0.63 pg/mL) were associated with the outcome.

To the best of our knowledge, no previous studies examined the association between serum levels of CXCL9 and hospitalizations among older adults. In the present analysis, this marker revealed a strong graded association with the outcome. CXCL9, CXCL10, and CXCL11 are part of a group of chemokines induced by interferon gamma (IFN-gamma) and play an important role in leukocyte recruitment to inflammation and infection sites and inhibition of angiogenesis1313. Lacotte S, Brun S, Muller S, Dumortier H. CXCR3, inflammation, and autoimmune Diseases. Send to Ann N Y Acad Sci 2009; 11731(1): 310-7.. Studies have shown that high levels of these chemokines are present in some neurological and rheumatic diseases, such as multiple sclerosis, rheumatoid arthritis, and systemic lupus erythematosus. This finding suggests that these chemokines could contribute to inducing or exacerbating a chronic inflammatory response associated with autoimmune diseases1313. Lacotte S, Brun S, Muller S, Dumortier H. CXCR3, inflammation, and autoimmune Diseases. Send to Ann N Y Acad Sci 2009; 11731(1): 310-7.. Thus, the association between elevated serum levels of CXCL9 and hospitalizations found in this study is biologically plausible.

This study has advantages and limitations. The main advantages are the large population base and the use of robust indicators of health conditions that could confound the associations examined. Another benefit is the analysis of various cytokines and chemokines, which only became possible more recently, with the availability of reliable kits to measure these dosages. The main limitation of this study is its cross-sectional nature, which prevents us from establishing temporal relationships between inflammatory markers and the outcome. In other words, it is not possible to know if the inflammation preceded or was a consequence of hospitalization, a situation that characterizes reverse causality1414. Szklo M, Javier Nieto E. Epidemiology: Beyond the Basics. 2nd ed. Massachusetts : Jones & Bartlett Publishers; 2007.. Lastly, both hospitalizations and dosage of inflammatory markers occurred at baseline cohort, that is, about 20 years ago. Although the prevalence or incidence of these measures could have changed over time, it is unlikely that these changes happened differentially, affecting the magnitude of the associations found.

CONCLUSION

Our results show that older adults hospitalized in the preceding 12 months had high levels of two inflammatory markers (IL-6 and CXCL9) which, in turn, were associated with an increased risk of developing several diseases, chronic conditions, and other adverse events, as demonstrated by the literature on the topic22. Singh T, Newman AB. Inflammatory markers in population studies of aging. Ageing Res Rev 2011; 10(3): 319-29.,33. Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.,44. Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61.,1010. Maggio M, Guralnik JM, Longo DL, Ferrucci L. Interleukin-6 in Aging and Chronic Disease: A Magni?cent Pathway. J Gerontol A Biol Sci Med Sci. 2006; 61(6): 575-84.,1111. Chang SS, Vaz Fragoso CA, Van Ness PH, Fried LP, Tinetti ME. Association between combined interleukin-6 and c-reactive protein levels and pulmonary function in older women: results from the Women's Health and Aging Studies I and II. J Am Geriatr Soc 2011; 59(1): 113-9.,1212. Volpato S, Guralnik JM, Ferrucci L, Balfour J, Chaves P, Fried LP, Harris TB. Cardiovascular disease, interleukin-6, and risk of mortality in older women the women's health and aging stud. Circulation 2001; 103(7): 947-53.,1313. Lacotte S, Brun S, Muller S, Dumortier H. CXCR3, inflammation, and autoimmune Diseases. Send to Ann N Y Acad Sci 2009; 11731(1): 310-7.. Our results are limited to allow inferences about the prognostic value of these markers for hospitalizations. Longitudinal analyses are underway for a better understanding of these relationships, and to determine if the increase in serum levels of these markers precedes or is a consequence of hospitalization.

References

  • 1
    Franceschi C, Valensin S, Lecai F, Olivieri F, Licastro F, Grimaldi LM, et al. Neuroinflammation and the genetics of Alzheimer's disease: the search for a pro-inflammatory phenotype. Aging (Milano) 2001; 13(3): 163-70.
  • 2
    Singh T, Newman AB. Inflammatory markers in population studies of aging. Ageing Res Rev 2011; 10(3): 319-29.
  • 3
    Salanitro AH, Ritchie CS, Hovater M, Roth DL, Sawyer P, Locher JL, et al. Inflammatory biomarkers as predictors of hospitalization and death in community-dwelling older adults. Arch Gerontol Geriatr 2012; 54(3): e387-91.
  • 4
    Adriaensen W, Matheï C, Vaes B, van Pottelbergh G, Wallemacq P, Degryse JM. Interleukin-6 as a first-rated serum inflammatory marker to predict mortality and hospitalization in the oldest old: A regression and CART approach in the BELFRAIL study. Exp Gerontol 2015; 69: 53-61.
  • 5
    Andersen R, Newman JF. Societal and individual determinants of medical care utilization in the United States. Milbank Mem Fund Q Health Soc 1973; 51(1): 95-124.
  • 6
    Lima-Costa MF, Firmo JO, Uchoa E. Cohort profile: the Bambui (Brazil) cohort study of ageing. Int J Epidemiol 2011; 40(4): 862-7.
  • 7
    Lima-Costa MF, Firmo JOA, Uchoa E. The Bambui Cohort Study of Aging: methodology and health profile of participants at baseline. Cad Saúde Pública 2011; 27(Suppl. 3): S327-35.
  • 8
    Rose GA. The diagnosis of ischaemic heart pain and intermittent claudication in field surveys. Bull World Health Organ 1962; 27(6): 645-58.
  • 9
    Long S, Freese J. Regression models for categorical dependent variables using Stata. 2nd ed. College Station, TX: StataCorp LP; 2006.
  • 10
    Maggio M, Guralnik JM, Longo DL, Ferrucci L. Interleukin-6 in Aging and Chronic Disease: A Magni?cent Pathway. J Gerontol A Biol Sci Med Sci. 2006; 61(6): 575-84.
  • 11
    Chang SS, Vaz Fragoso CA, Van Ness PH, Fried LP, Tinetti ME. Association between combined interleukin-6 and c-reactive protein levels and pulmonary function in older women: results from the Women's Health and Aging Studies I and II. J Am Geriatr Soc 2011; 59(1): 113-9.
  • 12
    Volpato S, Guralnik JM, Ferrucci L, Balfour J, Chaves P, Fried LP, Harris TB. Cardiovascular disease, interleukin-6, and risk of mortality in older women the women's health and aging stud. Circulation 2001; 103(7): 947-53.
  • 13
    Lacotte S, Brun S, Muller S, Dumortier H. CXCR3, inflammation, and autoimmune Diseases. Send to Ann N Y Acad Sci 2009; 11731(1): 310-7.
  • 14
    Szklo M, Javier Nieto E. Epidemiology: Beyond the Basics. 2nd ed. Massachusetts : Jones & Bartlett Publishers; 2007.

  • Financial support: Minas Gerais Research Foundation, Coordination for the Improvement of Higher Education Personnel, and National Council for Scientific and Technological Development

Publication Dates

  • Publication in this collection
    29 Apr 2019
  • Date of issue
    2019

History

  • Received
    03 Apr 2017
  • Reviewed
    26 Dec 2017
  • Accepted
    06 Mar 2018
Associação Brasileira de Pós -Graduação em Saúde Coletiva São Paulo - SP - Brazil
E-mail: revbrepi@usp.br