Characterization of population exposure to organochlorines: a cluster analysis application

Raphael Mendonça Guimarães Carmen Ildes Rodrigues Fróes Asmus Alex Burdorf About the authors

Abstract

This study aimed to show the results from a cluster analysis application in the characterization of population exposure to organochlorines through variables related to time and exposure dose. Characteristics of 354 subjects in a population exposed to organochlorine pesticides residues related to time and exposure dose were subjected to cluster analysis to separate them into subgroups. We performed hierarchical cluster analysis. To evaluate the classification accuracy, compared to intra-group and inter-group variability by ANOVA for each dimension. The aggregation strategy was accomplished by the method of Ward. It was, for the creation of clusters, variables associated with exposure and routes of contamination. The information on the estimated intake doses of compound were used to weight the values of exposure time at each of the routes, so as to obtain values proxy exposure intensity. The results showed three clusters: cluster 1 (n = 45), characteristics of greatest exposure, the cluster 2 (n = 103), intermediate exposure, and cluster 3 (n = 206), less exposure. The bivariate analyzes performed with groups that are groups showed a statistically significant difference. This study demonstrated the applicability of cluster analysis to categorize populations exposed to organochlorines and also points to the relevance of typological studies that may contribute to a better classification of subjects exposed to chemical agents, which is typical of environmental epidemiology studies to a wider understanding of etiological, preventive and therapeutic contamination.

Multivariate statistical methods; Cluster analysis; Organochlorines; Exposure; Environmental health; Environmental epidemiology.


Introduction

The concept of exposure in the area of environmental epidemiology is defined as a contact limited in time and space between an individual and one or more biological, chemical and physical agents11. Environmental Protection Agency. Exposure Assessment Tools and Models . Disponível em http://www.epa.gov/opptintr/exposure/ (Acessado em 20 de março de 2012).
http://www.epa.gov/opptintr/exposure/...
. In contrast, the assessment of exposure is identified from the exposures that occur or that can be predicted in human populations22. International Programme on Chemical Safety. General scientific principles of chemical safety . Geneva: World Health Organization; 2000. (Training Module, 4).. This can be a complex event, requiring the analysis of different aspects of contact between individuals and substances.

Exposure assessment methods can be used to identify and define groups with higher or lower exposure. Depending on the exposure assessment proposal, the numerical value can be an estimate of intensity, rate, speed, duration and frequency of contact or exposure. According to the International Program of Chemical Safety (IPCS), one of the ways to estimate exposure can be the separate assessment of concentration of exposure and time of contact, as well as their combination a posteriori. Based on this, evaluators focus on the determination of the concentration of substances in the environment or location and compare this information with the time and ways in which an individual or population groups have come into contact with such substances22. International Programme on Chemical Safety. General scientific principles of chemical safety . Geneva: World Health Organization; 2000. (Training Module, 4)..

Among the substances most frequently studied in recent years are the organochlorines, which are compounds of carbon, hydrogen and oxygen. They are extremely persistent in the environment and accumulate in several environmental compartments. Their persistence in the environment is defined by the time that it takes a chemical product to lose at least 95% of its activity, i.e. to decompose into simpler structures, basically CO2and H2O, under usual environmental conditions and uses. It takes between one and three weeks for products that are not persistent to be degraded; those with moderate persistence, between one and 18 months; and those that are persistent, two or more years33. Agency for Toxic Substances and Disease Registry. Toxicological profile for DDT, DDE, DDD . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp35.html (Acessado em 19 de março de 2012).
http://www.atsdr.cdc.gov/toxprofiles/tp3...

4. Agency for Toxic Substances and Disease Registry. Toxicological profile for chlorophenols . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp107.html (Acessado em 19 de março de 2012).
http://www.atsdr.cdc.gov/toxprofiles/tp1...

5. Agency for Toxic Substances and Disease Registry. Toxicological profile for 2,3,7,8-tetrachlorodibenzo-p-dioxin . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp104.html (Acessado em 19 de março de 2012).
http://www.atsdr.cdc.gov/toxprofiles/tp1...

6. Agency for Toxic Substances and Disease Registry. Toxicological profile for alpha, beta, gamma, and delta-hexachlorocyclohexane. Disponível em http://www.atsdr.cdc.gov/ toxprofiles/tp43.html (Acessado em 19 de março de 2012).
http://www.atsdr.cdc.gov/ toxprofiles/tp...
- 77. D'Amato C, Torres JPM, Malm O. DDT (diclorodifeniltricloroetano): toxicidade e contaminação ambiental. Uma revisão. Química Nova 2002; 25: 995-1002.. These compounds cannot be easily measured in human beings, due to their lipophilic nature and low availability in the blood tissue. Additionally, estimates of organochlorines require high-precision technology and, at times, do not reflect the actual contamination of individuals88. Klaassen D. Casarett and Doull'sToxicology: The Basic Science of Poisons . Companion HandBook. Fifth Edition. McGraw-Hill 6thEd; 1999.. Bearing this in mind, investigative programs aimed at this area have sought alternative forms of classification of individuals' exposure to perform studies that quantify the magnitude of the association between the contamination of compounds and different health outcomes99. Environmental Protection Agency. Hazardous waste. http://www.epa.gov/ebtpages/ wasthazardouswaste.html (Acessado em 22 de março de 2012).
http://www.epa.gov/ebtpages/ wasthazardo...

10. Agency for Toxic Substances and Disease Registry. Public health assessment guidance manual . Disponível em http://www.atsdr.cdc.gov/HAC/PHAManual/appg.html (Acessado em 22 de março de 2012).
http://www.atsdr.cdc.gov/HAC/PHAManual/a...

11. Reichenheim, ME & Moraes, CL. Qualidade dos instrumentos epidemiológicos. In Almeida Filho N, Barreto M (Eds.). Epidemiologia & Saúde - Fundamentos, Métodos e Aplicações . Rio de Janeiro: Guanabara-Koogan; 2011. pp. 150-64.
- 1212. Streiner DL, Norman GR. Health measurement scales. A practical guide to their development and use (4 ed.). Oxford: Oxford University Press; 2008..

Cluster analysis aims to divide the elements of a sample into groups so that elements belonging to the same group are similar to one another, with regard to the variables (characteristics) measured in them, and so that elements in distinct groups are heterogeneous for these characteristics. The term “Cluster Analysis”, first used by Tyron1313. Tyron RC. Cluster Analysis. Ann Arbor, MI: Edwards Brothers; 1939., in fact includes a variety of algorithms with distinct classifications, all aimed at an important question found in several areas of research: how to organize data observed in structures that make sense or, in other words, how to develop taxonomies capable of classifying the data present in different classes. It should be emphasized, among other things, that these classes must be classes that occur “naturally” in the set of data1414. von Wangenheim R. Análise de Agrupamentos. Disponível em http://www.inf.ufsc.br/ ~patrec/agrupamentos.html (Acessado em 25 de março de 2012).
http://www.inf.ufsc.br/ ~patrec/agrupame...
.

There were no studies in the literature that had used cluster analysis to verify the joint relations among variables associated with exposure to chemical substances, particularly organochlorines. The majority of international studies use data on the serum concentration of compounds, a solution that creates two problems: a) blood is not the main biological matrix of concentration of compounds; b) investigative programs with less funding or relying on more precarious logistics do not have the resources to collect or analyze any biological matrices.

Consequently, the present study aimed to present the results of the application of cluster analysis to characterize exposure to organochlorines, using variables associated with the exposure time and dose.

Methods

Study data

The data used in this study originated from a research project which is one of the main products of the Cooperation Term 74/2010 (process 25000.153491/2010-00) established between the Instituto de Estudos em Saúde Coletiva (IESC – Institute of Collective Health Studies) of the Federal University of Rio de Janeiro (UFRJ) and the Coordenação de Vigilância em Saúde Ambiental do Ministério da Saúde (CGVAM/MS – Brazilian Ministry of Health Coordination for Environmental Health Surveillance) in 2011.

This Cooperation Term, entitled “Analysis of the Health Effects Resulting from Exposure to Organochlorine Compounds in the district of Cidade dos Meninos, Duque de Caxias, RJ, Brazil”, aims to analyze the database developed by the Instituto Nacional do Câncer (INCA – National Cancer Institute) in 2007, based on a partnership between the INCA and CGVAM.

This partnership had the purpose of conducting a health survey of the population living in the area known as Cidade dos Meninos, including clinical data collection, physical examination and laboratory tests. This survey was completed in 2007 and the database developed was sent to the Ministry of Health.

In 2011, the Ministry of Health requested that the IESC/UFRJ analyze this database, in accordance with the aforementioned Cooperation Term.

The data maintained in the database do not have any type of identification, so that the analyses do not include any approaches of procedures that may violate the human rights established by the Ethics Code. This is a secondary database whose archives have been granted to the Ministry of Health under number 47/2012.

Statistical analysis

Hierarchical cluster analysis was performed in the present study. Intra-group variability (which is small if the classification is good) and inter-group variability (which is great if the classification is good) were compared to assess the accuracy of the classification, using the ANOVA test for each dimension (case of variable)1515. Mingoti SA. Análise de Dados Através de Métodos de Estatística Multivariada: uma abordagem aplicada. Belo Horizonte: Editora UFMG; 2005. , 1616. Wilson M. Constructing measures. An item response modeling approach . Mahwah, NJ: Lawrence Erlbaum Associates, Publishers; 2005..The cluster analysis aimed to classify the objects of analysis (for example, individuals of a population) that are known for their characteristics, in groups that are intra-group homogeneous and inter-group heterogeneous. The objective techniques of clusters reduce subjectivity, as they quantify the similarity or dissimilarity among individuals. Among the several methods or algorithms of classification of groups are those that use hierarchical techniques. In this case, the partition occurs from an undefined group number, in which the major groups are divided into minor sub-groups, gathering individuals that have similar characteristics. The classification of individuals in distinct groups is performed from a cluster function (distance or similarity) and a mathematical cluster criterion. The Euclidean distance is the dissimilarity measure most frequently used in clusters, although there are several distance measures1616. Wilson M. Constructing measures. An item response modeling approach . Mahwah, NJ: Lawrence Erlbaum Associates, Publishers; 2005.

17. Raymundo CE. Desenvolvimento de material instrucional com enfoque construtivista para cursos de bioestatística aplicada à análise epidemiológica usando R (dissertação de mestrado). Rio de Janeiro: Instituto de Medicina Social da Universidade do Estado do Rio de Janeiro – UERJ; 2009.
- 1818. Crivisqui E. Apresentação dos métodos de classificação . Londrina: U; 1999.

When p x n data are considered, given an X matrix in a dimensional space p ; the Euclidean distances between entities Xi, and Xj are expressed by:

Both the Euclidean distance, a dissimiliarity measure, and the correlation coefficient, a similarity measure, can be used to determine groups. To achieve this, there are two cluster methods, hierarchical and non-hierarchical. Several cluster criteria are possible in the hierarchical methods; of these, the Ward method (1963) was selected for the present study. This method searches for partitions that minimize loss associated with each cluster (Everitt, 1974; Bussab et al., 1990; Mingoti, 2005). This loss is quantified by the difference between the sum of squared errors of each pattern and the mean of the partition where it is included. The sum of squared errors is defined by:

where n is the total number of cluster elements and xi is the i-th cluster element.

The method, rather than putting together the two classes with the lowest distance (similarity), gathers instead two classes in a way that the resulting class has minimum dispersion, compared to all classes that could be formed in a certain stage of its algorithm1717. Raymundo CE. Desenvolvimento de material instrucional com enfoque construtivista para cursos de bioestatística aplicada à análise epidemiológica usando R (dissertação de mestrado). Rio de Janeiro: Instituto de Medicina Social da Universidade do Estado do Rio de Janeiro – UERJ; 2009.. The algorithm calculates the dispersion of each new class comprised of two original classes. The distance between objects (study subjects) to be classified must be a squared d2(Euclidean, reduced Euclidean or distance from c2). If the {k} and {k'} classes are grouped together, the increase in intra-group variance, also known as cluster level Δ(k ∪ k'), is expressed by:

where Gkand Gk'correspond to the gravity centers of classes k and k', whereas d2represents the Euclidean distance1818. Crivisqui E. Apresentação dos métodos de classificação . Londrina: U; 1999.

Microsoft Excel spreadsheets, version 2010, were used to organize data, while the SPSS 20.0 software was used to analyze clusters.

Results

The cluster technique used was the ascending hierarchical classification. The ascending or hierarchical cluster method starts with individual objects, i.e. the subjects. In the beginning, there are as many groups as there are subjects (n = 354). Those who were most similar were grouped together and the initial groups were joined according to their similarities. As the similarities decrease, all sub-groups are gathered into a single group. Aiming to select a good partition, a cluster level whose value was not very high was selected, i.e. with low change of the initial distances between objects1515. Mingoti SA. Análise de Dados Através de Métodos de Estatística Multivariada: uma abordagem aplicada. Belo Horizonte: Editora UFMG; 2005. , 1818. Crivisqui E. Apresentação dos métodos de classificação . Londrina: U; 1999.

Selection of cluster variables

Variables whose ancillary theoretical model identified itself with the behavior associated with exposure and routes of contamination were considered to create the clusters.

Organochlorines are part of a group of compounds classified as persistent organic pollutants (POPs). This attribution is due to three basic characteristics: environmental persistence, bioaccumulation (with resulting biomagnification in the trophic chain) and high toxicity. Innumerable studies have been performed and the harmful effect of these substances on the environment and public health has been confirmed, which has led to the restriction and even prohibition of its use in several countries. Properties such as low volatility, chemical stability, lipid solubility, low biotransformation and degradation rates, which caused these chemicals to become highly efficient pesticides, also banned them due to their high persistence in the environment, bioconcentration and biomagnifications in various food chains1919. Ecobichon DJ. Toxic effects of pesticides. In Amdur MO, Doull J, Klaassen CD (eds.) Casarett and Doull's Toxicology: The basic science of poisons . 4a ed. New York; McGraw-Hill; 1991. pp. 565-622..

Because of their persistence in the environment, organochlorines have a greater chance of entering several food chains and remaining in the ecosystem for an undetermined period of time. What causes these compounds to be harmful, apart from their persistence, is the fact that they are liposoluble and easily eliminated. They remain stored in the fatty tissue of the animal chain, so that animals become reservoirs of such products. There are reports that nearly 96% of human exposure to organochlorines and dioxines occurs through food intake, especially that of animal origin such as fish, meat, eggs, milk and dairy products2020. Nakagawa R et al. Maternal body burden of organochlorine pesticides and dioxins. Journal of AOAC International 1999; 82(3): 716-724..The following variables were used to define the clusters: time of residence in the area, time of contact with the soil (in occupational activities, agriculture etc.), time of animal husbandry, time of consumption of meat produced in the area, time of consumption of milk, eggs and derivatives, all of which are continuous variables measured in years.

Toxicology considers the dose (intensity) x time relation to assess how toxic any chemical compound is. All these variables were adjusted for age, using a person time calculation in which each year of exposure88. Klaassen D. Casarett and Doull'sToxicology: The Basic Science of Poisons . Companion HandBook. Fifth Edition. McGraw-Hill 6thEd; 1999.was taken into consideration to calculate the accumulated exposure.

During the Study on Risk Assessment, due to the limited amount of data on environmental dispersion of contaminants out of the target areas and to the lack of data on all target contaminants, soil and food (eggs) samples were collected to analyze the levels of contaminants21-23. The sample was systematic, using a grid based on two imaginary straight lines situated, respectively, 50 m and 100 m from the shoulders of the Camboaba Road, the main access to this area. The sampling points were defined at 500 m from these straight lines, using the main gatehouse to Cidade dos Meninos as the starting point. Beyond the proposed sampling points on the grid, other points were established in the immediate area surrounding the houses located along a stretch of the Camboaba Road. Data on the concentration of each contaminant detected in the soil samples in the main areas of emission in the Cidade dos Meninos were compared to reference values of the Dutch legislation for residential soils (MRT – Maximum Risk Tolerance – value and intervention)2424. European Food Safety Authority. Health and consumer protection directorate – general. Council directives: 76/895/EEC; 86/362/EEC; 86/363/EEC E 90/642/EEC . Disponível em http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm (Acessado em 22 de setembro de 2006).
http://ec.europa.eu/food/plant/protectio...
.

Tests were performed by a private laboratory in the city of Rio de Janeiro (limit of detection of the method: 0.01μg/kg for all compounds analyzed; the p'DDE, p'DDD, and p'DDT were quantified by the semi-quantitative method). With regard to food, eggs were selected because they store great amounts of organochlorine pesticides and, together with cow milk, represent a basic source of animal protein for locals. Pesticide levels in milk samples obtained from cows raised in the Cidade dos Meninos were used to calculate the exposure dose in foods. Sample collections were performed with milk producers located during the study. Each sample was based on the daily production of each farmer2224. European Food Safety Authority. Health and consumer protection directorate – general. Council directives: 76/895/EEC; 86/362/EEC; 86/363/EEC E 90/642/EEC . Disponível em http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm (Acessado em 22 de setembro de 2006).
http://ec.europa.eu/food/plant/protectio...
. 2323. Ministério da Saúde. Atuação do Ministério da Saúde no caso de contaminação ambiental por pesticidas organoclorados, na Cidade dos Meninos, Município de Duque de Caxias, Rio de Janeiro . Disponível em http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm? idtxt=23817 (Acessado em 22 de março de 2012).
http://portal.saude.gov.br/portal/svs/vi...
.

The analyses of pesticides of food samples were performed by a private laboratory in the city of Rio de Janeiro (limit of detection of the method: 0.01μg/kg for all compounds analyzed; the p'DDE, p'DDD, and p'DDT were quantified by the semi-quantitative method). The levels of residues of pesticides in foods were compared to the maximum limits of residues established by the European Food Safety Authority2424. European Food Safety Authority. Health and consumer protection directorate – general. Council directives: 76/895/EEC; 86/362/EEC; 86/363/EEC E 90/642/EEC . Disponível em http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm (Acessado em 22 de setembro de 2006).
http://ec.europa.eu/food/plant/protectio...
, which is considered the most complete and strictest international standard.

The doses of environmental exposure estimated by the Studies on the Assessment of Risk to Human Health performed in this area2124. European Food Safety Authority. Health and consumer protection directorate – general. Council directives: 76/895/EEC; 86/362/EEC; 86/363/EEC E 90/642/EEC . Disponível em http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm (Acessado em 22 de setembro de 2006).
http://ec.europa.eu/food/plant/protectio...
, 2525. Asmus CIRF et al. Assessment of human health risk from organochlorine pesticide residues in Cidade dos Meninos, Duque de Caxias, Rio de Janeiro, Brazil. Cad Saúde Pública 2008; 24(4); 755-66.used the following formulas:

Estimated dose per soil intake (Edsi)

where C = concentration of contaminant on the surface soil (mg/kg); IR = soil intake rate; EF = exposure factor; and BW = body weight.

Estimated dose per food intake (Edf)

where C = concentration of contaminant in the food group (MG/g); Ri = rate of intake of food group (g/day); EF = exposure factor; and BW = body weight.

The information about the estimated doses were used to weight the exposure time values for each of the routes, so that the proxy values of intensity of exposure could be obtained.

Definition of clusters

The number of clusters to be used does not follow a fixed pattern, as it depends on the researchers' objective. There is not a standard statistical criterion for inference, such as tests or similar procedures. A frequently used procedure is the stopping rule, which analyzes a certain measure of similarity or distance among clusters at each successive step, with the cluster solution being defined when the measure of similarity exceeds a specific value, i.e. when the distance between two points is greater than a value predefined by researchers.

Clusters were subsequently formed by the individual combination of subjects, one by one, in different groups, until the formation of the estimated number through modeling (data driven), which was three in this particular case.

The results indicated that cluster 1 (n = 45), here identified, has characteristics of exposure that can be considered as more intense than those identified for cluster 2 (n = 103), of intermediate exposure, which has a higher intensity than cluster 3 (n = 206).

Table 1 identifies the mean values of each of the variables used for the creation of clusters, with the respective ANOVA test. In contrast, Table 2 shows data on certain potential confounders of any analysis of organochlorines for health outcomes indicated by the literature2626. WHO. International Programme on Chemical Safety. Global Assessment Of The State-Of-The-Science Of Endocrine Disruptors . World Health Organization; 2002., revealing that they are clusters with statistically significant differences, i.e. heterogeneous groups among themselves, although homogeneous internally.

Table 1
Average values of environmental exposure times according to exposure groups.
Table 2
Bivariate analysis of potential confounding according to exposure group.

The predictive validity of clusters can be assessed in a prospective way, observing the behavior of each sub-type with regard to the different effect modification variables, such as sex, age or stage of life when exposure began. Although the study design does not enable the predictive validity of typology to be assessed, it is possible nonetheless to discuss the monitoring priorities. Clusters maintained different exposure patterns; therefore, their information could be used to categorize the exposed population and prioritize the group with the greatest exposure to screen for outcomes associated with organochlorines in the health care network, especially endocrine, reproductive, neurological, hepatic and cancer outcomes.

Conclusion

One of the aims of Environmental Health is to prevent harm to health caused by chemical contaminants present in the environment, maintaining the levels of exposure at values that do not represent an unacceptable risk. To achieve this, this risk must be identified and quantified through the biological assessment of human exposure2727. Amorim LCA. Os biomarcadores e sua aplicação na avaliação da exposição aos agentes químicos ambientais. Rev Bras Epidemiol 2003; 6(2); 158-70..

The study of common characteristics among the populations exposed to chemical substances is important to develop a program to reduce such exposure2828. Christensen R et al. European experience in chemicals management: integrating science into policy. Environ Sci Technol 2001; 45(1): 80-9.. In Brazil, there are few programs aimed at exposure prevention and risk reduction, unlike the reality of countries such as Canada, Australia, France and the United States.

One limitation of this study is that the technique used does not enable inferences of findings to be made (due to the lack of a gold standard). Nonetheless, this technique was useful for the study of these relationships and for the design of the profile of sub-groups of this population, some of which must be prioritized by actions aimed at controlling this health problem.

It is expected that the common characteristics found in this study will point towards the planning of strategies of organochlorine exposure prevention programs and promotion of future studies based on the hypotheses raised. Future studies analyzing population groups who have been exposed to accidents with organochlorines or who are using these substances at home or work, or even those living in places where exposure has not been eliminated, will be useful to increase knowledge about the associated factors and to assess the joint relations of these factors among groups.

References

  • 1. Environmental Protection Agency. Exposure Assessment Tools and Models . Disponível em http://www.epa.gov/opptintr/exposure/ (Acessado em 20 de março de 2012).
    » http://www.epa.gov/opptintr/exposure/
  • 2. International Programme on Chemical Safety. General scientific principles of chemical safety . Geneva: World Health Organization; 2000. (Training Module, 4).
  • 3. Agency for Toxic Substances and Disease Registry. Toxicological profile for DDT, DDE, DDD . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp35.html (Acessado em 19 de março de 2012).
    » http://www.atsdr.cdc.gov/toxprofiles/tp35.html
  • 4. Agency for Toxic Substances and Disease Registry. Toxicological profile for chlorophenols . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp107.html (Acessado em 19 de março de 2012).
    » http://www.atsdr.cdc.gov/toxprofiles/tp107.html
  • 5. Agency for Toxic Substances and Disease Registry. Toxicological profile for 2,3,7,8-tetrachlorodibenzo-p-dioxin . Disponível em http://www.atsdr.cdc.gov/toxprofiles/tp104.html (Acessado em 19 de março de 2012).
    » http://www.atsdr.cdc.gov/toxprofiles/tp104.html
  • 6. Agency for Toxic Substances and Disease Registry. Toxicological profile for alpha, beta, gamma, and delta-hexachlorocyclohexane. Disponível em http://www.atsdr.cdc.gov/ toxprofiles/tp43.html (Acessado em 19 de março de 2012).
    » http://www.atsdr.cdc.gov/ toxprofiles/tp43.html
  • 7. D'Amato C, Torres JPM, Malm O. DDT (diclorodifeniltricloroetano): toxicidade e contaminação ambiental. Uma revisão. Química Nova 2002; 25: 995-1002.
  • 8. Klaassen D. Casarett and Doull'sToxicology: The Basic Science of Poisons . Companion HandBook. Fifth Edition. McGraw-Hill 6thEd; 1999.
  • 9. Environmental Protection Agency. Hazardous waste. http://www.epa.gov/ebtpages/ wasthazardouswaste.html (Acessado em 22 de março de 2012).
    » http://www.epa.gov/ebtpages/ wasthazardouswaste.html
  • 10. Agency for Toxic Substances and Disease Registry. Public health assessment guidance manual . Disponível em http://www.atsdr.cdc.gov/HAC/PHAManual/appg.html (Acessado em 22 de março de 2012).
    » http://www.atsdr.cdc.gov/HAC/PHAManual/appg.html
  • 11. Reichenheim, ME & Moraes, CL. Qualidade dos instrumentos epidemiológicos. In Almeida Filho N, Barreto M (Eds.). Epidemiologia & Saúde - Fundamentos, Métodos e Aplicações . Rio de Janeiro: Guanabara-Koogan; 2011. pp. 150-64.
  • 12. Streiner DL, Norman GR. Health measurement scales. A practical guide to their development and use (4 ed.). Oxford: Oxford University Press; 2008.
  • 13. Tyron RC. Cluster Analysis. Ann Arbor, MI: Edwards Brothers; 1939.
  • 14. von Wangenheim R. Análise de Agrupamentos. Disponível em http://www.inf.ufsc.br/ ~patrec/agrupamentos.html (Acessado em 25 de março de 2012).
    » http://www.inf.ufsc.br/ ~patrec/agrupamentos.html
  • 15. Mingoti SA. Análise de Dados Através de Métodos de Estatística Multivariada: uma abordagem aplicada. Belo Horizonte: Editora UFMG; 2005.
  • 16. Wilson M. Constructing measures. An item response modeling approach . Mahwah, NJ: Lawrence Erlbaum Associates, Publishers; 2005.
  • 17. Raymundo CE. Desenvolvimento de material instrucional com enfoque construtivista para cursos de bioestatística aplicada à análise epidemiológica usando R (dissertação de mestrado). Rio de Janeiro: Instituto de Medicina Social da Universidade do Estado do Rio de Janeiro – UERJ; 2009.
  • 18. Crivisqui E. Apresentação dos métodos de classificação . Londrina: U; 1999
  • 19. Ecobichon DJ. Toxic effects of pesticides. In Amdur MO, Doull J, Klaassen CD (eds.) Casarett and Doull's Toxicology: The basic science of poisons . 4a ed. New York; McGraw-Hill; 1991. pp. 565-622.
  • 20. Nakagawa R et al. Maternal body burden of organochlorine pesticides and dioxins. Journal of AOAC International 1999; 82(3): 716-724.
  • 21. Ministério da Saúde. Avaliação de risco a saúde humana por resíduos de pesticidas organoclorados em Cidade dos Meninos, Duque de Caxias, RJ . Disponível em http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm?idtxt=23560 (Acessado em 19 de setembro de 2006).
    » http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm?idtxt=23560
  • 22. Ministério da Saúde. Atuação do Ministério da Saúde no caso de contaminação ambiental por pesticidas organoclorados, na Cidade dos Meninos, Município de Duque de Caxias, Rio de Janeiro . Disponível em http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm? idtxt=23817 (Acessado em 19 de setembro de 2006).
    » http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm? idtxt=23817
  • 23. Ministério da Saúde. Atuação do Ministério da Saúde no caso de contaminação ambiental por pesticidas organoclorados, na Cidade dos Meninos, Município de Duque de Caxias, Rio de Janeiro . Disponível em http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm? idtxt=23817 (Acessado em 22 de março de 2012).
    » http://portal.saude.gov.br/portal/svs/visualizar_texto.cfm? idtxt=23817
  • 24. European Food Safety Authority. Health and consumer protection directorate – general. Council directives: 76/895/EEC; 86/362/EEC; 86/363/EEC E 90/642/EEC . Disponível em http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm (Acessado em 22 de setembro de 2006).
    » http://ec.europa.eu/food/plant/protection/pesticides/legislation_en.htm
  • 25. Asmus CIRF et al. Assessment of human health risk from organochlorine pesticide residues in Cidade dos Meninos, Duque de Caxias, Rio de Janeiro, Brazil. Cad Saúde Pública 2008; 24(4); 755-66.
  • 26. WHO. International Programme on Chemical Safety. Global Assessment Of The State-Of-The-Science Of Endocrine Disruptors . World Health Organization; 2002.
  • 27. Amorim LCA. Os biomarcadores e sua aplicação na avaliação da exposição aos agentes químicos ambientais. Rev Bras Epidemiol 2003; 6(2); 158-70.
  • 28. Christensen R et al. European experience in chemicals management: integrating science into policy. Environ Sci Technol 2001; 45(1): 80-9.

Publication Dates

  • Publication in this collection
    June 2013

History

  • Received
    23 Apr 2012
  • Reviewed
    30 Aug 2012
  • Accepted
    31 Aug 2012
Associação Brasileira de Pós -Graduação em Saúde Coletiva São Paulo - SP - Brazil
E-mail: revbrepi@usp.br