Prevalence of bullying and associated factors among Brazilian schoolchildren in 2015

Deborah Carvalho Malta Flávia Carvalho Malta de Mello Rogério Ruscitto do Prado Ana Carolina Micheletti Gomide Nogueira de Sá Fátima Marinho Isabella Vitral Pinto Marta Maria Alves da Silva Marta Angélica Iossi Silva About the authors

Abstract

This study analyzed the prevalence of bullying and associated factors among Brazilian schoolchildren using data produced by the 2015 National School Health Survey (PeNSE, acronym in Portuguese) consisting of a national sample of 102,301 eighth grade students. The prevalence of bullying was calculated and bivariate analysis was performed using a 95% confidence level to determine the association between victimization and socio-demographic variables and other variables relating to family background, mental health, and risk behaviors. Multivariate analysis was then conducted using the biologically plausible variables of interest. For the final model, variables that obtained p-values of < 0.05 were maintained. The prevalence of bullying was found to be 7.4%. The results of the multivariate analysis showed that boys aged 13 years studying in public schools who worked and whose mother did not have any schooling were more likely to be bullied, as were schoolchildren who felt lonely, had no friends, suffered from insomnia, skipped lessons without parental permission, and who smoked. Victims of bullying were predominantly 13-year-olds from an unfavorable social and family background, painting a picture of vulnerability that calls for support from social protection networks, schools and families alike .

Bullying; Adolescents; Violence; Vulnerability; Survey

Introduction

Adolescence is a period of transition from childhood to adult life and a time of biological, cognitive, emotional, and social changes 11. World Health Organizatin (WHO) . Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: international report from the 2009/2010 survey . Copenhagen : WHO Regional Office for Europe ; 2012 . [ Health Policy for Children and Adolescents, Nº 6 ],22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
. It is also a phase marked by increased autonomy and independence in relation to the family and experimentation with new behaviors and experiences, which may often involve risk and have long-term health effects 11. World Health Organizatin (WHO) . Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: international report from the 2009/2010 survey . Copenhagen : WHO Regional Office for Europe ; 2012 . [ Health Policy for Children and Adolescents, Nº 6 ],22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
. This stage of life is also associated with increased opportunities for social interaction, new circles of friends, and increased exposure to risks and acts of violence 11. World Health Organizatin (WHO) . Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: international report from the 2009/2010 survey . Copenhagen : WHO Regional Office for Europe ; 2012 . [ Health Policy for Children and Adolescents, Nº 6 ],33. Malta DC , Oliveira TP , Santos MAS , Andrade SSCA , Silva MMA . Tendência dos fatores de risco e proteção de doenças crônicas não transmissíveis em adolescentes, Pesquisa Nacional de Saúde do Escolar (PeNSE 2009 e 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 77 - 91 . .

Bullying is considered a systematic act of aggression characterized by physical or psychological violence through acts of intimidation, humiliation, or discrimination 44. Brasil . Lei nº 13.185, de 06 de novembro de 2015. Institui o Programa de Combate à Intimidação Sistemática ( Bullying ). Diário Oficial da União 2015 ; 9 nov . . It consists of repetitive aggressive behavior, generally over a long period of time, directed toward other people and typically including some form of power asymmetry between peers 77. Berger KS . Update on bullying at school: Science forgotten? Dev Rev 2007 ; 27 ( 1 ): 90 - 126 .

8. Olweus D . Bullying at school. Long-term outcomes for the victims end an effective school-Based Intervention program . In: Huesmann LR , editor . Agressive Behavior: Current Perpectives . New York : Plenum Press ; 1994 . p. 97 - 130 .

9. Lisboa C , Braga LL , Ebert G . O fenômeno bullying ou vitimização entre pares na atualidade: definições, formas de manifestação e possibilidades de intervenção . Contextos Clínic 2009 ; 2 ( 1 ): 59 - 71 .
-1010. Pigozi PL , Machado AL . Bullying na adolescência: visão panorâmica no Brasil . Cien Saude Colet 2015 ; 20 ( 11 ): 3509 - 3522 . . Numerous studies have addressed school bullying. However, bullying also takes place in other settings, including the workplace, sports teams, and other spaces in the community 55. Lopes Neto AA . Ações anti bullying . In: Lopes Neto AA . Bullying: saber identificar e como prevenir . São Paulo : Brasiliense ; 2011 . p. 62 - 100 .,99. Lisboa C , Braga LL , Ebert G . O fenômeno bullying ou vitimização entre pares na atualidade: definições, formas de manifestação e possibilidades de intervenção . Contextos Clínic 2009 ; 2 ( 1 ): 59 - 71 .,1010. Pigozi PL , Machado AL . Bullying na adolescência: visão panorâmica no Brasil . Cien Saude Colet 2015 ; 20 ( 11 ): 3509 - 3522 . .

Bullying is a group phenomenon that involves the majority of schoolchildren, directly or indirectly, either as a victim, bully or observer 1111. Sanders CE , Phye GD . Bullying: implications for the classroom . London : Elsevier Academic Press ; 2004 . . There are different forms of bullying, including name-calling, physical aggression, threats, stealing, verbal abuse, and causing humiliation 1212. Lamb J , Pepler DJ , Craig W . Approach to bullying and victimization . Can Fam Physician 2009 ; 55 ( 4 ): 356 - 360 . .

Bullying is a global problem documented in numerous countries. A study of schoolchildren from over 40 different countries conducted by the World Health Organization (WHO) showed that 14% of 13-year-olds reported that they had been bullied over the two months prior to the study 1313. World Health Organization (WHO) . Inequalities young people’s health: key findings from the Health Behaviour in School-aged Children (HBSC) 2005/2006 survey fact sheet . Copenhagen : WHO ; 2008 . [ Health Policy for Children and Adolescents, No. 5 ]. .

Studies have also documented the health consequences of childhood bullying, including academic difficulties 1414. Due P , Holstein BE , Lynch J , Diderichsen F , Gabhain SN , Scheidt P , Currie C ; Health Behaviour in School-Aged Children Bullying Working Group . Bullying and symptoms among school-aged children: international comparative cross sectional study in 28 countries . Eur J Public Health 2005 ; 15 ( 2 ): 128 - 132 . , sleep problems 1515. Sharp S , Thompson D . Sources of stress: a contrast between pupil perspectives and pastoral teachers’ perspectives . Sch Psychol Int 1992 ; 13 ( 3 ): 229 - 241 . , greater propensity to early school leaving 1616. Stone S , Han M . Perceived school environments, perceived discrimination, and school performance among children of Mexican immigrants . Child Youth Serv Rev 2005 ; 27 ( 1 ): 51 - 66 . , relationship problems, as well as low self-esteem 1717. Zequinão MA , Medeiros P , Pereira B . Cardoso FL . Bullying escolar um fenômeno multifacetado . Educ Pesqui 2016 ; 42 ( 1 ): 181 - 198 . , mental disorders in adulthood 1717. Zequinão MA , Medeiros P , Pereira B . Cardoso FL . Bullying escolar um fenômeno multifacetado . Educ Pesqui 2016 ; 42 ( 1 ): 181 - 198 . , and suicide 1818. Henry KL , Lovegrove PJ , Steger MF , Chen PY , Cigularov KP , Tomazic RG . The potential role of meaning in life in the relationship between bullying victimization and suicidal ideation . J Youth Adolesc 2013 ; 43 ( 2 ): 221 - 232 .,1919. Levasseur M , Kelvin EA , Grosskopf N . Intersecting identities and the association between bullying and suicide attempt among New York city youths: results from the 2009 New York city youth risk behavior survey . Am J Public Health 2013 ; 103 ( 6 ): 1082 - 1089 . .

There is a growing body of national and international literature 1818. Henry KL , Lovegrove PJ , Steger MF , Chen PY , Cigularov KP , Tomazic RG . The potential role of meaning in life in the relationship between bullying victimization and suicidal ideation . J Youth Adolesc 2013 ; 43 ( 2 ): 221 - 232 .,1919. Levasseur M , Kelvin EA , Grosskopf N . Intersecting identities and the association between bullying and suicide attempt among New York city youths: results from the 2009 New York city youth risk behavior survey . Am J Public Health 2013 ; 103 ( 6 ): 1082 - 1089 . on bullying and associated factors. Studies highlight that younger socially withdrawn schoolchildren who have few friends 2020. Malta DC , Porto DL , Crespo CD , Silva MMA , Andrade SSC , Mello FCM , Monteiro R , Silva MAI . Bullying em escolares brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 92 - 105 .,2121. Oliveira WA , Silva MAI , Mello FCM , Porto DL , Yoshinaga ACM , Malta DC . Causas do bullying: resultados da Pesquisa Nacional de Saúde do Escolar . Rev. Latino-Am. Enfermagem Artigo Original Forthcoming 2015 DOI: 10.1590/0104-1169.0022.2552 www.eerp.usp.br/rlae
www.eerp.usp.br/rlae...
and suffer from depression and anxiety 2222. Carvalhosa S , Lima L , Matos MG . Bullying – A provocação/vitimação entre pares no contexto escolar português . Anál Psicol 2001 ; 4 ( 19 ): 523 - 537 . and of those who have poor relationships with their peers 2222. Carvalhosa S , Lima L , Matos MG . Bullying – A provocação/vitimação entre pares no contexto escolar português . Anál Psicol 2001 ; 4 ( 19 ): 523 - 537 . tend to be more prone to bullying. Other factors that place children at risk of bullying are physical and mental disabilities 2323. Cruz DMC , Silva JT , Alves HC . Evidências sobre violência e deficiência: implicações para futuras pesquisas . Rev Bras Educ Espec 2007 ; 13 ( 1 ): 131 - 146 . , sexual orientation and gender identity, which can often lead to suicidal thoughts 1919. Levasseur M , Kelvin EA , Grosskopf N . Intersecting identities and the association between bullying and suicide attempt among New York city youths: results from the 2009 New York city youth risk behavior survey . Am J Public Health 2013 ; 103 ( 6 ): 1082 - 1089 . . In Brazil, a study conducted by Malta et al. 2424. Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 . using data from the 2012 National School Health Survey ( Pesquisa Nacional de Saúde do Escolar - PeNSE) showed that bullying is linked to many negative outcomes, including impacts on mental health, such as insomnia and loneliness, and smoking, and that there was often a lack emotional support provided by the family of victims. However, a number of grey areas remain, particularly in relation to work/paid work, family relationship issues, substance use, etc.

The WHO has conducted surveys across a number of countries to explore trends and provide quality evidence to inform policies and programs to tackle this problem 1313. World Health Organization (WHO) . Inequalities young people’s health: key findings from the Health Behaviour in School-aged Children (HBSC) 2005/2006 survey fact sheet . Copenhagen : WHO ; 2008 . [ Health Policy for Children and Adolescents, No. 5 ]. . The first PeNSE, conducted in 2009 based on a sample of eighth grade students across Brazil’s state capitals, showed that 5.4% of students reported that they had been bullied over the 30-day period prior to the interview 2525. Malta DC , Porto DL , Crespo CD , Silva MMA , Andrade SAC , Mello FCM , Monteiro R , Silva MAI . Bullying em escolares brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 92 - 105 . . The second edition, conducted in 2012 showed that this proportion had grown to 6.8%, which is equivalent to a 25% increase 2424. Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 . . This apparent growth in the prevalence of bullying drew even greater attention to the issue, highlighting the need for periodic monitoring and resulting in the third edition of the PeNSE in 2015, thus allowing for a comparison of behaviors over the period. The inclusion of additional questions in the survey questionnaire also allows for the observation of changes in relation to factors associated with bullying and the examination of new aspects of the problem, such as work/paid work and victimization 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
.

Based on the findings of the 2015 PeNSE, the present study aims to determine the prevalence of bullying and identify the factors associated with victimization of Brazilian schoolchildren.

Methodology

This study analyzed the data generated by the 2015 PeNSE, a cross-sectional study conducted by the Brazilian Institute of Geography and Statistics ( Instituto Brasileiro de Geografia e Estatística - IBGE) in partnership with the Ministry of Health of eighth grade students studying in public and private schools across the country. The sample is representative of the school student population across Brazil 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
.

The sample was selected in three stages: stage one, in which the municipalities or groups of municipalities were selected (primary sampling unit - PSU); stage two, in which schools were selected (secondary sampling unit - SSU); and stage three, in which classes were selected (tertiary sampling unit - TSU). All students from the randomly selected classes present on data collection day were invited to participate in the study 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
. A total of 102,301 students from 3,040 schools and 4,159 classes took part in the survey. The sample loss rate due to students who did not wish to participate in the study was 8.5%. The survey considered all students enrolled in the eighth grade studying during the day in schools with over 15 students. A 50% proportion estimate and 95% margin of error and confidence level were used to estimate sample size. A more detailed description of the sample can be found elsewhere 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
.

The present study expanded on the conceptual model put forward by Malta et al. 2424. Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 . that proposes the following factors associated with bullying: I) demographic factors; II) mental health-related factors (loneliness, insomnia, having no friends); III) family situation (living with parents, family supervision, suffering violence within the family, truancy); and IV) risk behaviors (psychoactive substance use and having had sexual relations) 2424. Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 . . The present study included additional variables relating to socioeconomic and family situation: maternal level of schooling, whether the student worked/had paid work, and living with parents.

The outcome bullying was determined using the following question: “over the last 30 days, how often have any of your classmates ridiculed, mocked, made fun of, intimidated, or teased you to such an extent that you felt hurt/uncomfortable/upset/offended/humiliated?” Answers were categorized as “No” (never, rarely, sometimes) and “Yes” (most of the time, always).

Associations were tested using the following variables:

I) Sociodemographic characteristics were analyzed using the following independent variables: a) sex (male or female); b) age (≤ 13 years, 13 years, 14 years, 15 years, and 16 years and over); c) skin color/race (white, black, brown, yellow, and indigenous); d) school (public or private); e) maternal schooling (without schooling, primary (not completed/completed), secondary (not completed/completed), higher education (not completed/completed); f) currently working (yes/no); g) paid work (yes/no).

II) Family background: a) living with mother and/or father, categorized as yes (living with mother and father, living with mother, or living with father) or no (living without mother and father); b) family supervision, categorized as yes (most of the time, parents or guardians always know what the adolescent is doing) or no (never, rarely, sometimes); c) skipping lessons without parental permission, categorized as no (never) or yes (once or twice, three or more times in the last 30 days).

III) Mental health was analyzed using the following independent variables: a) feeling lonely, categorized as no (never, sometimes in the last 12 months) or yes (most of the time, always in the last 12 months); b) insomnia, categorized as no (never, sometimes in the last 12 months) or yes (most of the time, always in the last 12 months); c) friends, categorized as no (none) or yes (one, two, three, or more friends).

IV) Risk behaviors – smoking in the last 30 days or regular smoking (yes or no), regular alcohol use or use in the last 30 days (yes or no), having tried an illicit drug at some time (yes or no), and having had sexual relations (yes or no).

Prevalence of bullying was initially calculated using the sociodemographic variables and those relating to family background, family violence, mental health, and risk behaviors. Binary logistic regression analysis was performed to determine the factors associated with the outcome (having been bullied) based on crude odds ratios (OR) and respective confidence intervals. Subsequently, multiple logistic regression analysis was performed using variables that had p-values of < 0.20. For the final model (ORa), statistically significant variables with p-values of < 0.05 were maintained. The data set was then tested for the presence of multicollinearity and interaction between variables.

The analyses took into account the sample structure and weights assigned to produce population estimates. The analyses were performed using SPSS Statistics 20, and used complex sampling designs.

The students were informed about the study and advised that their participation was voluntary and that they may quit at any time if they did not feel comfortable answering the questions. Students who gave their consent answered an individual questionnaire using a smartphone under the supervision of IBGE researchers 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
. The PeNSE was conducted in accordance with the National Health Council resolution Guidelines and Regulations for Research Involving Human Beings and was approved by the National Research Ethics Committee of the Ministry of Health ( Comissão Nacional de Ética em Pesquisas do Ministério da Saúde - CONEP/MS) (approval March 30, 2015).

Results

The sample had the following characteristics: 48.7% were males and 51.3% females; 85.5% of the sample studied in public schools and 14.5% in private schools; 0.4% were aged under 13 years, 88.6% between 13 and 15 years, and 11% 16 years and over; 36.1% were white, 13.4% black, 43.1% brown, 4.1% yellow, and 3.3% indigenous ( Table 1 ).

Table 1
Sex, type of school, age and skin color/race of the students interviewed under the National School Health Survey. Brazil, 2015.

Seven point four percent of students reported having been bullied in the last 30 days prior to the study (CI95% 7. 2-7.6). Prevalence of bullying was highest among students aged under 13 years (8.8%; CI95% 8.1-9.5) and decreased after age 14, reaching as low as 6.8% in the 16 years and over age group (CI95% 6.3-7.3). Prevalence of bullying among black schoolchildren was 8.2% (CI95% 7.2-9.3), while no statistically significant difference was found for the other skin colors. Bullying was more common among students studying in public schools and among those whose mothers did not have any schooling (9.3%; CI95% 8.5-10.3). The prevalence of bullying was higher among students who worked (9.8%; CI95% 9.3-10.3) and those who had paid work (9.3%; CI95% 8.8-9.8). With respect to mental health-related factors, bullying was more prevalent among students who reported feeling lonely (16.6%; CI95% 16.1-17.2), followed by insomnia (15.2%; CI95% 14,5-15,8), and having no friends (14.1%; CI95% 13.0-15.1).

With regard to family situation, prevalence was highest among students who were hit on a regular basis in the family environment (15.4%; CI95% 14,8-16,0), followed by those who skipped lessons without parental permission (9.9%; CI95% 9,5-10,3), and those who were supervised by their parents (6.7%; CI95% 6,5-6,9).

With respect to risk behaviors, the prevalence of bullying was highest among students who smoked (12.7%; CI95% 11.4-14.0), followed by those who used alcohol (8.8%; CI95% 8,5-9,2), those who had used drugs (8.9%; CI95% 8.3-9.5), and those who had had sexual relations (8.1%; CI95% 7.8-8.5). Table 2 shows the crude ORs.

Table 2
Frequency of occurrence of bullying among eighth grade students, prevalence and crude OR by sociodemographic factors and variable related to family background, mental health, and risk behaviors. Brazil, 2015.

The results of the multivariate analysis showed that aged 13-year-old students were more likely to be bullied . In contrast, the following age groups were less likely to be bullied: students aged under 13 years (ORa = 0.58; CI95% 0.35– 0.95), older students (14-year-olds, ORa = 0.72; CI95% 0.67– 0.77; 15-year-olds, ORa = 0.63; CI95% 0.58 – 0.69), and students aged 16 years and over (ORa = 0.51; CI95% 0.46 – 0.57)). Female students (ORa = 0.69; CI95% 0.65 – 0.73) and students studying in private schools (ORa = 0.84; CI95% 0.77– 0.92) were less likely to be bullied. With regard to sociodemographic variables, children whose mothers did not have any schooling and those who worked were more likely be bullied (ORa = 1.30; CI95% 1.15– 1.47 and ORa = 1.33; CI95% 1.23-1.43, respectively) , while the variable paid work lost its statistical significance ( Table 3 ).

Table 3
Risk factors associated with bullying among eighth grade students. Brazil, 2015.

With respect to mental health-related factors, students who reported feeling lonely, having insomnia, and having no friends were more likely be bullied (ORa 2.88; CI95% 2.69-3.08; ORa 1.50; CI95% 1.39-1.62; and ORa 1.67; CI95% 1.49-1.86, respectively).

With regard to family situation, schoolchildren who were hit on a regular basis in the family environment and who skipped lessons without parental permission were more likely to be bullied (ORa 2.35 CI95% 2.2-2.5 and ORa 1.40 CI95% 1.31-1.49. respectively).

With respect to risk behaviors, students who smoked on a regular basis were more likely to be bullied (ORa 1.16; CI95% 1.03-1.31). The relationship detected in the first model between drug use and bullying was inverted in the multivariate model, which showed that students who had used drugs were less likely to be bullied (ORa 0.82; CI95% 0.74-0.91). The other variables were not maintained in the multivariate model (Table 3).

Discussion

The findings show that 7.4% of the study sample reported that they had been bullied in the last 30 days prior to the interview. The multivariate analysis showed that male students aged 13 years studying in public schools who worked and whose mothers did not have any schooling were more likely to be bullied. Furthermore, the results show that students who felt lonely, had insomnia, smoked, suffered physical aggression at the hands of family members, and skipped lessons without parental permission were also more likely to be bullied, while drug use was shown to be a protective factor.

There is a growing body of literature on bullying 11. World Health Organizatin (WHO) . Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: international report from the 2009/2010 survey . Copenhagen : WHO Regional Office for Europe ; 2012 . [ Health Policy for Children and Adolescents, Nº 6 ],2626. Costa MR , Xavier CC , Andrade AC , Proietti FA , Caiaffa WT . Bullying among adolescents in a Brazilian urban center - “Health in Beagá Study” . Rev Saude Publica 2015 ; 49 ( 56 ): 1 - 10 .,2727. Mello FCM , Malta DC , Prado RR , Farias MS , Alencastro LCS , Silva MAI . Bullying e fatores associados em adolescentes da Região Sudeste segundo a Pesquisa Nacional de Saúde do Escolar . Rev Bras Epidemiol 2016 ; 19 ( 4 ): 866 - 877 . , which shows that the prevalence of victimization varies from country to country. In Europe and North America, studies have documented prevalence rates ranging between 5 and 20% 2828. Carlyle KE , Steinman KJ . Demographic differences in the prevalence, co-occurrence, and correlates of adolescent bullying at school . J Sch Health 2007 ; 77 ( 9 ): 623 - 629 .,2929. Schnohr C , Niclasen BV . Bullying among Greenlandic school children: development since 1994 and relations to health and health behavior . Int J Circumpolar Health 2006 ; 65 ( 4 ): 305 - 312 . , while in Africa rates have been shown to be between 21 and 40% 3030. Liang H , Flisher AJ , Lombard CJ . Bullying, violence, and risk behavior in South African school students . Child Abuse Negl 2007 ; 31 ( 2 ): 161 - 171 . . In Brazil, a cross-sectional study conducted in Pelotas with a sample of 1,075 first to eighth grades students studying at public schools showed that 17.6% had been bullied 3131. Moura DR , Cruz ACN , Quevedo LA . Prevalência e características de escolares vítimas de bullying . J Pediatr ( Rio J ) 2011 ; 87 ( 1 ): 19 - 23 . , while another study undertaken in Caxias do Sul in the State of Rio Grande do Sul in 2011 with 1,230 sixth grade students (aged between 11 and 14 years) showed that 10.2% were victims of bullying and 7.1% had bullied 3232. Rech RR , Halpern R , Tedesco A , Santos DF . Prevalence and characteristics of victims and perpetrators of bullying . J Pediatr ( Rio J ) 2013 ; 89 ( 2 ): 164 - 170 . .

These differences in prevalence rates may be explained by differences in methodology, study design, sampling, age groups studied, questionnaires and the questions used, the period and frequency used to characterize a bullying event, as well as the types of bullying considered (verbal, physical, psychological, sexual, etc.) 1010. Pigozi PL , Machado AL . Bullying na adolescência: visão panorâmica no Brasil . Cien Saude Colet 2015 ; 20 ( 11 ): 3509 - 3522 . and cultural characteristics 2626. Costa MR , Xavier CC , Andrade AC , Proietti FA , Caiaffa WT . Bullying among adolescents in a Brazilian urban center - “Health in Beagá Study” . Rev Saude Publica 2015 ; 49 ( 56 ): 1 - 10 . .

Most studies show that bullying is more prevalent among boys 3131. Moura DR , Cruz ACN , Quevedo LA . Prevalência e características de escolares vítimas de bullying . J Pediatr ( Rio J ) 2011 ; 87 ( 1 ): 19 - 23 .

32. Rech RR , Halpern R , Tedesco A , Santos DF . Prevalence and characteristics of victims and perpetrators of bullying . J Pediatr ( Rio J ) 2013 ; 89 ( 2 ): 164 - 170 .

33. Fleming LC , Jacoben KH . Bullying among middle-school students in low and middle income countries . Health Promot Int 2010 ; 25 ( 1 ): 73 - 84 .
-3434. Klomek AB , Marroco F , Kleinman M , Schnofeld IS , Gould MS . Peer victimization, depression, and suicidiality in adolescents . Suicide Life Threat Behav 2008 ; 38 ( 2 ): 166 - 180 . . However, a study conducted by Costa et al. 2626. Costa MR , Xavier CC , Andrade AC , Proietti FA , Caiaffa WT . Bullying among adolescents in a Brazilian urban center - “Health in Beagá Study” . Rev Saude Publica 2015 ; 49 ( 56 ): 1 - 10 . in Belo Horizonte did not show any statistically significant gender difference, while Ybarra et al. 3535. Ybarra ML , Diener-West M , Leaf PJ . Examining the overlap in internet harassment and school bullying: implications for school intervention . J Adolesc Health 2007 ; 41 ( 6 Supl. 1 ): S42 - 50 . found that internet bullying was more prevalent among girls. The results of the multivariate analysis confirm that males are more likely to be bullied. This result is particularly important since the crude data did not reveal this difference.

The results of the present study also show that 13-year-olds are more likely to be bullied than other ages. This is consistent with the findings of the majority of studies, which show that the prevalence of bullying tends to be greater among younger students 2727. Mello FCM , Malta DC , Prado RR , Farias MS , Alencastro LCS , Silva MAI . Bullying e fatores associados em adolescentes da Região Sudeste segundo a Pesquisa Nacional de Saúde do Escolar . Rev Bras Epidemiol 2016 ; 19 ( 4 ): 866 - 877 .,2929. Schnohr C , Niclasen BV . Bullying among Greenlandic school children: development since 1994 and relations to health and health behavior . Int J Circumpolar Health 2006 ; 65 ( 4 ): 305 - 312 .,3535. Ybarra ML , Diener-West M , Leaf PJ . Examining the overlap in internet harassment and school bullying: implications for school intervention . J Adolesc Health 2007 ; 41 ( 6 Supl. 1 ): S42 - 50 . . It is important to note, however, that the sample used for the PeNSE comprises students from the eighth grade, where the majority of students are aged between 13 and 15 years, and thus is not sufficiently representative of students under the age of 13. It should be noted, however, that the IBGE includes a subsample of students by age (13 to 17 years), which confirms the assumption that the prevalence of bullying is lower among students aged 13 22. Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
https://www.icict.fiocruz.br/sites/www.i...
.

The 2015 PeNSE showed that there is an association between being bullied and mental health-related factors such as feeling lonely, insomnia, and not having friends. This finding is particularly relevant and this situation should be monitored given that other studies have also found an association between bullying and loneliness, anxiety, insomnia, sadness, depression, post-traumatic stress disorder and suicidal thoughts 1818. Henry KL , Lovegrove PJ , Steger MF , Chen PY , Cigularov KP , Tomazic RG . The potential role of meaning in life in the relationship between bullying victimization and suicidal ideation . J Youth Adolesc 2013 ; 43 ( 2 ): 221 - 232 .,3535. Ybarra ML , Diener-West M , Leaf PJ . Examining the overlap in internet harassment and school bullying: implications for school intervention . J Adolesc Health 2007 ; 41 ( 6 Supl. 1 ): S42 - 50 .,3636. Morris EB , Zhang B , Bondy SJ . Bullying and smoking: examining the relationships in Ontario adolescents . J Sch Health 2006 ; 76 ( 9 ): 465 - 470 . , showing the extent of this problem and its grave immediate and long-term health consequences 3737. Albuquerque PP , Williams LCA , D’Affonseca SM . Efeitos Tardios do Bullying e Transtorno de Estresse Pós Traumático: Uma Revisão Crítica . Psic Teor Pesq 2013 ; 29 ( 1 ): 91 - 98 . . The 2015 PeNSE allowed us to determine associations between these variables at the national level and is therefore an important tool for monitoring factors that may result in depression and grave mental health consequences.

Different studies around the world have shown that there is an association between victimization and risk behaviors such as smoking and alcohol and drug use 3434. Klomek AB , Marroco F , Kleinman M , Schnofeld IS , Gould MS . Peer victimization, depression, and suicidiality in adolescents . Suicide Life Threat Behav 2008 ; 38 ( 2 ): 166 - 180 .,3535. Ybarra ML , Diener-West M , Leaf PJ . Examining the overlap in internet harassment and school bullying: implications for school intervention . J Adolesc Health 2007 ; 41 ( 6 Supl. 1 ): S42 - 50 .,3737. Albuquerque PP , Williams LCA , D’Affonseca SM . Efeitos Tardios do Bullying e Transtorno de Estresse Pós Traumático: Uma Revisão Crítica . Psic Teor Pesq 2013 ; 29 ( 1 ): 91 - 98 .,3838. Tharp-Taylor S , Haviland A , D’Amico EJ . Victimization from mental and physical bullying and substance use in early adolescence . Addict Behav 2009 ; 34 ( 6-7 ): 561 - 567 . Moreover, a study realized in Belo Horizonte in Brazil found that the prevalence of bullying among adolescents was greater among those who reported involvement in fighting, drug use, episodes of drunkenness, and smoking 2626. Costa MR , Xavier CC , Andrade AC , Proietti FA , Caiaffa WT . Bullying among adolescents in a Brazilian urban center - “Health in Beagá Study” . Rev Saude Publica 2015 ; 49 ( 56 ): 1 - 10 . . In a national study in Brazil, Malta et al. also documented an association between bullying and smoking in the last 30 days prior to the study 2424. Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 . , while a multivariate analysis of 2012 PeNSE data for the Southeast Region conducted by Mello et al. 2727. Mello FCM , Malta DC , Prado RR , Farias MS , Alencastro LCS , Silva MAI . Bullying e fatores associados em adolescentes da Região Sudeste segundo a Pesquisa Nacional de Saúde do Escolar . Rev Bras Epidemiol 2016 ; 19 ( 4 ): 866 - 877 . showed that alcohol was a protective factor for bullying . The latter finding was attributed to the fact that teenagers generally consume alcohol in groups of friends, making it a factor that favors socialization and interaction among peers. The results of the present study showed that only smoking was associated with bullying.

Carvalhosa et al. 2222. Carvalhosa S , Lima L , Matos MG . Bullying – A provocação/vitimação entre pares no contexto escolar português . Anál Psicol 2001 ; 4 ( 19 ): 523 - 537 . found that drug use was lower among victims of bullying. The bivariate analysis performed in the present study showed that drug use was associated with a greater likelihood of victimization. However, this relationship was inverted by the multivariate analysis, which showed drug use to be a protective factor. The test for presence of multicollinearity and interaction between variables related to risk behaviors (data not shown) showed that there was a negative interaction between having had sexual relations and drug use. Both types of risk behavior are more common among older students (aged 15 years and over). Thus, the fact that bullying was more common among younger students (13-year-olds) may explain the change in direction in the variable “drug use”, since it is associated with older students who tend to be less vulnerable to bullying . In the same way, the loss of significance of the relationship between having had sexual relations and bullying may also be explained by the negative interaction identified above. Thus, the results of our study differ from those documented in the international literature that show there is an association between sexual activity and bullying 3939. Rudatsikira E , Siziya S , Kazembe LN , Muula AS . Prevalence and associated factors of physical fighting among school-going adolescents in Namibia . Ann Gen Psychiatry 2007 ; 6 : 18 . .

Our findings also show that there was an association between skipping lessons without parental permission and suffering physical aggression at the hands of family members. These variables are indicators of lack of family cohesion and violent and insecure family environments, which in turn have a negative effect on physical and mental health 4040. Andrade SC , Yokota RT , Sá NN , Silva MM , Araújo WN , Mascarenhas MM , Malta DC . Relação entre violência física, consumo de álcool e outras drogas e bullying entre adolescentes escolares brasileiros . Cad Saude Publica 2012 ; 28 ( 9 ): 1725 - 1736 .,4141. Youngblade LM , Theokas C , Schulenberg J , Curry L , Huang IC , Novak M . Risk and promotive factors in families, schools, and communities: a contextual model of positive youth development in adolescence . Pediatrics 2007 ; 119 ( 1 ): 47 - 53 . .

Studies exploring the factors that make teenagers more vulnerable to bullying have shown that aspects such as poor physical, academic, emotional or social self-concept and low self-esteem result in an increased risk of victimization over time and can trigger aggressive behaviors 1111. Sanders CE , Phye GD . Bullying: implications for the classroom . London : Elsevier Academic Press ; 2004 . .

The above emphasizes the importance of paying special attention to both victims and perpetrator-victims. This group is particularly vulnerable and having a greater propensity toward violent behavior outside school, substance use, depression, and anxiety and obtaining and achieving particularly low psychosocial adjustment scores 4242. Zequinão MA , Medeiros P , Pereira B , Cardoso FL . Bullying escolar: um fenômeno multifacetado . Educ. Pesqui . 2016 ; 42 ( 1 ): 181 - 198 . .

In the adolescent stage of human development, social relations are the driving force behind the development of personal values and ways of thinking and acting. By entering the labor market, children and adolescents can interrupt this process and suffer discrimination, which might explain higher levels of victimization among schoolchildren who work found by this study 4343. Cruz MNA , Assunção AA . Estrutura e Organização do Trabalho Infantil de Rua em Belo Horizonte, MG, Brasil . Saúde Soc . 2008 ; 17 ( 1 ): 131 - 142 . . Having paid work was not maintained in the final model, probably because of the fact that work is a marker of the same phenomenon .

The PeNSE is the most wide-ranging survey of Brazilian school students to date, covering both public and private schools in all of Brazil’s states and state capitals. Given that the survey relies on self-reported information. The associations identified by this study should be viewed with some caution given that a cross-sectional design was used and that bullying and associated factors were measured simultaneously, thus limiting the ability to establish temporality. Furthermore, feelings of abandonment, loneliness and sadness may lead victims of bullying to adopt risk behaviors 2222. Carvalhosa S , Lima L , Matos MG . Bullying – A provocação/vitimação entre pares no contexto escolar português . Anál Psicol 2001 ; 4 ( 19 ): 523 - 537 . . Finally, other variables associated with the outcome may not have been included in the present study.

Conclusion

The findings of this study show that there is an association between school bullying and sociodemographic variables such as being male, being younger, and having a lower socioeconomic status, for example children studying in public schools who work and whose mothers do not have any schooling. Lack of family cohesion and a violent and insecure family environment and smoking are also contributing factors. These findings can help inform bullying prevention and youth protection policies and programs. Bullying affects the physical and mental health of victims and thus calls an integrated approach to tackling this problem that involves educators, health professionals, parents, and the community in general. These initiatives should focus on health promotion and protection, comprehensiveness, and intersectorality.

Acknowledgments

The authors thank the Ministry of Health, Health Surveillance Secretariat, for financing through TED.

References

  • 1
    World Health Organizatin (WHO) . Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: international report from the 2009/2010 survey . Copenhagen : WHO Regional Office for Europe ; 2012 . [ Health Policy for Children and Adolescents, Nº 6 ]
  • 2
    Brasil . Instituto Brasileiro de Geografia e Estatística (IBGE) . Pesquisa Nacional de Saúde do Escolar, (PeNSE), 2015 [ Internet ]. Rio de Janeiro : IBGE ; 2016 [ acessado 2017 Fev 01 ]. Disponível em: https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
    » https://www.icict.fiocruz.br/sites/www.icict.fiocruz.br/files/PENSE_Saude%20Escolar%202015.pdf
  • 3
    Malta DC , Oliveira TP , Santos MAS , Andrade SSCA , Silva MMA . Tendência dos fatores de risco e proteção de doenças crônicas não transmissíveis em adolescentes, Pesquisa Nacional de Saúde do Escolar (PeNSE 2009 e 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 77 - 91 .
  • 4
    Brasil . Lei nº 13.185, de 06 de novembro de 2015. Institui o Programa de Combate à Intimidação Sistemática ( Bullying ). Diário Oficial da União 2015 ; 9 nov .
  • 5
    Lopes Neto AA . Ações anti bullying . In: Lopes Neto AA . Bullying: saber identificar e como prevenir . São Paulo : Brasiliense ; 2011 . p. 62 - 100 .
  • 6
    Fundo das Nações Unidas para a Infância (Unicef) . Adolescência: uma fase de oportunidades [ Internet ]. 2011 . New York : Unicef ; 2011 [ citado 2014 Mar 19 ]. Disponível em: https://www.unicef.org/brazil/pt/br_sowcr11web.pdf
    » https://www.unicef.org/brazil/pt/br_sowcr11web.pdf
  • 7
    Berger KS . Update on bullying at school: Science forgotten? Dev Rev 2007 ; 27 ( 1 ): 90 - 126 .
  • 8
    Olweus D . Bullying at school. Long-term outcomes for the victims end an effective school-Based Intervention program . In: Huesmann LR , editor . Agressive Behavior: Current Perpectives . New York : Plenum Press ; 1994 . p. 97 - 130 .
  • 9
    Lisboa C , Braga LL , Ebert G . O fenômeno bullying ou vitimização entre pares na atualidade: definições, formas de manifestação e possibilidades de intervenção . Contextos Clínic 2009 ; 2 ( 1 ): 59 - 71 .
  • 10
    Pigozi PL , Machado AL . Bullying na adolescência: visão panorâmica no Brasil . Cien Saude Colet 2015 ; 20 ( 11 ): 3509 - 3522 .
  • 11
    Sanders CE , Phye GD . Bullying: implications for the classroom . London : Elsevier Academic Press ; 2004 .
  • 12
    Lamb J , Pepler DJ , Craig W . Approach to bullying and victimization . Can Fam Physician 2009 ; 55 ( 4 ): 356 - 360 .
  • 13
    World Health Organization (WHO) . Inequalities young people’s health: key findings from the Health Behaviour in School-aged Children (HBSC) 2005/2006 survey fact sheet . Copenhagen : WHO ; 2008 . [ Health Policy for Children and Adolescents, No. 5 ].
  • 14
    Due P , Holstein BE , Lynch J , Diderichsen F , Gabhain SN , Scheidt P , Currie C ; Health Behaviour in School-Aged Children Bullying Working Group . Bullying and symptoms among school-aged children: international comparative cross sectional study in 28 countries . Eur J Public Health 2005 ; 15 ( 2 ): 128 - 132 .
  • 15
    Sharp S , Thompson D . Sources of stress: a contrast between pupil perspectives and pastoral teachers’ perspectives . Sch Psychol Int 1992 ; 13 ( 3 ): 229 - 241 .
  • 16
    Stone S , Han M . Perceived school environments, perceived discrimination, and school performance among children of Mexican immigrants . Child Youth Serv Rev 2005 ; 27 ( 1 ): 51 - 66 .
  • 17
    Zequinão MA , Medeiros P , Pereira B . Cardoso FL . Bullying escolar um fenômeno multifacetado . Educ Pesqui 2016 ; 42 ( 1 ): 181 - 198 .
  • 18
    Henry KL , Lovegrove PJ , Steger MF , Chen PY , Cigularov KP , Tomazic RG . The potential role of meaning in life in the relationship between bullying victimization and suicidal ideation . J Youth Adolesc 2013 ; 43 ( 2 ): 221 - 232 .
  • 19
    Levasseur M , Kelvin EA , Grosskopf N . Intersecting identities and the association between bullying and suicide attempt among New York city youths: results from the 2009 New York city youth risk behavior survey . Am J Public Health 2013 ; 103 ( 6 ): 1082 - 1089 .
  • 20
    Malta DC , Porto DL , Crespo CD , Silva MMA , Andrade SSC , Mello FCM , Monteiro R , Silva MAI . Bullying em escolares brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 92 - 105 .
  • 21
    Oliveira WA , Silva MAI , Mello FCM , Porto DL , Yoshinaga ACM , Malta DC . Causas do bullying: resultados da Pesquisa Nacional de Saúde do Escolar . Rev. Latino-Am. Enfermagem Artigo Original Forthcoming 2015 DOI: 10.1590/0104-1169.0022.2552 www.eerp.usp.br/rlae
    » https://doi.org/10.1590/0104-1169.0022.2552» www.eerp.usp.br/rlae
  • 22
    Carvalhosa S , Lima L , Matos MG . Bullying – A provocação/vitimação entre pares no contexto escolar português . Anál Psicol 2001 ; 4 ( 19 ): 523 - 537 .
  • 23
    Cruz DMC , Silva JT , Alves HC . Evidências sobre violência e deficiência: implicações para futuras pesquisas . Rev Bras Educ Espec 2007 ; 13 ( 1 ): 131 - 146 .
  • 24
    Malta DC , Prado RR , Dias AJC , Mello FCM , Silva MAI , Costa MR , Caiaffa WT . Bullying e fatores associados em adolescentes brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 131 - 145 .
  • 25
    Malta DC , Porto DL , Crespo CD , Silva MMA , Andrade SAC , Mello FCM , Monteiro R , Silva MAI . Bullying em escolares brasileiros: análise da Pesquisa Nacional de Saúde do Escolar (PeNSE 2012) . Rev Bras Epidemiol 2014 ; 17 ( Supl. 1 ): 92 - 105 .
  • 26
    Costa MR , Xavier CC , Andrade AC , Proietti FA , Caiaffa WT . Bullying among adolescents in a Brazilian urban center - “Health in Beagá Study” . Rev Saude Publica 2015 ; 49 ( 56 ): 1 - 10 .
  • 27
    Mello FCM , Malta DC , Prado RR , Farias MS , Alencastro LCS , Silva MAI . Bullying e fatores associados em adolescentes da Região Sudeste segundo a Pesquisa Nacional de Saúde do Escolar . Rev Bras Epidemiol 2016 ; 19 ( 4 ): 866 - 877 .
  • 28
    Carlyle KE , Steinman KJ . Demographic differences in the prevalence, co-occurrence, and correlates of adolescent bullying at school . J Sch Health 2007 ; 77 ( 9 ): 623 - 629 .
  • 29
    Schnohr C , Niclasen BV . Bullying among Greenlandic school children: development since 1994 and relations to health and health behavior . Int J Circumpolar Health 2006 ; 65 ( 4 ): 305 - 312 .
  • 30
    Liang H , Flisher AJ , Lombard CJ . Bullying, violence, and risk behavior in South African school students . Child Abuse Negl 2007 ; 31 ( 2 ): 161 - 171 .
  • 31
    Moura DR , Cruz ACN , Quevedo LA . Prevalência e características de escolares vítimas de bullying . J Pediatr ( Rio J ) 2011 ; 87 ( 1 ): 19 - 23 .
  • 32
    Rech RR , Halpern R , Tedesco A , Santos DF . Prevalence and characteristics of victims and perpetrators of bullying . J Pediatr ( Rio J ) 2013 ; 89 ( 2 ): 164 - 170 .
  • 33
    Fleming LC , Jacoben KH . Bullying among middle-school students in low and middle income countries . Health Promot Int 2010 ; 25 ( 1 ): 73 - 84 .
  • 34
    Klomek AB , Marroco F , Kleinman M , Schnofeld IS , Gould MS . Peer victimization, depression, and suicidiality in adolescents . Suicide Life Threat Behav 2008 ; 38 ( 2 ): 166 - 180 .
  • 35
    Ybarra ML , Diener-West M , Leaf PJ . Examining the overlap in internet harassment and school bullying: implications for school intervention . J Adolesc Health 2007 ; 41 ( 6 Supl. 1 ): S42 - 50 .
  • 36
    Morris EB , Zhang B , Bondy SJ . Bullying and smoking: examining the relationships in Ontario adolescents . J Sch Health 2006 ; 76 ( 9 ): 465 - 470 .
  • 37
    Albuquerque PP , Williams LCA , D’Affonseca SM . Efeitos Tardios do Bullying e Transtorno de Estresse Pós Traumático: Uma Revisão Crítica . Psic Teor Pesq 2013 ; 29 ( 1 ): 91 - 98 .
  • 38
    Tharp-Taylor S , Haviland A , D’Amico EJ . Victimization from mental and physical bullying and substance use in early adolescence . Addict Behav 2009 ; 34 ( 6-7 ): 561 - 567
  • 39
    Rudatsikira E , Siziya S , Kazembe LN , Muula AS . Prevalence and associated factors of physical fighting among school-going adolescents in Namibia . Ann Gen Psychiatry 2007 ; 6 : 18 .
  • 40
    Andrade SC , Yokota RT , Sá NN , Silva MM , Araújo WN , Mascarenhas MM , Malta DC . Relação entre violência física, consumo de álcool e outras drogas e bullying entre adolescentes escolares brasileiros . Cad Saude Publica 2012 ; 28 ( 9 ): 1725 - 1736 .
  • 41
    Youngblade LM , Theokas C , Schulenberg J , Curry L , Huang IC , Novak M . Risk and promotive factors in families, schools, and communities: a contextual model of positive youth development in adolescence . Pediatrics 2007 ; 119 ( 1 ): 47 - 53 .
  • 42
    Zequinão MA , Medeiros P , Pereira B , Cardoso FL . Bullying escolar: um fenômeno multifacetado . Educ. Pesqui . 2016 ; 42 ( 1 ): 181 - 198 .
  • 43
    Cruz MNA , Assunção AA . Estrutura e Organização do Trabalho Infantil de Rua em Belo Horizonte, MG, Brasil . Saúde Soc . 2008 ; 17 ( 1 ): 131 - 142 .

Publication Dates

  • Publication in this collection
    02 May 2019
  • Date of issue
    Apr 2019

History

  • Received
    20 Jan 2017
  • Reviewed
    18 Apr 2017
  • Accepted
    22 June 2017
ABRASCO - Associação Brasileira de Saúde Coletiva Rio de Janeiro - RJ - Brazil
E-mail: revscol@fiocruz.br