National School Health Survey: Methodological aspects changes and comparability with the Global School-based Student Health Survey

Alan Cristian Marinho Ferreira Alanna Gomes da Silva Évelin Angélica Herculano de Morais Deborah Carvalho Malta About the authors

ABSTRACT

Objective:

To analyze the changes in the methodological aspects of the National Survey of School Health (PeNSE) and its comparability with the Global School-based Student Health Survey (GSHS).

Methods:

This evaluative study that utilized the PeNSE questionnaires from 2009, 2012, 2015, and 2019, and the GSHS questionnaires from 2013-2017 e 2018-2020. The variables analyzed included the sample size, representativeness and geographic stratification of PeNSE, the number of questions in PeNSE, the percentage similarity of the PeNSE 2019 relative to the 2015, and its comparability with GSHS.

Results:

Over the four editions of PeNSE, the sample size increased (from 63,411 in 2009 to 125,123 in 2019). There were changes in educational levels (exclusion of the 6th grade and inclusion of the 7th and 8th grades of primary and secondary education), geographic stratification (expanded to large regions and federation units), and the number of questions increased by 46%. Regarding the similarity between the 2015 and 2019 editions, 48 questions were added, 35 were excluded, and 4 were changed. In 2019, PeNSE presented 11 modules that were partially comparable and 3 that were potentially not to those of 2015. The PeNSE 2015 edition was more similar to the GSHS, with 10 comparable modules, whereas in 2019, this number was reduced to five.

Conclusion:

Since its creation, PeNSE has undergone several changes, including increased sample representativeness and number of questions across editions. However, changes to the questionnaires must be analyzed with caution, as they may compromise comparability with previous editions and international surveys.

Keywords:
Adolescents; Public health surveillance; Health surveys; Health status indicators

INTRODUCTION

The National School Health Survey (PeNSE) is a study conducted by the Brazilian Ministry of Health in partnership with the Brazilian Institute of Geography and Statistics (Instituto Brasileiro de Geografia e Estatística – IBGE), initiated in 2009. Its objective is to gather data on the health and well-being of elementary and high school students from both public and private schools across the country11 Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
https://biblioteca.ibge.gov.br/visualiza...
.

The survey was designed to be conducted every three years and is regarded as a key component of the health surveillance system for Brazilian adolescents. It allows for the monitoring of health risk and protective factors, particularly those associated with noncommunicable diseases (NCDs), such as diet, physical activity, and the use of legal and illegal substances22 Oliveira MM, Campos MO, Andreazzi MAR, Malta DC. Características da Pesquisa Nacional de Saúde do Escolar – PeNSE. Epidemiol Serv Saude. 2017; 26(3): 605-16. https://doi.org/10.5123/s1679-49742017000300017
https://doi.org/10.5123/s1679-4974201700...
. Monitoring adolescent health through PeNSE is part of Brazil's efforts to fulfill global commitments to reduce NCDs by preventing their risk factors and providing appropriate care to affected individuals33 Malta DC, Silva Jr JB. O Plano de ações estratégicas para o enfrentamento das doenças crônicas não transmissíveis no Brasil e a definição das metas globais para o enfrentamento dessas doenças até 2025: uma revisão. Epidemiol Serv Saúde. 2013; 22(1): 151-64. https://doi.org/10.5123/S1679-49742013000100016
https://doi.org/10.5123/S1679-4974201300...
.

To be truly effective in the health surveillance process and contribute to reducing NCDs risk factors, PeNSE must ensure consistency in its metrics, enabling comparability of results across its editions and with international surveys such as the Global School-based Student Health Survey (GSHS). This requires maintaining existing questions while adding new ones as necessary22 Oliveira MM, Campos MO, Andreazzi MAR, Malta DC. Características da Pesquisa Nacional de Saúde do Escolar – PeNSE. Epidemiol Serv Saude. 2017; 26(3): 605-16. https://doi.org/10.5123/s1679-49742017000300017
https://doi.org/10.5123/s1679-4974201700...
,44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
. However, changes have occurred over the editions. The first edition of PeNSE focused on 9th-grade elementary school students from all state capitals and the Federal District. By the 2019 edition, the target population had expanded to include students from the 7th grade of elementary school through the 3rd year of high school, aged 13 to 17, from across the entire country. Additionally, there were modifications to the questionnaire, involving the inclusion and exclusion of questions, as well as adjustments to question formats and response scales.

These changes in both the sampling process and the data collection instruments over the years must be made with caution to avoid affecting comparability between editions, which could undermine the surveillance system, the monitoring of health indicators, and the interpretation and analysis of data. This highlights the importance of studies that evaluate these changes over time to contribute to future editions, minimize potential analytical inconsistencies when comparing variables across years, and ensure comparability between national and international research, as recommended by the World Health Organization (WHO).

In this context, the objective of this study was to assess the methodological changes in the National Survey of School Health (PeNSE) and its comparability with the Global School-based Student Health Survey.

METHODS

Study design

This is an evaluative study that utilized the PeNSE student questionnaires from the 2009, 2012, 2015, and 2019 editions, as well as the PeNSE results books published by IBGE, to conduct a comparative evaluation of sample size, representativeness, geographic stratification, and the number of questions. To assess similarity, the materials from the 2015 and 2019 editions were compared with the GSHS student questionnaires corresponding to the periods 2013–2017 and 2018–2020.

PeNSE

PeNSE was the first Brazilian survey to examine the behavioral aspects of students in public and private schools across the country, while also addressing issues related to the family and school environment11 Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
https://biblioteca.ibge.gov.br/visualiza...
. Utilizing a two-stage cluster sampling process (schools and classes), its sample comprised all students enrolled in the selected classes who were present at school on the day the survey was conducted and met the inclusion criteria11 Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
https://biblioteca.ibge.gov.br/visualiza...
.

Global School-based Student Health Survey

GSHS was created by the WHO in partnership with the United Nations Children's Fund (UNICEF), the United Nations Educational, Scientific and Cultural Organization (UNESCO), the Joint United Nations Programme on HIV/AIDS (UNAIDS), and the Centers for Disease Control and Prevention (CDC) in 2003, aiming to assess various health aspects of students aged 13 to 17 worldwide. Made available to over one hundred countries for use and adaptation to local contexts, it is one of the largest population surveys globally, particularly among Latin American countries55 World Health Organization. Global school-based student health survey GSHS: a tool for integrated youth behavioral surveillance [Internet]. Geneva: WHO; 2018 [cited on Jun 04, 2024]. Available at: https://apps.who.int/iris/handle/10665/275390
https://apps.who.int/iris/handle/10665/2...
. GSHS employs a standardized sample selection process based on schools44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
and collects data through a questionnaire that addresses a wide range of health-related topics, including mental health, physical activity, dietary habits, and the use of alcohol, tobacco, and other drugs, among others44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
. This tool helps identify the main health challenges faced by students worldwide and guides health promotion and disease prevention initiatives within the school population55 World Health Organization. Global school-based student health survey GSHS: a tool for integrated youth behavioral surveillance [Internet]. Geneva: WHO; 2018 [cited on Jun 04, 2024]. Available at: https://apps.who.int/iris/handle/10665/275390
https://apps.who.int/iris/handle/10665/2...
. Additionally, it provides crucial information on health disparities between countries and can be used to assess the impact of public health interventions55 World Health Organization. Global school-based student health survey GSHS: a tool for integrated youth behavioral surveillance [Internet]. Geneva: WHO; 2018 [cited on Jun 04, 2024]. Available at: https://apps.who.int/iris/handle/10665/275390
https://apps.who.int/iris/handle/10665/2...
.

The GSHS questionnaires are available on the World Health Organization website (https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey).

A summary of the main features of both surveys is provided in Supplementary Material I.

Study variables

The following variables were analyzed in this study:

  1. sample used by PeNSE in each edition;

  2. representativeness of PeNSE in each edition;

  3. geographic stratification of PeNSE in each edition;

  4. number of questions in PeNSE, in each edition, by thematic module and total;

  5. percentage of similarity of the PeNSE 2019 questionnaire in relation to the PeNSE 2015 questionnaire;

  6. percentage of similarity of the PeNSE 2015 and 2019 questionnaires in relation to the GSHS 2013–2017 and 2018–2020 questionnaire;

  7. classification of the PeNSE question modules in relation to their comparability to the GSHS question modules.

Variables a and b were collected from the PeNSE results books, while variables d to g were extracted from the PeNSE and GSHS student questionnaires. For extraction, all questions from the questionnaires were tabulated in a Microsoft Office Excel® spreadsheet, with columns organized by year of completion.

Data analysis

Due to sampling considerations, only the results from the last two editions of PeNSE could be used in comparative analyses. This explains the focus on the similarity analysis for the 2015 and 2019 editions of the survey, as well as the comparability analysis with the GSHS.

To calculate the percentage of similarity between the 2015 and 2019 editions of PeNSE, the questions within each thematic module of the research were classified as follows:

  • NC (no changes) — a question in 2019 that did not present any changes compared to the 2015 edition, therefore comparable;

  • SQ (similar question) — a question in 2019 that was similar to the 2015 edition, still comparable;

  • CQ (change in the question) — a question that underwent a change in the question in 2019 compared to 2015, becoming non-comparable;

  • CR (change in the response) — a question that underwent a change in the response in 2019 compared to 2015, becoming non-comparable;

  • EQ (excluded question) — a question that existed in the 2015 edition, but was deleted in the 2019 edition, making it non-comparable;

  • NQ (new question) — a new question that was included in the questionnaire in 2019, which did not exist in the 2015 edition, thus non-comparable.

The percentage of similarity was calculated using the following formula:

(SA+QS)Cx100

Where C represents the total number of questions in the module in PeNSE 2015.

The questions were independently evaluated by peers, and in cases of disagreement, a third evaluator was consulted. The similarity analysis between PeNSE 2015 and 2019, in relation to the GSHS, followed the same methods, using the GSHS student questionnaire as a reference. According to the WHO, for a survey to be considered comparable to the GSHS, it must include at least six similar modules, with countries having the option to include additional questions44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
. In this research, a 60% similarity criterion between questions was adopted for analysis purposes.

Ethical procedures

In all editions of PeNSE, students invited to participate consented through an Informed Consent presented at the beginning of the questionnaire, with the freedom to decide whether to participate. Although there were no direct risks to students’ health, the sensitivity of the topics addressed was considered, and measures were taken to protect their well-being and comfort. Participation was voluntary, allowing students to skip any question or choose not to complete the questionnaire. Their information remained confidential, and the schools were not identified.

All editions of PeNSE received approval from the National Commission for Research Ethics (Comissão Nacional de Ética em Pesquisa – CONEP) of the National Health Council (Conselho Nacional de Saúde – CNS), which oversees and approves health research involving human subjects. The CONEP approval numbers were: 11.537/2009 (2009 edition), 16.805/2012 (2012 edition), 1.006.467/2015 (2015 edition), and 3.249.268/2019 (2019 edition). Similarly, all countries conducting research through the GSHS obtain ethical approvals from their respective national government agencies and institutional ethics committees.

RESULTS

Throughout its various editions, PeNSE has undergone sample modifications, as detailed in Chart 1. With each edition, the number of schools and students surveyed increased. The 2009 edition included 1,507 schools and a final valid sample of 63,411 students. In the most recent edition, the sample expanded to 4,361 schools with a final valid sample of 125,123 students (Chart 1).

Chart 1
Sampling aspects of the National School Health Survey in each edition. Pesquisa Nacional de Saúde do Escolar, 2009, 2012, 2015, and 2019.

In terms of representativeness, the 2009 PeNSE survey was representative of public and private schools, 9th-grade elementary students, the 26 Brazilian capitals, and the Federal District. In 2012, representativeness was expanded to include Brazil's Major Regions, and in 2015 (sample 1), it extended to the entire country. The 2015 edition (sample 2) represented public and private schools, students from the 6th grade of elementary school to the 3rd year of high school, students aged 13 to 17, the 26 Brazilian capitals, Major Regions, and Brazil. In the most recent edition, PeNSE was representative of public and private schools, students from the 7th grade of elementary school to the 3rd year of high school, students aged 13 to 17, and the entire country (Chart 1).

In terms of geographic stratification, the first edition of PeNSE allowed stratification only for Brazilian capitals and the Federal District. In the second edition, stratification was expanded to include the Major Regions. In the third edition, for sample 1, geographic stratification was possible for capitals, the Federal District, non-capitals, states, and Major Regions. Sample 2, however, was limited to stratification for Major Regions and Brazil. The latest edition enabled stratification for Major Regions, Federative Units, and municipalities within the capitals (Chart 1).

Table 1 presents the thematic modules for each edition of PeNSE, highlighting changes in the number of questions within each module and in the total number of questions in the student questionnaire. In the first edition, the survey contained 108 questions, while by 2019, this number increased to 158, representing a 46% growth (Table 1).

Table 1
Number of questions in the student questionnaire of the National School Health Survey, by thematic module and total. Pesquisa Nacional de Saúde do Escolar, 2009, 2012, 2015, and 2019.

Of the 15 thematic modules, PeNSE 2019 showed one module (Oral Hygiene and Health) with 100% similarity to the 2015 edition. Eleven modules had at least 60% similarity (general information 68%, diet 65%, physical activity 75%, cigarette use 89%, alcoholic beverages 88%, illicit drugs 83%, situations at home and at school 60%, sexual and reproductive health 83%, safety 72%, use of health services 88%, and body image 86%) (Table 2). Supplementary Material II provides a detailed comparison of all the questions from PeNSE 2015 and their counterparts in 2019, indicating whether the question remained unchanged, was similar, underwent changes in wording or response options, was excluded, or was newly added.

Table 2
Number of questions and percentage of similarity of thematic modules in the National School Health Survey from the 2019 edition compared to the 2015 edition.

In terms of comparability between the PeNSE and GSHS surveys, the 2015 edition had the highest number of modules comparable to the international survey, with eight modules in total, seven of which were considered 100% comparable. By 2019, the modules "Dietary Behavior," "Hygiene," and "Violence and Unintentional Injury" were considered potentially non-comparable, reducing the number of comparable modules to six, with only two deemed 100% comparable (Table 3).

Table 3
Comparability between the National School Health Survey and the Global School-based Student Health Survey. PeNSE, 2015 and 2019, Global School-Based Student Health Survey, 2015–2018.

Supplementary Material III provides the complete set of questions from the GSHS student questionnaire and a comparison with the 2015 and 2019 PeNSE editions.

DISCUSSION

Throughout its editions, PeNSE underwent changes in its sample size, representativeness, and geographic stratification, expanding the number of participating schools and students, educational levels, age range, and possibilities for geographic stratification. Additionally, the total number of questions increased, along with adjustments in the number of questions within each thematic module. In terms of similarity between the 2015 and 2019 editions, most modules were partially comparable, with only one being fully comparable. The modules related to mental health, asthma, and anthropometric data were deemed potentially non-comparable. Regarding comparability with the GSHS, the 2015 edition of PeNSE had more comparable modules than the 2019 edition.

Since its inception, PeNSE has employed a random probabilistic sampling technique, based on clusters, using data from the most recent school census available for the year in which the survey was conducted11 Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
https://biblioteca.ibge.gov.br/visualiza...
. This method is a strength of the survey's design, as it is compatible with the statistical analyses commonly used in quantitative epidemiological studies (confidence interval, hypothesis testing, regressions, etc.)66 Castro SMJ, Mancuso ACB, Leotti VB, Hirakata VN, Camey SA. Bioestatística e epidemiologia: perguntas que você sempre quis fazer, mas nunca teve coragem. Clin Biomed Res. 2019; 39(3): 257-65. https://doi.org/10.22491/2357-9730.96394
https://doi.org/10.22491/2357-9730.96394...
. Due to the probabilistic sampling, PeNSE is representative of schoolchildren across the entire country, granting studies based on PeNSE data a high level of inference power for this population77 Freitag RMK. Amostras sociolinguísticas: probabilísticas ou por conveniência? Revista de Estudos da Linguagem. 2018; 26(2): 667-86. https://doi.org/10.17851/2237-2083.26.2.667-686
https://doi.org/10.17851/2237-2083.26.2....
.

It is important to emphasize that analyses of PeNSE data must adhere to the sampling plan, including weights and similar calculations, to adjust for potential selection biases, such as the cluster effect. Furthermore, changes in sampling over the years, particularly regarding the target population, limit comparisons to students enrolled in the 9th grade of elementary school, typically aged 13 to 15 years old, as this group remains consistent across all survey editions.

Regarding the representativeness and geographic stratification of the data, the agencies responsible for PeNSE consistently strive to enhance the detail of the data collected by the survey. This effort is crucial, as Brazil's continental dimensions can lead to significant variations in the scenarios investigated across different regions of the country88 Cardoso BB, Vieira FMSB, Saraceni V. Aborto no Brasil: o que dizem os dados oficiais? Cad Saúde Pública. 2020; 36(Suppl 1): e00188718. https://doi.org/10.1590/01002-311X00188718
https://doi.org/10.1590/01002-311X001887...
. A representative survey with stratification for Major Regions and states enables a better understanding of health determinants at local levels, assisting in the identification of priorities that support more specific and effective actions for health protection and promotion99 Garnelo L. Especificidades e desafios das políticas públicas de saúde na Amazônia. Cad Saúde Pública. 2019; 35(12): e00220519. https://doi.org/10.1590/0102-311X00220519
https://doi.org/10.1590/0102-311X0022051...
,1010 Bezerra VM, Medeiros DS, Gomes KO, Souzas R, Giatti L, Steffens AP, et al. Inquérito de Saúde em Comunidades Quilombolas de Vitória da Conquista, Bahia, Brasil (Projeto COMQUISTA): aspectos metodológicos e análise descritiva. Ciênc Saúde Coletiva. 2014; 19(6): 1835-47. https://doi.org/10.1590/1413-81232014196.01992013
https://doi.org/10.1590/1413-81232014196...
.

The total number of questions in PeNSE has significantly expanded across its editions, enhancing the survey's investigative power by allowing the exploration of various aspects of individuals’ lives1111 Souza AC, Alexandre NMC, Guirardello EB. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde. 2017; 26(3): 649-59. https://doi.org/10.5123/S1679-49742017000300022
https://doi.org/10.5123/S1679-4974201700...
. Furthermore, new questions can be incorporated to address contemporary issues, such as the inclusion of questions related to cyberbullying in the 2019 edition.

Regarding the comparability of PeNSE between its editions, the results of this study indicated weaknesses stemming from the incomparability of thematic modules. This situation contradicts the recommendations from organizations such as the European Centre for Disease Prevention and Control (ECDC) and CDC, which define quality attributes that all public health surveillance systems should encompass. These organizations emphasize the importance of consolidating systems that facilitate comparative analyses, whether within the same system over time for examining temporal trends or between external systems, such as those in other countries1212 Center for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems. Recommendations from the Guidelines Working Group [Internet]. 2001 [cited on Jun 04, 2024]. Available at: https://www.cdc.gov/mmwr/preview/mmwrhtml/rr5013a1.htm
https://www.cdc.gov/mmwr/preview/mmwrhtm...
,1313 European Centre for Disease Prevention and Control. Data quality monitoring and surveillance system evaluation – a handbook of methods and applications [Internet]. 2014 [cited on Jun 04, 2024]. Available at: https://www.ecdc.europa.eu/en/publications-data/data-quality-monitoring-and-surveillance-system-evaluation-handbook-methods-and
https://www.ecdc.europa.eu/en/publicatio...
.

Due to changes in the questionnaires between editions, such as deletions, additions of new questions, and modifications to response options, researchers must carefully examine the questionnaire before attempting to compare the surveys. For instance, the response options for bullying were altered in 2019, rendering them incomparable with previous editions1414 Malta DC, Oliveira WA, Prates EJS, Mello FCM, Moutinho CS, Silva MAI. Bullying entre adolescentes brasileiros: evidências das Pesquisas Nacionais de Saúde do Escolar, Brasil, 2015 e 2019. Rev Latino-Am Enfermagem. 2022; 2022; 30(spe): e3679. https://doi.org/10.1590/1518-8345.6278.3679
https://doi.org/10.1590/1518-8345.6278.3...
. Similarly, the removal of the question about adolescent work in 2019 hinders the ability to track this significant issue over time.

In comparison with international surveys like the GSHS, PeNSE showed a decrease in comparability in its most recent 2019 edition, which may hinder cross-country comparisons despite meeting the minimum number of comparable modules. Such changes could present obstacles to the promotion and protection of adolescent health in Brazil, as conducting an internationally comparable survey enables the evaluation of national epidemiological patterns relative to other countries. This also fosters dialogue between nations and the creation of collaboration networks that support health management and the proposal of more effective public health measures1515 Toma TS, Pereira TV, Vanni T, Barreto JOM. Avaliação de tecnologias de saúde & políticas informadas por evidências. São Paulo: Instituto de Saúde; 2017.,1616 Aschengrau A, Seage GR. Essentials of epidemiology in public health. 4th ed. Massachusetts: Jones & Bartlett Learning; 2020..

In 2015, a significant effort was made to align PeNSE with the GSHS, resulting in eight similar modules; however, by 2019, changes in several questions reduced this similarity to six modules. Important global monitoring indicators, such as those related to physical activity and hunger, were removed in 2019, further hindering comparability11 Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
https://biblioteca.ibge.gov.br/visualiza...
,44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
. As a result, Brazil has not yet succeeded in joining the WHO list of over one hundred countries that have conducted health surveys on their adolescent populations, due to these ongoing challenges in aligning PeNSE with GSHS44 World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
https://www.who.int/teams/noncommunicabl...
.

The limitations of this study include the procedures for comparability. Due to changes in sampling, it was not possible to extend the analysis to earlier editions of PeNSE (2009 and 2012). The choice of the 60% cutoff point for the similarity analyses was a decision made by the researchers.

A key strength of this study is the recognition of PeNSE as the primary tool for monitoring the health of Brazilian schoolchildren. The current analysis seeks to assist policymakers in achieving international comparability by identifying similarities between PeNSE and GSHS. Furthermore, the comprehensive review of the questionnaires enables the identification of significant changes over time, supporting future analyses.

Over the years, PeNSE has expanded in several aspects, including the number of participating schools and students, education levels, age range, geographic data stratification options, and the total number of questions. Between the 2015 and 2019 editions, most modules are partially comparable, with only one module being fully comparable. As for comparability with the GSHS, only the 2015 edition was deemed comparable.

PeNSE has undergone various changes, both in methodological aspects such as sampling, representativeness, and geographic stratification, and in the content of the student questionnaires. These changes risk undermining the stability of the survey and compromise its comparability, both across its own editions and with international surveys like the GSHS. Such alterations may hinder critical efforts, such as the analysis of temporal trends in health indicators among Brazilian adolescents. Strengthening the comparability of the Brazilian survey with international surveys is recommended, and to achieve this, the PeNSE student questionnaire should align as closely as possible with the GSHS.

PeNSE is widely recognized for its representativeness and its established significance in national scientific research. However, researchers must exercise caution when using its data. Analyses that involve different editions of the survey or international comparisons through the GSHS should be carefully scrutinized to ensure consistency in how the information is collected, as well as in the representativeness of the target population being studied.

  • FUNDING:

    National Health Fund, Health Surveillance Secretariat, Ministry of Health (TED: 147/2018).
  • ETHICS COMMITTEE:

    The National Survey of School Health (Pesquisa Nacional de Saúde do Escolar) was approved by the National Commission on Research Ethics for Human Beings of the Ministry of Health (Approval No. 3.249.268, dated April 8, 2019).

ACKNOWLEDGMENTS:

To the National Council for Scientific and Technological Development (Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq) for the Postdoctoral Junior fellowship awarded to Alanna Gomes da Silva and the productivity fellowship granted to Deborah Carvalho Malta.

REFERENCES

  • 1
    Instituto Brasileiro de Geografia e Estatística. Pesquisa nacional de saúde do escolar: 2019 [Internet]. Rio de Janeiro: IBGE; 2021 [cited on Jun 04, 2024]. Available at: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
    » https://biblioteca.ibge.gov.br/visualizacao/livros/liv101852.pdf
  • 2
    Oliveira MM, Campos MO, Andreazzi MAR, Malta DC. Características da Pesquisa Nacional de Saúde do Escolar – PeNSE. Epidemiol Serv Saude. 2017; 26(3): 605-16. https://doi.org/10.5123/s1679-49742017000300017
    » https://doi.org/10.5123/s1679-49742017000300017
  • 3
    Malta DC, Silva Jr JB. O Plano de ações estratégicas para o enfrentamento das doenças crônicas não transmissíveis no Brasil e a definição das metas globais para o enfrentamento dessas doenças até 2025: uma revisão. Epidemiol Serv Saúde. 2013; 22(1): 151-64. https://doi.org/10.5123/S1679-49742013000100016
    » https://doi.org/10.5123/S1679-49742013000100016
  • 4
    World Health Organization. Noncommunicable disease surveillance, monitoring and reporting. Global school-based student health survey [Internet]. 2022 [cited on Jun 04, 2024]. Available at: https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
    » https://www.who.int/teams/noncommunicable-diseases/surveillance/systems-tools/global-school-based-student-health-survey/questionnaire
  • 5
    World Health Organization. Global school-based student health survey GSHS: a tool for integrated youth behavioral surveillance [Internet]. Geneva: WHO; 2018 [cited on Jun 04, 2024]. Available at: https://apps.who.int/iris/handle/10665/275390
    » https://apps.who.int/iris/handle/10665/275390
  • 6
    Castro SMJ, Mancuso ACB, Leotti VB, Hirakata VN, Camey SA. Bioestatística e epidemiologia: perguntas que você sempre quis fazer, mas nunca teve coragem. Clin Biomed Res. 2019; 39(3): 257-65. https://doi.org/10.22491/2357-9730.96394
    » https://doi.org/10.22491/2357-9730.96394
  • 7
    Freitag RMK. Amostras sociolinguísticas: probabilísticas ou por conveniência? Revista de Estudos da Linguagem. 2018; 26(2): 667-86. https://doi.org/10.17851/2237-2083.26.2.667-686
    » https://doi.org/10.17851/2237-2083.26.2.667-686
  • 8
    Cardoso BB, Vieira FMSB, Saraceni V. Aborto no Brasil: o que dizem os dados oficiais? Cad Saúde Pública. 2020; 36(Suppl 1): e00188718. https://doi.org/10.1590/01002-311X00188718
    » https://doi.org/10.1590/01002-311X00188718
  • 9
    Garnelo L. Especificidades e desafios das políticas públicas de saúde na Amazônia. Cad Saúde Pública. 2019; 35(12): e00220519. https://doi.org/10.1590/0102-311X00220519
    » https://doi.org/10.1590/0102-311X00220519
  • 10
    Bezerra VM, Medeiros DS, Gomes KO, Souzas R, Giatti L, Steffens AP, et al. Inquérito de Saúde em Comunidades Quilombolas de Vitória da Conquista, Bahia, Brasil (Projeto COMQUISTA): aspectos metodológicos e análise descritiva. Ciênc Saúde Coletiva. 2014; 19(6): 1835-47. https://doi.org/10.1590/1413-81232014196.01992013
    » https://doi.org/10.1590/1413-81232014196.01992013
  • 11
    Souza AC, Alexandre NMC, Guirardello EB. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde. 2017; 26(3): 649-59. https://doi.org/10.5123/S1679-49742017000300022
    » https://doi.org/10.5123/S1679-49742017000300022
  • 12
    Center for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems. Recommendations from the Guidelines Working Group [Internet]. 2001 [cited on Jun 04, 2024]. Available at: https://www.cdc.gov/mmwr/preview/mmwrhtml/rr5013a1.htm
    » https://www.cdc.gov/mmwr/preview/mmwrhtml/rr5013a1.htm
  • 13
    European Centre for Disease Prevention and Control. Data quality monitoring and surveillance system evaluation – a handbook of methods and applications [Internet]. 2014 [cited on Jun 04, 2024]. Available at: https://www.ecdc.europa.eu/en/publications-data/data-quality-monitoring-and-surveillance-system-evaluation-handbook-methods-and
    » https://www.ecdc.europa.eu/en/publications-data/data-quality-monitoring-and-surveillance-system-evaluation-handbook-methods-and
  • 14
    Malta DC, Oliveira WA, Prates EJS, Mello FCM, Moutinho CS, Silva MAI. Bullying entre adolescentes brasileiros: evidências das Pesquisas Nacionais de Saúde do Escolar, Brasil, 2015 e 2019. Rev Latino-Am Enfermagem. 2022; 2022; 30(spe): e3679. https://doi.org/10.1590/1518-8345.6278.3679
    » https://doi.org/10.1590/1518-8345.6278.3679
  • 15
    Toma TS, Pereira TV, Vanni T, Barreto JOM. Avaliação de tecnologias de saúde & políticas informadas por evidências. São Paulo: Instituto de Saúde; 2017.
  • 16
    Aschengrau A, Seage GR. Essentials of epidemiology in public health. 4th ed. Massachusetts: Jones & Bartlett Learning; 2020.

Publication Dates

  • Publication in this collection
    22 Nov 2024
  • Date of issue
    2024

History

  • Received
    23 July 2024
  • Accepted
    27 Aug 2024
Associação Brasileira de Pós -Graduação em Saúde Coletiva São Paulo - SP - Brazil
E-mail: revbrepi@usp.br