Abstract
This study analyzed the validity and reliability of an instrument with scales measuring factors associated with screen time in adolescents. Two cross-sectional studies included students for analyses of validity and internal consistency (n=1138, 51.5% boys) and test-retest reproducibility (n=194, 56.2% boys). Individual (attitude, self-efficacy and expectations), social (behaviors, rules, beliefs and family support and support of school members) and physical environmental (home and bedroom equipment) factors of screen time were evaluated. All the scales of the instrument met the statistical criteria of the validity of the exploratory factorial analysis (p<0.001). The exploratory factorial analysis indicated five one-dimensional and three two-factor scales (self-efficacy, expectations and familiar behavior), with factorial loads of 0.56 to 0.88. There were significant correlations between the scores of almost all the scales and the reported screen time (p<0.05). Eight of nine scales/subscales showed Cronbach’s α value being higher than 0.70, and ICC ranged from 0.63 to 0.83. In conclusion, the instrument presented scales with acceptable validity and reliability and can be used to measure factors associated with screen time in Brazilian students.
Key words
Sedentary lifestyles; Associated factors; Questionnaire; Validity tests; Reproducibility of results
Resumo
Este estudo analisou a validade e a confiabilidade de um instrumento com escalas de fatores associados ao tempo de tela em adolescentes. Dois estudos transversais incluíram escolares para análises de validade (n=1138, 51,5% meninos) e reprodutibilidade teste-reteste (n=194, 56,2% meninos) do instrumento. Fatores individuais (atitude, autoeficácia e expectativas), do ambiente social (comportamentos, regras, crenças e suporte familiar e suporte dos membros da escola) e físico (casa e no quarto) associados ao tempo de tela foram avaliados. Todas as escalas do instrumento atenderam os critérios estatísticos de validade da análise fatorial exploratória (p<0.001). A análise fatorial exploratória indicou cinco escalas unidimensionais e três bi-dimensionais (autoeficácia, expectativas e comportamento familiares), com cargas fatoriais de 0,56 a 0,88. Houve correlações significativas entre quase todas as escalas e o tempo de tela reportado (p<0,05). Oito das nove escalas apresentaram um valor de α de Cronbach superior a 0,70, e o CCI variou de 0,63 a 0,83. O instrumento apresentou escalas que se apresentaram com validade e confiabilidade aceitáveis, podendo ser utilizado na mensuração de fatores associados ao tempo de tela em escolares brasileiros.
Palavras-chave
Estilos de vida sedentários; Fatores associados; Questionário; Testes de validade; Reprodutibilidade de resultados
Introduction
Reducing screen time seems to be an emerging topic in public health promotion in Brazilian children and adolescents, as supported by the Brazilian Society of Pediatrics11 Sociedade Brasileira de Pediatria (SBP). Promoção da Atividade Física na Infância e Adolescência [Internet]. 2017 [acessado 2017 Set 21]. Disponível em: ://www.sbp.com.br/fileadmin/user_upload/ 19890d-MO-Promo_AtivFisica_na_Inf_e_Adoles. pdf
://www.sbp.com.br/fileadmin/user_upload/... . One of the relevant pathways for effective interventions in reducing screen time among young people is understanding the factors on which to focus during the intervention strategies/actions (i.e., modifiable factors that can influence screen time)22 Chastin SFM, De Craemer M, Lien N, Bernaards C, Buck C, Oppert J-M, Nazare J-A, Lakerveld J, O'Donoghue G, Holdsworth M, Owen N, Brug J, Cardon G, DEDIPAC consortium, expert working group and consensus panel. The SOS-framework (Systems of Sedentary behaviours): an international transdisciplinary consensus framework for the study of determinants, research priorities and policy on sedentary behaviour across the life course: a DEDIPAC-study. Int J Behav Nutr Phys Act 2016; 13:83..
A theoretical framework that is used to understand the factors associated with screen time is the socio-ecological framework. This framework emphasizes that factors from different levels may explain why and how young people had specific behaviors: these can be individual (e.g., self-efficacy and expectations), social (e.g., social support of friends and family) and physical environmental (e.g., house equipment) factors33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133.,44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265.. The SOS-framework (Systems of Sedentary Behaviors) is another approach that suggest the potential determinants of sedentary behavior (including screen time) across the life course; this approach also suggests that factors from different levels (specially, considering the interaction between factors from psychological to environments levels) should be considered in studies on determinants of screen time and other sedentary behaviors22 Chastin SFM, De Craemer M, Lien N, Bernaards C, Buck C, Oppert J-M, Nazare J-A, Lakerveld J, O'Donoghue G, Holdsworth M, Owen N, Brug J, Cardon G, DEDIPAC consortium, expert working group and consensus panel. The SOS-framework (Systems of Sedentary behaviours): an international transdisciplinary consensus framework for the study of determinants, research priorities and policy on sedentary behaviour across the life course: a DEDIPAC-study. Int J Behav Nutr Phys Act 2016; 13:83..
Some studies have analyzed factors associated with screen time44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265.,55 Garcia JM, Agaronov A, Sirard JR, Whaley D, Rice DJ, Weltman A. psychosocial and friend influences on objective sedentary behavior and screen time: A mixed methods analysis. J Phys Act Health 2017; 14(3):213-221., but a few studies have examined a comprehensive set of factors at different levels of influences. Thus, which factors and levels influence on screen time among young people is an unanswerable question33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133.. A possible explanation for a few studies on this topic is the scarcity of valid and reliable instruments to measure the behavior (screen time) and its correlates33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133.,66 Lubans DR, Hesketh K, Cliff DP, Barnett LM, Salmon J, Dollman J, Morgan PJ, Hills AP, Hardy LL. A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents. Obes Rev 2011; 12(10):781-99.,77 Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206.. Few studies presented validated and reliable instruments on individual and environmental factors associated with screen time in children and adolescents33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133.,77 Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206., and in Brazil, to our knowledge, no instrument was found with validity and reliability indicators. Thus, this is a gap in the national and international literature77 Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206.. Filling this gap is relevant, because validated and reliable scales are relevant to adequately measure screen time correlates and to understand the effectiveness of screen time interventions on modifiable determinants of this behavior.
Therefore, the present study aimed to examine the validity and reliability of an instrument for measuring individual, social environmental and physical environmental factors associated with screen time among Brazilian students.
Method
The instrument used in this study was developed in order to measure factors associated with screen time in an intervention study that aimed for active and healthy lifestyle promotion among students in Fortaleza, northeastern Brazil – the “Fortaleça sua Saúde” program. A detailed description of the population of interest, sampling and intervention program is in the trial record (ClinicalTrials.Gov) and in a previous publication88 Barbosa Filho VC, Lopes AS, Lima AB, Souza EA,Gubert FA, Silva KS, Vieira NFC, Trompieri Filho N,Araújo TS, Bruin PFC, Mota J, “Fortaleça sua Saúde” Working Group. Rationale and methods of a cluster-randomized controlled trial to promote active and healthy lifestyles among Brazilian students: the “Fortaleça sua Saúde” program. BMC Public Health 2015; 15:1212..
This instrument was constructed considering a socio-ecological approach of sedentary behavior77 Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206.,99 Owen N, Salmon J, Koohsari MJ, Turrell G, Giles-Corti B. Sedentary behaviour and health: mapping environmental and social contexts to underpin chronic disease prevention. Br J Sports Med 2014; 48(3):174-177.. The developed instrument focused on evaluating modifiable factors of screen time in order to be attempted in intervention studies. Thus, most of the scales considered items that included sentences focused on reducing screen time (i.e., attitude, self-efficacy, family’s support and school members’ support for reducing screen time). Other scales focused on measuring the construct related with screen time, such as the screen equipment in the bedroom88 Barbosa Filho VC, Lopes AS, Lima AB, Souza EA,Gubert FA, Silva KS, Vieira NFC, Trompieri Filho N,Araújo TS, Bruin PFC, Mota J, “Fortaleça sua Saúde” Working Group. Rationale and methods of a cluster-randomized controlled trial to promote active and healthy lifestyles among Brazilian students: the “Fortaleça sua Saúde” program. BMC Public Health 2015; 15:1212..
During the selection of scales and items for this instrument, different scales and items were extracted and adapted from other instruments previously validated for adolescents1010 Gebremariam MK, Totland TH, Andersen LF, Bergh IH, Bjelland M, Grydeland M, Ommundsen Y, Lien N. Stability and change in screen-based sedentary behaviours and associated factors among Norwegian children in the transition between childhood and adolescence. BMC Public Health 2012; 12:104.
11 Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24.
12 Jago R, Baranowski T, Watson K, Bachman C, Baranowsi JC, Thompson D, Hernández AE, Venditti E, Blackshear T, Moe E. Development of new physical activity and sedentary behavior change self-efficacy questionnaires using item response modeling. Int J Behav Nutr Phys Act 2009; 6:20.
13 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.
14 Salmon J, Hume C, Ball K, Booth M, Crawford D. Individual, social and home environment determinants of change in children's television viewing: The Switch-Play intervention. J Sci Med Sport 2006; 9(5):378-387.-1515 Tandon PS, Zhou C, Sallis JF, Cain KL, Frank LD, Saelens BE. Home environment relationships with children's physical activity, sedentary time, and screen time by socioeconomic status. Int J Behav Nutr Phys Act 2012; 9(1):88.. This decision was made because a single instrument was not considered a broad evaluation of modifiable factors of screen time. Also, adaptations on the scales were performed in order to consider a specific type of sedentary behavior (screen time), considering that most of previous scales were based on total sedentary behavior). The used items and scales were in English and, thus, they had a process of translation and language adaptation in order to consider relevant expressions and contexts related to adolescent’s behavior. All process was performed by two experts that are familiar with development and validation of instrument, as well as terms of the literature on screen time and sedentary behavior. A full version of the instrument was evaluated by five stakeholders with several publications on sedentary behavior and theoretical and practical experience in the validation process of instruments. After stakeholder suggestions, the corrected version was filled out by the students. The final version of the instrument is in Chart 1.
Study samples
Study 1 - Validity internal consistency
One sample was evaluated in order to examine the validity and internal consistency (reliability) of the instrument. For this aim, 1,272 students from 40 classes of 7-9 grades in all six public secondary full-time schools in Fortaleza (Brazil) were eligible; they were invited to participate in the “Fortaleça sua Saúde” program88 Barbosa Filho VC, Lopes AS, Lima AB, Souza EA,Gubert FA, Silva KS, Vieira NFC, Trompieri Filho N,Araújo TS, Bruin PFC, Mota J, “Fortaleça sua Saúde” Working Group. Rationale and methods of a cluster-randomized controlled trial to promote active and healthy lifestyles among Brazilian students: the “Fortaleça sua Saúde” program. BMC Public Health 2015; 15:1212.. Of these, 87 were not present for the data collection; four students refused to participate, and 47 questionnaires were excluded, due to completion errors. A total of 1,138 students had valid data. This sample size was adequate for estimating validity and reliability parameters, considering the rate of approximately 20 individuals for each item of the instrument1616 Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis [Internet]. Prentice Hall; 2009 [acessado 2017 Ago 25]. Disponível em: ://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523
://gen.lib.rus.ec/book/index.php?md5=FCD... .
Study 2 - Test-retest reproducibility (reliability)
Another sample was used to verify the test-retest reproducibility of the instrument. For this, two public schools in Fortaleza, independent of the schools in Study 1, were intentionally selected. Students from the 12 classes of 7-9 grades were eligible. In total, 194 students contributed test-retest data. This sample allows for the identification of ICC greater than 0.20 as statistically significant (α=0.05) and 80% power (β=0.20) with two instrument applications.
Instruments
The instrument examined in this study was initially composed of 60 items that were structured in nine scales. A detailed description of each scale is in Table 1. Three scales were related to individual factors. The attitude for reducing screen time scale (3 items) represents the affective and instrumental aspects for reducing screen time, considering contrasting adjectives, such as fun–boring, important–negligible, health-harmful1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.. The self-efficacy for reducing screen time scale represents the students’ perceptions of the confidence and abilities to reduce their screen time1212 Jago R, Baranowski T, Watson K, Bachman C, Baranowsi JC, Thompson D, Hernández AE, Venditti E, Blackshear T, Moe E. Development of new physical activity and sedentary behavior change self-efficacy questionnaires using item response modeling. Int J Behav Nutr Phys Act 2009; 6:20.,1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.. The expectations of screen time scale measured the students’ perception on the positive (8 items) and negative (4 items) expectations about their screen time1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.,1414 Salmon J, Hume C, Ball K, Booth M, Crawford D. Individual, social and home environment determinants of change in children's television viewing: The Switch-Play intervention. J Sci Med Sport 2006; 9(5):378-387.,1717 Norman GJ. Psychosocial and Environmental Correlates of Adolescent Sedentary Behaviors. Pediatrics 2005; 116(4):908-916.. Five were social/environmental factor scales. The scale of family’s screen time use represents the students’ perception on the frequency of screen time among parents and other family’s members, that could be performed alone or together with the students (8 items)1414 Salmon J, Hume C, Ball K, Booth M, Crawford D. Individual, social and home environment determinants of change in children's television viewing: The Switch-Play intervention. J Sci Med Sport 2006; 9(5):378-387.,1818 Salmon J, Timperio A, Telford A, Carver A, Crawford D. Association of family environment with children's television viewing and with low level of physical activity. Obesity 2005; 13(11):1939-1951.. One scale evaluated the students’ perception of family rules of screen time (six items)1111 Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24., and another scale was focused on measuring the family’s beliefs on screen time (3 items)1717 Norman GJ. Psychosocial and Environmental Correlates of Adolescent Sedentary Behaviors. Pediatrics 2005; 116(4):908-916.. Also, the family’s support for reducing screen time (5 items) and the schools’ members support for reducing screen time (4 items) were evaluated in two separated scales1111 Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24.,1515 Tandon PS, Zhou C, Sallis JF, Cain KL, Frank LD, Saelens BE. Home environment relationships with children's physical activity, sedentary time, and screen time by socioeconomic status. Int J Behav Nutr Phys Act 2012; 9(1):88.,1717 Norman GJ. Psychosocial and Environmental Correlates of Adolescent Sedentary Behaviors. Pediatrics 2005; 116(4):908-916.. Finally, the scales on the physical environmental variables included eight items of the screen equipment (e.g., computer with Internet access, etc.) in the students’ homes and bedrooms1111 Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24.,1414 Salmon J, Hume C, Ball K, Booth M, Crawford D. Individual, social and home environment determinants of change in children's television viewing: The Switch-Play intervention. J Sci Med Sport 2006; 9(5):378-387..
Description of the scales used in this instrument for measuring factors associated to screen time among Brazilian students. Fortaleza, Brazil, 2014.
Students self-reported gender, age and grade. Students reported screen time during free time, using four standardized questions1919 Silva KS, Lopes AS, Hoefelmann LP, Cabral LGA, De Bem MFL, Barros MVG, Nahas MV. Health risk behaviors Project (COMPAC) in youth of the Santa Catarina State, Brazil: ethics and methodological aspects. Rev Bras Cineantropometria Amp Desempenho Hum 2013; 15(1):1-15.. These questions were related to habitual daily time watching TV or using computer/video games on weekdays and weekend days separately. These questions were combined in order to estimate the total screen time as well as the time watching TV or using computer/video games on habitual days.
Procedures
Study 1 - Validity and internal consistency (reliability)
Evaluators previously trained in theoretical explanations and practical simulations administered the instrument with students in the classroom, without the presence of teachers. Prior to administration, the evaluators provided instructions and read each question aloud. Then, the students answered the questions. Data collection was conducted in November and December 2014.
Study 2 - Test-retest reproducibility (reliability)
An identical application was also performed during the test-retest data collections. Data collection was applied (test) and repeated (retest) at an interval of 15 days. In the first application, students received the instrument in an envelope to complete. In the second application, the same procedure was carried out. Data collections were conducted in June 2014.
Data analysis
We used mean, standard deviation and frequency for a description of the sample characteristics. All analyses were performed using the software SPSS 21.0 (SPSS, Inc., Chicago, IL) with a significance level of 5%.
Study 1 - Validity and internal consistency (reliability)
Construct (factorial) validation was analyzed using exploratory factorial analysis, considering the principal component method with Promax rotation, because correlations between the constructs are expected by the theory. This procedure was performed in order to define factors and items that were extracted in each scale (Table 1). For this, factors were retained if their self-values were equal to or greater than one, and items with a factor loading equal to or greater than 0.4 were considered relevant1616 Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis [Internet]. Prentice Hall; 2009 [acessado 2017 Ago 25]. Disponível em: ://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523
://gen.lib.rus.ec/book/index.php?md5=FCD... . The adequacy of the variable items for factor analysis was assessed using the Kaiser Meyer-Olkin (KMO) index, Bartlett’s Sphericity Test (BST) and the measure of sampling adequacy (MSA). Satisfactory values were considered if KMO and MSA ≥0.60 and BST with statistical significance at p<0.051616 Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis [Internet]. Prentice Hall; 2009 [acessado 2017 Ago 25]. Disponível em: ://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523
://gen.lib.rus.ec/book/index.php?md5=FCD... . Items on screen equipment were evaluated separately (not analyzed as a scale), because each item may have an isolated association with screen time among students, i.e., they do not build a construct (factor)99 Owen N, Salmon J, Koohsari MJ, Turrell G, Giles-Corti B. Sedentary behaviour and health: mapping environmental and social contexts to underpin chronic disease prevention. Br J Sports Med 2014; 48(3):174-177..
Construct validity was assessed using Spearman’s correlation coefficient (rho) between the scale scores and reported total screen time. We standardized the scores of the items in a positive direction relationship with the screen time. Items with higher values representing conditions that were less favorable to screen time had their values reversed before the sum of the scale scores.
Internal consistency was tested using Cronbach’s α, because it is the main parameter used in studies on reliability of scales, including in studies on sedentary behaviors66 Lubans DR, Hesketh K, Cliff DP, Barnett LM, Salmon J, Dollman J, Morgan PJ, Hills AP, Hardy LL. A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents. Obes Rev 2011; 12(10):781-99.. Values α≥0.70 and ranging from 0.60 to 0.69 were considered adequate and substantial, respectively2020 Brown H, Hume C, ChinAPaw M. Validity and reliability of instruments to assess potential mediators of children's physical activity: A systematic review. J Sci Med Sport 2009; 12(5):539-548..
Study 2 - Test-retest reproducibility (reliability)
Test-retest reliability was assessed using the ICC with a confidence interval of 95% (95%CI) between test-retest measurements. ICC values ≥0.70 were considered adequate, and values from 0.60 to 0.69 were considered substantial2020 Brown H, Hume C, ChinAPaw M. Validity and reliability of instruments to assess potential mediators of children's physical activity: A systematic review. J Sci Med Sport 2009; 12(5):539-548..
Ethical Considerations
Parents/guardians of the students authorized participation in this study by signing the informed consent. The National Research Ethics System approved this research project.
Results
Characteristics of samples
The final samples were 1,138 and 194 in studies 1 and 2, respectively. No statistically significant difference between samples was found for gender, age groups and school grade and time watching TV (p>0.05). A sample of test-retest reproducibility (Study 2) showed a higher proportion of students who reported using computer/video games two or more hours per day (63.9% versus 48.7%; p<0.05, Table 2).
Validity and internal consistency
Exploratory factor analysis
All results for the KMO and MSA tests were higher than 0.60 and statistically significant for Bartlett’s sphericity test (p<0.001), indicating that the exploratory factor analysis was adequate in the tested scales (Table 3).
Analyses of validity and reliability parameters of scales of factors associated to screen time among Brazilian students. Fortaleza, Brazil, 2014.
A single factor was identified for attitude for reducing screen time (the proportion of explained variance by the items was 57.9%). Two factors were identified in the scale of self-efficacy for reducing screen time, which were labeled as individual limits and abilities and confidence. The total variance explained by the items was 39.3% and 10.8%, respectively. Two factors were extracted with all items of the scale expectations of screen time: positive expectations (33.3% of total variance) and negative expectations (17.5% of total variance, Table 3).
Two factors were identified in the scale of family’s screen time use: family’s TV use (35.0% of total variance) and family’s computer/games use (20.7% of total variance). One factor was extracted for each scale: family’s rules of screen time, family’s beliefs on screen time, family’s support for reducing screen time and school members’ support for reducing screen time. The total variance explained by the items was 57.9%, 53.5%, 54.2% and 68.7%, respectively (Table 3).
Construct validity
The scores of almost all scales and subscales presented statistically significant correlations with total screen time. The significant correlations coefficients ranged from -0.068 (p<0.001, subscale of self-efficacy related to confidence for reducing screen time) to 0.462 (p<0.001, subscale of positive expectations). In general, similar results were found when time watching TV and time using computer/games were analyzed separately (Table 4).
Spearman correlation (rho) between scale scores and reported daily screen time use among students. Fortaleza, Brazil, 2014.
Considering the items of physical environment, the quantity of screen equipment at home and in the bedroom showed a statistically significant correlation with screen time. All significant correlations ranged from 0.109 (p<0.001, number of TVs in the bedroom) to 0.244 (p<0.001, number of computers with Internet access at home). Also, similar results were found when time watching TV and time using computer/games were analyzed separately (Table 4).
Internal consistency (reliability)
Eight of nine scales showed adequate Cronbach’s α values (≥0.70), ranging from 0.70 (subscale of negative expectations of screen time) to 0.85 (subscale of self-efficacy: individual limits and abilities for reducing screen time, positive expectations of screen time, family rules of screen time and school members’ support for reducing screen time). The scale of attitude for reducing screen time (α=0.64) and the subscale of self-efficacy: confidence for reducing screen time (α=0.61) showed substantial internal consistency. The scale of family’s beliefs on screen time had a Cronbach’s α of 0.55 (Table 3).
Study 2 - Test-retest reproducibility (reliability)
The ICC of the scales ranged from 0.63 (self-efficacy for reducing screen time) to 0.78 (positive expectations of screen time). Considering the physical environmental variables (screen equipment), the ICC ranged from 0.66 (number of computers without Internet access at home) to 0.83 (number of video games in the bedroom).
Discussion
The present study aimed to examine the validity and reliability of an instrument with nine scales that represents potential modifiable factors associated with screen time among Brazilian students. In general, scales had acceptable validity, internal consistency, and test–retest reproducibility. Valid and reliable measures of individual, social and physical environmental factors associated with screen time are fundamental for exploring and understanding the factors that could be target of surveillance and interventions on screen time among young people.
The attitude for reducing screen time scale was confirmed with all three items, with a significant correlation with screen time among students. The attitude is a fundamental construct for determining an individual’s intention to perform behavior, for example, when the child or adolescent has a positive attitude towards reducing screen time, it is probable that this reduction occurs44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265.. This factor is frequently evaluated in physical activity intervention studies44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265., but studies on this factor for sedentary behavior and screen time are limited, mainly because scales on attitude for screen time are scare44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265.. Considering that attitude is considered by an international transdisciplinary framework for the studies on sedentary behavior across the life course22 Chastin SFM, De Craemer M, Lien N, Bernaards C, Buck C, Oppert J-M, Nazare J-A, Lakerveld J, O'Donoghue G, Holdsworth M, Owen N, Brug J, Cardon G, DEDIPAC consortium, expert working group and consensus panel. The SOS-framework (Systems of Sedentary behaviours): an international transdisciplinary consensus framework for the study of determinants, research priorities and policy on sedentary behaviour across the life course: a DEDIPAC-study. Int J Behav Nutr Phys Act 2016; 13:83., we suggest the use of the attitude for reducing screen time scale in intervention studies, because it may be important to understand whether interventions are effective on this construct and whether it helps in reducing the screen time among young people.
The scale of self-efficacy for reducing screen time was confirmed with eleven items and a two-factor structure (individual limits and abilities and confidence) and scores with statistically significant correlation with screen time (rho=0.200). Differently, Norman et al.1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575. found a scale of self-efficacy for reducing sedentary behaviors (including other behaviors besides screen time) in 11- to 15-year-old American adolescents composed by one factor (seven items) – this was one of the first studies focused on developing and validating a scale on factors associated with screen time. Difference between scales may represent the fact that various cultures might affect the self-efficacy systems. Students’ perception of abilities and confidence is relevant to define individual strategies for a specific behavior, but studies measuring self-efficacy as a potential determinant of screen time33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133. or in interventions studies for reducing screen time44 Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265. are still scare. Thus, we believe the measurement of self-efficacy for reducing screen time is a relevant aspect of the proposed instrument and in future intervention studies, because it can help to understand different facets of the self-efficacy and how they can explain screen time changes among young people.
Outcome expectation is a factor mentioned in the Social Cognitive Theory and Health Belief Model that has been studied as a correlate of physical activity2121 Williams DM, Anderson ES, Winett RA. A review of the outcome expectancy construct in physical activity research. Ann Behav Med 2005; 29(1):70-79., but studies on screen time are insufficient. In our study, negative expectations and positive expectations constructs were identified and they had significant correlations with screen time. Similarly, Norman et al.1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575. developed a “decisional balance” scale with negative and positive expectations of screen time. The existence of two factors indicates the importance of both the benefits and the costs related to observed behavior, reflecting the level of motivation to change behavior. The scale on outcome expectations of screen time had satisfactory validity parameters and, thus, studies measuring these constructs help to understand whether the perception of benefits and costs is associated with screen time, as well as how interventions focused on these constructs can be effective on reducing screen time among adolescents.
The family’s screen time use scale presented the highest correlation coefficient (rho=0.283) with screen time between social environmental scales, and the family’s beliefs on screen time scale presented a significant correlation with screen time (rho=0.138). Members of the family may be considered the primary agents for the development of healthy behavior in children and adolescents1111 Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24., and family-related factors were considered in the pioneer studies on scales of factors associated with screen time among young people1313 Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.,1717 Norman GJ. Psychosocial and Environmental Correlates of Adolescent Sedentary Behaviors. Pediatrics 2005; 116(4):908-916.. Besides some studies that presented paternal and maternal rules as a significant determinant to screen time among children2222 Cillero IH, Jago R, Sebire S. Individual and social predictors of screen-viewing among Spanish school children. Eur J Pediatr 2011; 170(1):93-102.,2323 Gingold JA, Simon AE, Schoendorf KC. Excess screen time in US children: association with family rules and alternative activities. Clin Pediatr (Phila) 2014; 53(1):41-50., our results showed that family’s rules of screen time and family’s support for reducing screen time scales were not significantly correlated with screen time (rho<0.010). Based on our results, the scales on family’s screen time use and family’s beliefs on screen time can be considered in studies on family correlates of screen time or the effectiveness of family-based interventions on screen time-related outcomes. However, we stimulate futures studies on the validity of scales on family-related factors of screen time, because most of the scales proposed in our study had trivial correlation coefficients.
Results from the school members’ support for reducing screen time scale demonstrated the existence of one factor with four items. Understanding the impact of social support on health behaviors can help to develop future health promotion interventions77 Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206.. Specifically among adolescents, teachers and friends have a greater contribution to the adoption of behaviors because they tend to be more independent from their families. However, in our study, the scores of this scale did not have a significant correlation with screen time; possibly, because the screen use (TV, computer or video games) tends to be performed in the home context. Thus, using the scale of school members’ support for reducing screen time may be important in studies on the effectiveness of school-based interventions on screen time-related outcomes, in order to identify changes on an intervention process element i.e., whether the school context change the way they discuss on screen time and health. However, studies on school members’ support for screen time and other sedentary behaviors are still a relevant literature gap33 Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133..
Most of screen items at home and in the bedroom showed a significant positive correlation with screen time. Studies have shown that physical environment is a strong factor associated with screen time2424 LeBlanc AG, Katzmarzyk PT, Barreira TV, Broyles ST, Chaput J-P, Church TS, Fogelholm M, Harrington DM, Hu G, Kuriyan R, Kurpad A, Lambert EV, Maher C, Maia J, Matsudo V, Olds T, Onywera V, Sarmiento OL, Standage M, Tudor-Locke C, Zhao P, Tremblay MS, ISCOLE Research Group. Correlates of Total Sedentary Time and Screen Time in 9-11 Year-Old Children around the World: The International Study of Childhood Obesity, Lifestyle and the Environment. PloS One 2015; 10(6):e0129622.. For instance, a longitudinal study with school-aged children found that the presence of a computer in the bedroom was positively associated with screen time2525 Atkin AJ, Corder K, van Sluijs EM. Bedroom media, sedentary time and screen-time in children: a longitudinal analysis. Int J Behav Nutr Phys Act 2013; 10(1):137.. Focus on these screen equipment in both contexts seems to be relevant to understand environmental factors related to screen time and to identify whether interventions with strategies that use electronic monitoring devices and limits for screen use are effective in reducing screen time among young people2626 Buchanan L, Rooks-Peck CR, Finnie RKC, Wethington HR, Jacob V, Fulton JE, Johnson DB, Kahwati LC, Pratt CA, Ramirez G, Mercer SL, Glanz K, Community Preventive Services Task Force. Reducing Recreational Sedentary Screen Time. Am J Prev Med 2016; 50(3):402-415..
The majority of scales showed adequate internal consistency with Cronbach’s alpha values above 0.70. Only the family’s beliefs on screen time scale obtained a value below substantial, possibly explained by the low number of items comprising the scale2727 Scatena LM, Wysocki AD, Beraldo AA, Magnabosco GT, Brunello MEF, Ruffino AN, Nogueira JA, Silva Sobrinho RA, Brito EWG, Alexandre PBD, Monroe AA, Villa TCS. Validity and reliability of a health care service evaluation instrument for tuberculosis. Rev Saúde Pública 2015; 49:7. In addition, all scales showed substantial or appropriate values in the test-retest reproducibility (ICC ranging from 0.63 to 0.83). Few studies have investigated the reproducibility of the measures about individual, social and physical environmental factors associated with screen time in adolescents. Singh et al.2828 Singh AS, Vik FN, Chinapaw MJ, Uijtdewilligen L, Verloigne M, Fernández-Alvira JM, Stomfai S, Manios Y, Martens M, Brug J. Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project. Int J Behav Nutr Phys Act 2011; 8(1):136. evaluated the test-retest reproducibility using an instrument with 24 items of potential screen-viewing determinants in young people and identified ICC, ranging from 0.48 to 0.92. Approximately 76% of the items had ICC as good; however, the classification used by the authors consider values above 0.60 as good, different from our study2828 Singh AS, Vik FN, Chinapaw MJ, Uijtdewilligen L, Verloigne M, Fernández-Alvira JM, Stomfai S, Manios Y, Martens M, Brug J. Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project. Int J Behav Nutr Phys Act 2011; 8(1):136.. In another study, which evaluated the ICC test-retest values of parents’ rules and guidance in relation to screen time among Chinese children, the authors showed substantial reliability (ICC ranging from 0.72 to 0.86)2929 Huang Y-J, Wong SH, Salmon J, Hui SS. Reliability and validity of psychosocial and environmental correlates measures of physical activity and screen-based behaviors among Chinese children in Hong Kong. Int J Behav Nutr Phys Act 2011; 8:16.. These evidences show the complexity of measuring psychosocial factors associated with screen time in children and adolescents.
According to a review3030 Hidding LM, Altenburg TM, Mokkink LB, Terwee CB, Chinapaw MJM. Systematic review of childhood sedentary behavior questionnaires: What do we know and what is next? Sports Med 2017; 47(4):677-699., no study that focused on assessing the measurement properties of self-report questionnaires about sedentary behavior (screen time) were considered both valid and reliable. Moreover, to the authors’ knowledge, this is the first study to examine psychometric propriety of the questionnaire about individual, social and physical environmental factors associated with screen time for Brazilian children and adolescents. Finally, other strengths were the sample with sufficient statistical power and the different statistical procedures used to make inferences, both for the analysis of validity and for the reliability of instrument1616 Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis [Internet]. Prentice Hall; 2009 [acessado 2017 Ago 25]. Disponível em: ://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523
://gen.lib.rus.ec/book/index.php?md5=FCD... .
This study has some limitations. First, some scales were developed with the objective of measuring the factors associated with screen time, while others were directed to interventions aimed at reducing screen time. Therefore, the items those higher values represent conditions that were less favorable to screen time had their values reversed, and studies using these scales should consider the represented constructs. Also, some scale had a low quantity of items, and it may explain some results of psychometric indicators2727 Scatena LM, Wysocki AD, Beraldo AA, Magnabosco GT, Brunello MEF, Ruffino AN, Nogueira JA, Silva Sobrinho RA, Brito EWG, Alexandre PBD, Monroe AA, Villa TCS. Validity and reliability of a health care service evaluation instrument for tuberculosis. Rev Saúde Pública 2015; 49:7.
A comprehensive approach of screen time has been stimulated, and we need to improve the screen time measurement. The proposed scales are not a final step, but a step forward to achieve a best evidence practice in screen time measurement and intervention in youth. Thus, future studies testing these scales and/or improving them with new scales are also needed. Specifically, considering that our study was limited to evaluate a few psychometric parameters of validity and reliability, other statistical parameters (e.g., confirmatory factor analysis of these constructs) are stimulated in order to understand the factors that explain screen time among young people.
In conclusion, the instrument included scales that showed acceptable validity and reliability. Future epidemiological and intervention studies can use the proposed scales in order to identify factors associated with screen time, as well as to identify mediators of the effect of interventions on reducing screen time in schoolchildren.
- Financial supportThere was no financial funding to perform this review. Individual grants for VC Barbosa Filho from the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), AS Lopes and AS Bandeira from the Conselho Nacional de Ciência e Tecnologia (CNPQ). J Mota was supported by grants: FCT: SFRH/BSAB/142983/2018 and UID/DTP/00617/2019 as well as Programa de Bolsas Santander Universidades 2018. The funding agencies had no participation in the interpretation, analysis, writing and approval of this manuscript.
Acknowledgements
We thank the Municipal Education Department for technical support and authorization to the study execution. We thank all members of the school community (managers, teachers, parents and students) who were involved in this study. We thank the “Fortaleça sua Saúde” Working Group, which is detailed in a previous publication (http://www.biomedcentral.com/1471-2458/15/1212).
References
- 1Sociedade Brasileira de Pediatria (SBP). Promoção da Atividade Física na Infância e Adolescência [Internet]. 2017 [acessado 2017 Set 21]. Disponível em: ://www.sbp.com.br/fileadmin/user_upload/ 19890d-MO-Promo_AtivFisica_na_Inf_e_Adoles. pdf
» http://www.sbp.com.br/fileadmin/user_upload/ 19890d-MO-Promo_AtivFisica_na_Inf_e_Adoles. pdf - 2Chastin SFM, De Craemer M, Lien N, Bernaards C, Buck C, Oppert J-M, Nazare J-A, Lakerveld J, O'Donoghue G, Holdsworth M, Owen N, Brug J, Cardon G, DEDIPAC consortium, expert working group and consensus panel. The SOS-framework (Systems of Sedentary behaviours): an international transdisciplinary consensus framework for the study of determinants, research priorities and policy on sedentary behaviour across the life course: a DEDIPAC-study. Int J Behav Nutr Phys Act 2016; 13:83.
- 3Stierlin AS, De Lepeleere S, Cardon G, Dargent-Molina P, Hoffmann B, Murphy MH, Kennedy A, O'Donoghue G, Chastin SFM, De Craemer M, DEDIPAC consortium. A systematic review of determinants of sedentary behaviour in youth: a DEDIPAC-study. Int J Behav Nutr Phys Act 2015; 12:133.
- 4Van Stralen MM, Yildirim M, Velde SJ, Brug J, van Mechelen W, Chinapaw MJ. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes 2011; 35(10):1251-1265.
- 5Garcia JM, Agaronov A, Sirard JR, Whaley D, Rice DJ, Weltman A. psychosocial and friend influences on objective sedentary behavior and screen time: A mixed methods analysis. J Phys Act Health 2017; 14(3):213-221.
- 6Lubans DR, Hesketh K, Cliff DP, Barnett LM, Salmon J, Dollman J, Morgan PJ, Hills AP, Hardy LL. A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents. Obes Rev 2011; 12(10):781-99.
- 7Salmon J, Tremblay MS, Marshall SJ, Hume C. Health Risks, Correlates, and Interventions to Reduce Sedentary Behavior in Young People. Am J Prev Med 2011; 41(2):197-206.
- 8Barbosa Filho VC, Lopes AS, Lima AB, Souza EA,Gubert FA, Silva KS, Vieira NFC, Trompieri Filho N,Araújo TS, Bruin PFC, Mota J, “Fortaleça sua Saúde” Working Group. Rationale and methods of a cluster-randomized controlled trial to promote active and healthy lifestyles among Brazilian students: the “Fortaleça sua Saúde” program. BMC Public Health 2015; 15:1212.
- 9Owen N, Salmon J, Koohsari MJ, Turrell G, Giles-Corti B. Sedentary behaviour and health: mapping environmental and social contexts to underpin chronic disease prevention. Br J Sports Med 2014; 48(3):174-177.
- 10Gebremariam MK, Totland TH, Andersen LF, Bergh IH, Bjelland M, Grydeland M, Ommundsen Y, Lien N. Stability and change in screen-based sedentary behaviours and associated factors among Norwegian children in the transition between childhood and adolescence. BMC Public Health 2012; 12:104.
- 11Hardy LL, Baur LA, Garnett SP, Crawford D, Campbell KJ, Shrewsbury VA, Cowell CT, Salmon J. Family and home correlates of television viewing in 12-13 year old adolescents: the Nepean Study. Int J Behav Nutr Phys Act 2006; 3:24.
- 12Jago R, Baranowski T, Watson K, Bachman C, Baranowsi JC, Thompson D, Hernández AE, Venditti E, Blackshear T, Moe E. Development of new physical activity and sedentary behavior change self-efficacy questionnaires using item response modeling. Int J Behav Nutr Phys Act 2009; 6:20.
- 13Norman GJ, Vaughn AA, Roesch SC, Sallis JF, Calfas KJ, Patrick K. Development of decisional balance and self-efficacy measures for adolescent sedentary behaviors. Psychol Health 2004; 19(5):561-575.
- 14Salmon J, Hume C, Ball K, Booth M, Crawford D. Individual, social and home environment determinants of change in children's television viewing: The Switch-Play intervention. J Sci Med Sport 2006; 9(5):378-387.
- 15Tandon PS, Zhou C, Sallis JF, Cain KL, Frank LD, Saelens BE. Home environment relationships with children's physical activity, sedentary time, and screen time by socioeconomic status. Int J Behav Nutr Phys Act 2012; 9(1):88.
- 16Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis [Internet]. Prentice Hall; 2009 [acessado 2017 Ago 25]. Disponível em: ://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523
» http://gen.lib.rus.ec/book/index.php?md5=FCDB08391BCEC7C365BB1D252D4BA523 - 17Norman GJ. Psychosocial and Environmental Correlates of Adolescent Sedentary Behaviors. Pediatrics 2005; 116(4):908-916.
- 18Salmon J, Timperio A, Telford A, Carver A, Crawford D. Association of family environment with children's television viewing and with low level of physical activity. Obesity 2005; 13(11):1939-1951.
- 19Silva KS, Lopes AS, Hoefelmann LP, Cabral LGA, De Bem MFL, Barros MVG, Nahas MV. Health risk behaviors Project (COMPAC) in youth of the Santa Catarina State, Brazil: ethics and methodological aspects. Rev Bras Cineantropometria Amp Desempenho Hum 2013; 15(1):1-15.
- 20Brown H, Hume C, ChinAPaw M. Validity and reliability of instruments to assess potential mediators of children's physical activity: A systematic review. J Sci Med Sport 2009; 12(5):539-548.
- 21Williams DM, Anderson ES, Winett RA. A review of the outcome expectancy construct in physical activity research. Ann Behav Med 2005; 29(1):70-79.
- 22Cillero IH, Jago R, Sebire S. Individual and social predictors of screen-viewing among Spanish school children. Eur J Pediatr 2011; 170(1):93-102.
- 23Gingold JA, Simon AE, Schoendorf KC. Excess screen time in US children: association with family rules and alternative activities. Clin Pediatr (Phila) 2014; 53(1):41-50.
- 24LeBlanc AG, Katzmarzyk PT, Barreira TV, Broyles ST, Chaput J-P, Church TS, Fogelholm M, Harrington DM, Hu G, Kuriyan R, Kurpad A, Lambert EV, Maher C, Maia J, Matsudo V, Olds T, Onywera V, Sarmiento OL, Standage M, Tudor-Locke C, Zhao P, Tremblay MS, ISCOLE Research Group. Correlates of Total Sedentary Time and Screen Time in 9-11 Year-Old Children around the World: The International Study of Childhood Obesity, Lifestyle and the Environment. PloS One 2015; 10(6):e0129622.
- 25Atkin AJ, Corder K, van Sluijs EM. Bedroom media, sedentary time and screen-time in children: a longitudinal analysis. Int J Behav Nutr Phys Act 2013; 10(1):137.
- 26Buchanan L, Rooks-Peck CR, Finnie RKC, Wethington HR, Jacob V, Fulton JE, Johnson DB, Kahwati LC, Pratt CA, Ramirez G, Mercer SL, Glanz K, Community Preventive Services Task Force. Reducing Recreational Sedentary Screen Time. Am J Prev Med 2016; 50(3):402-415.
- 27Scatena LM, Wysocki AD, Beraldo AA, Magnabosco GT, Brunello MEF, Ruffino AN, Nogueira JA, Silva Sobrinho RA, Brito EWG, Alexandre PBD, Monroe AA, Villa TCS. Validity and reliability of a health care service evaluation instrument for tuberculosis. Rev Saúde Pública 2015; 49:7
- 28Singh AS, Vik FN, Chinapaw MJ, Uijtdewilligen L, Verloigne M, Fernández-Alvira JM, Stomfai S, Manios Y, Martens M, Brug J. Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project. Int J Behav Nutr Phys Act 2011; 8(1):136.
- 29Huang Y-J, Wong SH, Salmon J, Hui SS. Reliability and validity of psychosocial and environmental correlates measures of physical activity and screen-based behaviors among Chinese children in Hong Kong. Int J Behav Nutr Phys Act 2011; 8:16.
- 30Hidding LM, Altenburg TM, Mokkink LB, Terwee CB, Chinapaw MJM. Systematic review of childhood sedentary behavior questionnaires: What do we know and what is next? Sports Med 2017; 47(4):677-699.
Publication Dates
- Publication in this collection
15 Mar 2021 - Date of issue
Mar 2021
History
- Received
22 Jan 2018 - Accepted
04 May 2019 - Published
06 May 2019