Validation of psychosocial scales for physical activity in university students

Rafael Miranda Tassitano José Cazuza de Farias Júnior Cassiano Ricardo Rech Maria Cecília Marinho Tenório Poliana Coelho Cabral Giselia Alves Pontes da Silva About the authors

Abstracts

OBJECTIVE

Translate the Patient-centered Assessment and Counseling for Exercise questionnaire, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students.

METHODS

The Patient-centered Assessment and Counseling for Exercise questionnaire is made up of 39 items divided into constructs based on the social cognitive theory and the transtheoretical model. The analyzed constructs were, as follows: behavior change strategy (15 items), decision-making process (10), self-efficacy (6), support from family (4), and support from friends (4). The validation procedures were conceptual, semantic, operational, and functional equivalences, in addition to the equivalence of the items and of measurements. The conceptual, of items and semantic equivalences were performed by a specialized committee. During measurement equivalence, the instrument was applied to 717 university students. Exploratory factor analysis was used to verify the loading of each item, explained variance and internal consistency of the constructs. Reproducibility was measured by means of intraclass correlation coefficient.

RESULTS

The two translations were equivalent and back-translation was similar to the original version, with few adaptations. The layout, presentation order of the constructs and items from the original version were kept in the same form as the original instrument. The sample size was adequate and was evaluated by the Kaiser-Meyer-Olkin test, with values between 0.72 and 0.91. The correlation matrix of the items presented r < 0.8 (p < 0.05). The factor loadings of the items from all the constructs were satisfactory (> 0.40), varying between 0.43 and 0.80, which explained between 45.4% and 59.0% of the variance. Internal consistency was satisfactory (α ≥ 0.70), with support from friends being 0.70 and 0.92 for self-efficacy. Most items (74.3%) presented values above 0.70 for the reproducibility test.

CONCLUSIONS

The validation process steps were considered satisfactory and adequate for applying to the population.

Young Adult; Motor Activity; Questionnaires; Translations; Validation Studies


INTRODUCTION

Encouraging individuals to perform physical activity is an effective strategy to reduce the risk of cardiovascular diseases, diabetes, obesity, osteoporosis and some cancers.2424 .Warburton DER, Nicol CW, Bredin SSD. Health benefits of physical activity: the evidence. CMAJ. 2006;174(6):801-9. DOI:10.1503/cmaj.051351,2525 .World Health Organization. Global health risks: mortality and burden of disease attributable to selected major risks. Geneva; 2009. However, despite the evidences to support such benefits, understanding how people establish and maintain these physical activities is still a challenge. Behavioral theories use empirical studies to establish models that explain physical activity practice with the objective of helping design programs for promoting physical activity.2.Brug J, Oenema A, Ferreira I. Theory, evidence and intervention mapping to improve behavior nutrition and physical activity interventions.Int J Behav Nutr Phys Act. 2005;2(1):1-7. DOI:10.1186/1479-5868-2-2 Reviews surrounding the psychosocial factors related to the practice indicate that constructs from the social cognitive theory1.Bandura A. Social cognitive theory. In: Vasta R, editor. Annals of child development. Vol. 6, Six theories of child development.Greenwich (CT): JAI Press; 1989. p.1-60. (self-efficacy, social support and behavior change process) and the transtheoretical model1414 .Prochaska JO, Velicer WF. The Transtheoretical model of health behavior change. Am J Health Promot. 1997;12(1):38-48. (self-efficacy and decision-making process) have often been used to explain this behavior.7.Kahn EB, Ramsey LT, Brownson RC, Heath GW, Howze EH, Powell KE, et al. The effectiveness of interventions to increase physical activity: a systematic review. Am J Prev Med. 2002;22(4 Suppl):73-107. DOI:10.1016/S0749-3797(02)00434-8,8.Lewis BA, Marcus BH, Pate RR, Dunn AL. Psychosocial mediators of physical activity behavior among adults and children. Am J Prev Med. 2002;23(2 Suppl):26-35. DOI:10.1016/S0749-3797(02)00471-3

Despite the significant increase in the production of knowledge regarding psychosocial factors and physical activity interventions in Brazil,6.Hallal PC, Dumith SC, Bastos JP, Reichert FF, Siqueira FV, Azevedo MR. Evolução da pesquisa epidemiológica em atividade física no Brasil: revisão sistemática. Rev Saude Publica. 2007;41(3):453-60. DOI:10.1590/S0034-89102007000300018 studies that address these aspects in young adults are still scarce. One contributing reason for this the lack of valid instruments to measure these factors in the Brazilian population. Recently, four psychosocial scale validation studies were published, related to satisfaction,1515 .Rech CR, Fermino RC, Hallal PC, Reis RS. Validade e fidedignidade da escala de satisfação com a prática de atividade física em adultos.Rev Saude Publica. 2011;45(2):286-93. DOI:10.1590/S0034-89102011005000011 self-efficacy,1616 .Rech CR, Sarabia TT, Fermino RC, Hallal PC, Reis RS. Propriedades psicométricas de uma escala de autoeficácia para a prática de atividade física em adultos brasileiros. Rev Panam Salud Publica. 2011;29(4):259-66. DOI:10.1590/S1020-49892011000400007 perceived barriers2121 .Santos MS, Reis RS, Rodriguez-Añez CR, Fermino RC. Desenvolvimento de um instrumento para avaliar as barreiras para a prática de atividade física em adolescentes. Rev Bras Ativ Fis Saude. 2009;14(2):76-85. and social support1818 .Reis MS, Reis RS, Hallal PC. Validade e fidedignidade de uma escala de avaliação do apoio social para a atividade física. Rev Saude Publica. 2011;45(2):294-301. DOI:10.1590/S0034-89102011000200008 for performing physical activity. However, current instruments that measure other constructs, which make up the main theories applied to physical activity, are still insufficient, e.g., behavior change strategy, perceived facilitators and barriers for adults.

A group of researchers at the University of San Diego, California, USA, have been developing studies on behavior and style in an initiative entitled “Patient-centered Assessment and Counseling for Exercise” (PACE) since the 1990s. In addition to proposing and evaluating interventions regarding various health outcomes, in different contexts and age groups, PACE has also developed and validated psychosocial scales for health behaviors, including physical activity.3.Calfas KJ, Sallis JF, Zabinski MF, Wilfley DE, Rupp J, Prochaska JJ, et al. Preliminary evaluation of a multicomponent program for nutrition and physical activity change in primary care: PACE+ for adults. Prev Med. 2002;34(2):153-61. DOI:10.1006/pmed.2001.0964

.Carlson JA, Sallis JF, Ramirez ER, Patrick K, Norman GJ. Physical activity and dietary behavior change in Internet-based weight loss interventions: comparing two multiple-behavior change indices. Prev Med. 2012;54(1):50-4. DOI:10.1016/j.ypmed.2011.10.018
-5.Hagler AS, Norman GJ, Radick LR, Calfas KJ, Sallis JF. Comparability and reliability of paper- and computer-based measures of psychosocial constructors for adolescent fruit and vegetable and dietary fat intake. J Am Diet Assoc. 2005;105(11):1758-64. DOI:10.1016/j.jada.2005.08.010,1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302

11 .Patrick K, Calfas KJ, Norman GJ, Zabinski MF, Sallis JF, Rupp J, et al. Randomized controlled trial of a primary care and home-based intervention for physical activity and nutrition behaviors: PACE+ for adolescents.Arch Pediatr Adolesc Med. 2006;160(2):128-36. DOI:10.1001/archpedi.160.2.128
-1212 .Patrick K, Calfas KJ, Norman GJ, Rosenberg D, Zabinski MF, Sallis JF, et al. Outcomes of a 12-month web-based intervention for overweight and obese men. Ann Behav Med. 2011;42(3):391-401. DOI:10.1007/s12160-011-9296-7 However, instruments developed and used in other countries should not be applied without first being translated, culturally adapted and validated for its new target population.

This study aimed to translate PACE into Portuguese, adapt it cross-culturally and identify the psychometric properties of the psychosocial scales for physical activity in young university students.

METHODS

An instrument validation study was conducted at the Universidade Federal Rural de Pernambuco (UFRPE) in 2011.

The original instrument of the study consisted of 39 items distributed into four constructs. Additional information regarding the instrument is available on the PACE project page.aa PACE Projects. Measures: adolescent psychosocial scales [Internet]. [cited 2010 Apr 19]. Available from: http://www.paceproject.org/Measures.html

Behavior change strategy. Reflects the thoughts, activities and feelings that individuals can use to increase their physical activity,1919 .Saelens BE, Gehrman CA, Sallis JF, Calfas KJ, Sarkins JA, Caparosa S. Use of self-management strategies in a 2-year cognitive-behavioral intervention to promote physical activity. Behav Ter. 2000;31(2):365-79. DOI:10.1016/S0005-7894(00)80020-9 made up of 15 items with a 5-point Likert scale (never; hardly ever; sometimes; frequently; many times).

Decision-making process. Consists of two factors (perceived facilitators and perceived barriers) to achieve behavior change, which are related to cognitive and motivational aspects involved in the decision-making process.9.Marcus BH, Owen N. Motivacional readiness, self-efficacy and decision-making for exercise. J Appl Soc Psychol. 1992;22(1):3-16. DOI:10.1111/j.1559-1816.1992.tb01518.x,1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 This range is made up of 10 items, five for each factor, with the response options set out in a 5-point Likert scale (not important; slightly important; more or less important; very important; extremely important).

Self-efficacy. Related to the degree of confidence or belief with which the individual is capable of performing or adopting a certain behavior when faced with various existing barriers.9.Marcus BH, Owen N. Motivacional readiness, self-efficacy and decision-making for exercise. J Appl Soc Psychol. 1992;22(1):3-16. DOI:10.1111/j.1559-1816.1992.tb01518.x,2020 .Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for health-related diet and exercise behaviors. Health Educ Res. 1988;3(3):283-92. DOI:10.1093/her/3.3.283,2323 .Velicer WF, DiClement CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol. 1985;48(5):1279-89. DOI:10.1037/0022-3514.48.5.1279 The scale is made up of six items, with a 5-point Likert scale (absolutely not; probably not; indifferent/neutral; probably yes; absolutely yes).

Social support from family and friends. Represents support from family and friends regarding the process of changing or maintaining a behavior, which are related to incentives, supporting actions and joint practices.1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 This social support scale consists of eight items, four for support from relatives and four from friends, in a 5-point Likert scale (never; one to two days; three to four days; five to six days; every day).

Regarding implementation, the entire validation process was performed according to procedures identified in the literature1717 .Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica. 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035 and consisted of six steps: (a) conceptual equivalence; (b) items equivalence; (c) semantic equivalence; (d) operational equivalence; (e) measurement equivalence; and (f) functional equivalence.

The conceptual and items equivalence aimed to verify the relevance that each item had in its respective construct, considering the country of origin and the location where it was applied. A review of the studies was performed, including their development, validation and application. Subsequently, an appraisal of the items that make up each construct in relation to local culture was performed. These steps were conducted by three researchers who have experience in instrument validation in the area of physical activity.

The initial translation of the original instrument (English) into Portuguese was independently performed by two native professionals, one native of the Portuguese language and the other the English language. Based on the two translations, one group of researchers summarized a Portuguese version, which was again translated into English by an English native professional, fluent in Portuguese. The denotative meanings were evaluated to verify the literal correspondence between the two versions (English-Portuguese). The connotative significance was also observed, that is, the use of a word with a meaning different from the original, which will be developed according to its context.

The Portuguese translation version was given to 20 university students so as to evaluate the extent to which each item is understood. Each question was evaluated based on the following question: “Do you understand what was asked?” with the response options set out in a 6-point Likert scale (I did not understand anything; I only understood a little; I understood more or less; I understood almost everything, but had some doubts; I understood almost everything; and I understood everything perfectly and I have no doubts). During the operational equivalence evaluation, the characteristics of the original version (layout, completion guidelines, question sequence and response options) and the questionnaire application method (form, location and duration) were assessed.

About the measurement equivalence and functional equivalence, the psychometric properties of the Portuguese translation version from the psychosocial scales for physical activity were tested. The levels of validity and reliability of the scales were estimated.

The target population was made up of both male and female students who were enrolled in the 2010 academic year at the Universidade Federal Rural de Pernambuco (n = 12,451). Students of both genres, aged from 18 to 24 years were considered eligible. Exclusion criteria were: (a) presenting any physical and/or mental disability; (b) institutional exchange students (Brazilian or foreign); and (c) students from distance learning programs, post-graduation courses or those from a different campus. A total of 7,287 students were considered eligible to participate in the study.

The sample size was determined based on the following parameters: (a) population size (n = 12,451); (b) prevalence of sufficient physical activity being performed (≥ 150 minutes/week) estimated at 50.0%; (c) sampling error of five percentage points; (d) sampling design effect of 2. Minimum sample size was estimated at 697 students. To compensate for any possible drop outs or refusals, a decision was made to multiply this total by 1.2, totaling 836 students. For validation studies that use exploratory factor analysis, the literature recommends a 1:5 or 1:10 item-to-sample ratio for each item to be validated,1717 .Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica. 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035 which would result in a sample of between 210 and 420 participants. Therefore, the required sample size is sufficient for all the validation tests.

The sample was randomly selected and proportionally distributed about the number of enrollments per class in each course and study time. Data was collected between October and November 2011, by eight previously trained students. The interviewers were instructed to conduct individual interviews with the students in an environment that was separated from the classroom. In addition to applying the psychosocial scales for physical activity, information regarding age (in years), economic class,bb Associação Brasileira de Empresas de Pesquisa (ABEP). Critério de Classificação Econômica do Brasil [cited 2011 Oct 20]. Available from: http:/www.abep.org marital status (single, married or otherwise), place of residence (urban, rural), work (yes; no) and classes time (daytime; nighttime) were also collected. The average duration time of the interviews was 30 minutes.

The validity of the scales was verified by means of exploratory factor analysis, using the principal components technique with Promax rotation, and considering that the constructs present a correlation amongst themselves.To determine the number of dimensions and factors in each scale, eigenvalues greater than or equal to 1.0 were adopted as a criterion. Items with factor loadings greater than 0.40 were kept in the scale. The constructs were tested toward sampling adequacy by the Kaiser-Meyer-Olkin (KMO) index, with values above 0.70 being considering adequate.2222 .Terwee CB, Bot SDM, Boer MR, Van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. DOI:10.1016/j.jclinepi.2006.03.012Bartlett’s test of sphericity was used to verify whether the correlation matrix differed from an identity matrix. Multicollinearity (high correlation, r > 80) and singularity (perfect correlation, r = 1.0) was verified in the correlation matrix among the items of each construct.

Reliability was evaluated by means of internal consistency and reproducibility. Internal consistency was determined by the Cronbach’s alpha coefficient (α), considering α ≥ 0.70 as satisfactory.2222 .Terwee CB, Bot SDM, Boer MR, Van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. DOI:10.1016/j.jclinepi.2006.03.012 Test-retest reproducibility was evaluated by the intraclass correlation coefficient (ICC), with values greater than or equal to 0.70 being considered satisfactory.2222 .Terwee CB, Bot SDM, Boer MR, Van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. DOI:10.1016/j.jclinepi.2006.03.012The scales were applied and reapplied with a time interval of 10 to 14 days in a subsample (n = 53), which was randomly selected from the sample. This sub-sample enabled the identification of ICC values of ≥ 0.20 (α = 5.0% and β = 80.0%) as significant. The functional equivalence was obtained based on the evaluation of previous steps.

The data was tabulated using the Epidata 3.1 software (Epidata Assoc, Odense, Denmark) and all analyses were performed using the SPSS 17.0 software.

This study was approved by the Ethics Committee from the Centro de Ciências da Saúde of the Universidade Federal de Pernambuco (Process 313/2010, CAAE 0313.0.172.000-10, 23/11/2011).

RESULTS

Considering the conceptual, items, semantic and operational equivalence, both translations were equivalent and back-translation was similar to the original version. It was decided that in Q4, Q16, Q17, Q18, Q19 direct language would be used, preferably while leaving the verbs in the first person. As to semantics, translator 1 translated the term “reward” as “prêmio” (prize) and translator 2, as “recompensa” (reward) (Q6). Another term with distinct translations was “surrounding”, that translator 1 translated as “entorno” (surroundings) and translator 2, as “meio ambiente” (environment) (Q4). Both the specialists and students concluded that it would be clearer to use “recompensa” and “meio ambiente”, respectively. In questions Q12 and Q36, the term “encourages” was translated as “encorajar” (encourage) and “incentivar” (give incentive), with the second option being chosen. Only one term was adapted: the word “school” was replaced with “universidade” (university). From the surveyed students, 91.0% reported that they perfectly understood all the items in the translated instrument, while the remaining claimed that they understood almost everything.

The layout, presentation order of the constructs and the items from the original version were kept in their original form. It was only necessary to insert a text defining the meaning of moderate and vigorous activity in the form, in addition to examples of activities that characterize these intensities so as to provide better understanding. The temporal units and the measurement unit of the answer from each construct were highlighted in bold. The original and final versions of the translated and adapted instrument can be seen in Table 1.

Table 1
Original and final version translated and adapted from the psychosocial constructs of physical activity.

Regarding measurement equivalence, a total of 747 students participated in the study. Drop outs and refusals totaled 4.2% (n = 30). The final sample was made up of 717 students (55.9% women), with average age of 20.6 years (SD = 1.9). Most students were single (95.4%), lived in urban areas (97.8%), were not employed (64.6%), studied during the day (67.5%) and were included in the economic class C (almost 50.0%). Prevalence of 34.2% (95%CI 37.8;30.7) of physically active individuals was observed. The subsample used for the reproducibility analysis (n = 53) showed no significant difference between the study variables when compared with the sample from the factor analysis.

During psychometric properties analysis, all constructs were observed to be satisfactory for both the measure of sampling adequacy (KMO) test, with values between 0.72 and 0.91, and Bartlett’s test of sphericity (p = 0.00) (Tables 1 to 4). As to singularity and multicollinearity analysis, the correlation matrix had the following minimum and maximum values: behavior change strategy (r = 0.23 and r = 0.68); perception of facilitators (r = 0.21 and r = 0.65) perception of barriers (r = 0.26 and r = 0.61); self-efficacy (r = 0.41 and r = 0.67); social support from family (r = 0.38 and r = 0.53); and social support from friends (r = 0.23 and r = 0.56). The results indicated by the correlation matrix were satisfactory (r < 0.8 and p < 0.05) for all constructs, with all items being kept for exploratory factor analysis.

During the exploratory factor analysis of the behavior change strategy construct, only one factor was identified, with factor loadings ranging from 0.54 to 0.73, thereby explaining 56.7% of the total scale variance. The internal consistency was high (α = 0.88) and all the items were seen to be important for their respective scales, since removing any one of them would have significantly diminished internal consistency (Table 2). Reproducibility ranged from 0.56 to 0.86 with 73.3% of the items reaching values above 0.70.

Table 2
Exploratory factor analysis and intraclass correlation coefficient for the behavior change strategy construct for physical activity. (N = 717)

In the decision-making process construct, two factors were identified, the first related to aspects that make behavior change easier, and the second related to aspects that make it more difficult. Factor loadings ranged from 0.60 to 0.80 for the first factor, and from 0.50 to 0.73 for the second, thereby explaining 25.3% and 20.1% of the items’ variance, respectively. Internal consistency was high for both (factor 1 - α = 0.80 and factor 2 - α = 0.73). It was observed that withdrawing any question would result in significantly reducing the internal consistency of the construct. Reproducibility ranged from 0.52 to 0.83 with 70.0% of the items reaching values above 0.70 (Table 3).

Table 3
Exploratory factor analysis and intraclass correlation coefficient for the decision-making process construct for physical activity. (N = 717)

Only one factor was identified during the perception of self-efficacy, with factor loadings ranging from 0.72 to 0.80, thereby explaining 59.0% of the variance of the items. Internal consistency was excellent (α = 0.92) and all items presented reproducibility above 0.70. Withdrawing any question would have resulted in significantly reducing the internal consistency of the construct (Table 4).

Table 4
Exploratory factor analysis and intraclass correlation coefficient for the self-efficacy construct of the physical activity. (N = 717)

Two factors were identified in relation to social support, one being related to social support from family, and the other to social support from friends. In factor 1 (support from the family), the factor loadings ranged from 0.66 to 0.52, and in factor 2 (support from the friends), they ranged from 0.43 to 0.63. Internal consistency was satisfactory for both identified factors, with it being greater for factor 1 (α = 0.89), with an explained variance of 29.2%, compared to factor 2 (α = 0.70), that had an explained variance of 25.8%. Withdrawing any question would have resulted in significantly reducing the internal consistency for both constructs. Reproducibility ranged from 0.56 to 0.90 and support from friends varied from 0.61 to 0.83 (Table 5).

Table 5
Exploratory factor analysis and intraclass correlation coefficient for the social support from family and friends construct for physical activity. (N = 717)

DISCUSSION

Generally speaking, the results indicate that the psychosocial scales for physical activity showed adequate internal consistency, high factorial validity and good reproducibility levels. Evaluating the back-translation and the original version, no differences were observed, and it was well understood by the target population. The validation process followed all the steps that were expected for translating, adapting and validating the instrument.1717 .Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica. 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035

Culturally adapting the scales for Brazilian university students was relatively simple, since there was no difference between the connotation and denotation of the words or phrases. During a study by Pirasteh et al,1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 which comprehensively validated the PACE instrument in a population of Iranian women, minor adjustments were performed. This evidence supports the idea that the instrument is easy to understand and is highly applicable, even when used in different countries.

Operationally, the layout, completion guidelines, question sequence and response options were complied as described in the original instrument. This instrument has been applied both electronically1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302and as an interview.1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302,1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 In this study, the decision was to apply it in the form of an interview due to the fact that this strategy decreases the likelihood of information bias, and because electronic questionnaires are not widely accessed by the general Brazilian population.

Exploratory factor analysis extracted the same amount of factors that were observed in studies by Pirasteh et al1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 and Norman et al,1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 one being for the behavior change strategy construct, one for self-efficacy, two for the decision-making process (factor 1: perception of facilitators, and factor 2: perception of barriers) and two others for social support (factor 1: family, and factor 2 : friends). The factor loadings were above 0.40 in all the items that make up the constructs, with the values for self-efficacy always being above 0.70, thereby corroborating the studies by Pirasteh et al1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 and Norman et al.1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 These results indicate that the scales show levels of factorial validity are satisfactory for measuring these constructs.

All scales presented adequate internal consistency, with Cronbach’s alpha values being greater than 0.70. In comparison to studies that used the entire PACE instrument, the internal consistency of the self-efficacy scale (α = 0.92) was greater than that in the studies by Pirasteh et al1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 (α = 0.84) and Norman et al1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 (α = 0.76). This was also observed in the social support from the family scale (α = 0.89) and in the perception of barriers (α = 0.73). The values observed in the study by Pirasteh et al1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 were α = 0.72 and α = 0.69, while they were α = 0.79 and α = 0.53, respectively, in the study by Norman et al.1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 The reason for these differences was the target population, as these studies were not conducted with university students.

In both studies, by Pirasteh studies et al1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 and Norman et al,1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302 as well as in this study, the lowest α values were found for support from friends. This value can be a reflection from Q38, which reads: “Do your friends or classmates tease you about not being good at physical activities or sports?”, which has a negative sentence structure and differs from the other items in the construct. However, the decision was made to keep this item to preserve the original scale, since withdrawing it would not have significantly increased the α value and left the scale with few items, which could have influenced on internal consistency.

When compared to studies that used the same scales evaluated in this study, either with more questions or by using only one or more constructs, it is possible to compare the results.1.Bandura A. Social cognitive theory. In: Vasta R, editor. Annals of child development. Vol. 6, Six theories of child development.Greenwich (CT): JAI Press; 1989. p.1-60.,9.Marcus BH, Owen N. Motivacional readiness, self-efficacy and decision-making for exercise. J Appl Soc Psychol. 1992;22(1):3-16. DOI:10.1111/j.1559-1816.1992.tb01518.x,1212 .Patrick K, Calfas KJ, Norman GJ, Rosenberg D, Zabinski MF, Sallis JF, et al. Outcomes of a 12-month web-based intervention for overweight and obese men. Ann Behav Med. 2011;42(3):391-401. DOI:10.1007/s12160-011-9296-7,2020 .Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for health-related diet and exercise behaviors. Health Educ Res. 1988;3(3):283-92. DOI:10.1093/her/3.3.283,2323 .Velicer WF, DiClement CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol. 1985;48(5):1279-89. DOI:10.1037/0022-3514.48.5.1279 For example, the original development study of the scale for measuring self-efficacy, performed with adults in the 1980s, was composed of 12 questions, with the variation of loading values for the items being between 0.40 and 0.82.2020 .Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for health-related diet and exercise behaviors. Health Educ Res. 1988;3(3):283-92. DOI:10.1093/her/3.3.283 Overall, the original studies of the scales presented similar values for the items and a larger number of questions for building the construct. However, these studies were developed with the objective of exclusively researching one construct. When constructing instruments to measure associated factors or determinants of physical activity for epidemiological studies, these instruments should contain modules that include different constructs from a theoretical model.

The aforementioned studies1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302,1313 .Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008;8:150-60. DOI:10.1186/1471-2458-8-150 that validated the original scale of the PACE questionnaire presented reproducibility results that only considered the mean value of the score observed in each construct. In this study, it was observed that the ICC values from the constructs ranged from 0.70 (perception of facilitators for behavior change) to 0.82, for self-efficacy. Overall, these results are similar to those reported in the original scale1010 .Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport. 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302(varying from 0.68 to 0.88), and greater than those found in the study carried out on Iranian women (varying between 0.36 and 0.74).2323 .Velicer WF, DiClement CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol. 1985;48(5):1279-89. DOI:10.1037/0022-3514.48.5.1279

One limiting factor of this study was the fact that the original scales were developed for American adolescents and, in this study, they were adapted to young adult university students. This limitation has to be considered, as the scales were originally derived from other scales that has been validated for young adults and university students in studies carried out in the 1980s and 1990s.9.Marcus BH, Owen N. Motivacional readiness, self-efficacy and decision-making for exercise. J Appl Soc Psychol. 1992;22(1):3-16. DOI:10.1111/j.1559-1816.1992.tb01518.x,1212 .Patrick K, Calfas KJ, Norman GJ, Rosenberg D, Zabinski MF, Sallis JF, et al. Outcomes of a 12-month web-based intervention for overweight and obese men. Ann Behav Med. 2011;42(3):391-401. DOI:10.1007/s12160-011-9296-7,1919 .Saelens BE, Gehrman CA, Sallis JF, Calfas KJ, Sarkins JA, Caparosa S. Use of self-management strategies in a 2-year cognitive-behavioral intervention to promote physical activity. Behav Ter. 2000;31(2):365-79. DOI:10.1016/S0005-7894(00)80020-9,2323 .Velicer WF, DiClement CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol. 1985;48(5):1279-89. DOI:10.1037/0022-3514.48.5.1279 However, it is still not recommended to apply the validated and adapted instrument to Brazilian adolescents due to differences between school and University contexts. In addition, given the socioeconomic and cultural differences in Brazil, testing the psychometric properties in samples of young adult university students from other regions of the country is suggested. There are still other suggested studies that would test the relationship of the constructs with physical activity levels.

Validating these scales can assist in preparing intervention studies based on two aspects: planning, from studying the extent to which psychosocial aspects can explain the behavior of physical activity, and developing intervention strategies that focus on aspects of behavior change.

REFERENCES

  • 1
    Bandura A. Social cognitive theory. In: Vasta R, editor. Annals of child development. Vol. 6, Six theories of child development.Greenwich (CT): JAI Press; 1989. p.1-60.
  • 2
    Brug J, Oenema A, Ferreira I. Theory, evidence and intervention mapping to improve behavior nutrition and physical activity interventions.Int J Behav Nutr Phys Act. 2005;2(1):1-7. DOI:10.1186/1479-5868-2-2
  • 3
    Calfas KJ, Sallis JF, Zabinski MF, Wilfley DE, Rupp J, Prochaska JJ, et al. Preliminary evaluation of a multicomponent program for nutrition and physical activity change in primary care: PACE+ for adults. Prev Med 2002;34(2):153-61. DOI:10.1006/pmed.2001.0964
  • 4
    Carlson JA, Sallis JF, Ramirez ER, Patrick K, Norman GJ. Physical activity and dietary behavior change in Internet-based weight loss interventions: comparing two multiple-behavior change indices. Prev Med 2012;54(1):50-4. DOI:10.1016/j.ypmed.2011.10.018
  • 5
    Hagler AS, Norman GJ, Radick LR, Calfas KJ, Sallis JF. Comparability and reliability of paper- and computer-based measures of psychosocial constructors for adolescent fruit and vegetable and dietary fat intake. J Am Diet Assoc 2005;105(11):1758-64. DOI:10.1016/j.jada.2005.08.010
  • 6
    Hallal PC, Dumith SC, Bastos JP, Reichert FF, Siqueira FV, Azevedo MR. Evolução da pesquisa epidemiológica em atividade física no Brasil: revisão sistemática. Rev Saude Publica. 2007;41(3):453-60. DOI:10.1590/S0034-89102007000300018
  • 7
    Kahn EB, Ramsey LT, Brownson RC, Heath GW, Howze EH, Powell KE, et al. The effectiveness of interventions to increase physical activity: a systematic review. Am J Prev Med 2002;22(4 Suppl):73-107. DOI:10.1016/S0749-3797(02)00434-8
  • 8
    Lewis BA, Marcus BH, Pate RR, Dunn AL. Psychosocial mediators of physical activity behavior among adults and children. Am J Prev Med 2002;23(2 Suppl):26-35. DOI:10.1016/S0749-3797(02)00471-3
  • 9
    Marcus BH, Owen N. Motivacional readiness, self-efficacy and decision-making for exercise. J Appl Soc Psychol 1992;22(1):3-16. DOI:10.1111/j.1559-1816.1992.tb01518.x
  • 10
    Norman GJ, Sallis JF, Gaskins R. Comparability and reability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behavior. Res Q Exerc Sport 2005;76(3):315-23. DOI:10.1080/02701367.2005.10599302
  • 11
    Patrick K, Calfas KJ, Norman GJ, Zabinski MF, Sallis JF, Rupp J, et al. Randomized controlled trial of a primary care and home-based intervention for physical activity and nutrition behaviors: PACE+ for adolescents.Arch Pediatr Adolesc Med 2006;160(2):128-36. DOI:10.1001/archpedi.160.2.128
  • 12
    Patrick K, Calfas KJ, Norman GJ, Rosenberg D, Zabinski MF, Sallis JF, et al. Outcomes of a 12-month web-based intervention for overweight and obese men. Ann Behav Med 2011;42(3):391-401. DOI:10.1007/s12160-011-9296-7
  • 13
    Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F. Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health 2008;8:150-60. DOI:10.1186/1471-2458-8-150
  • 14
    Prochaska JO, Velicer WF. The Transtheoretical model of health behavior change. Am J Health Promot 1997;12(1):38-48.
  • 15
    Rech CR, Fermino RC, Hallal PC, Reis RS. Validade e fidedignidade da escala de satisfação com a prática de atividade física em adultos.Rev Saude Publica 2011;45(2):286-93. DOI:10.1590/S0034-89102011005000011
  • 16
    Rech CR, Sarabia TT, Fermino RC, Hallal PC, Reis RS. Propriedades psicométricas de uma escala de autoeficácia para a prática de atividade física em adultos brasileiros. Rev Panam Salud Publica 2011;29(4):259-66. DOI:10.1590/S1020-49892011000400007
  • 17
    Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035
  • 18
    Reis MS, Reis RS, Hallal PC. Validade e fidedignidade de uma escala de avaliação do apoio social para a atividade física. Rev Saude Publica 2011;45(2):294-301. DOI:10.1590/S0034-89102011000200008
  • 19
    Saelens BE, Gehrman CA, Sallis JF, Calfas KJ, Sarkins JA, Caparosa S. Use of self-management strategies in a 2-year cognitive-behavioral intervention to promote physical activity. Behav Ter 2000;31(2):365-79. DOI:10.1016/S0005-7894(00)80020-9
  • 20
    Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for health-related diet and exercise behaviors. Health Educ Res 1988;3(3):283-92. DOI:10.1093/her/3.3.283
  • 21
    Santos MS, Reis RS, Rodriguez-Añez CR, Fermino RC. Desenvolvimento de um instrumento para avaliar as barreiras para a prática de atividade física em adolescentes. Rev Bras Ativ Fis Saude 2009;14(2):76-85.
  • 22
    Terwee CB, Bot SDM, Boer MR, Van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007;60(1):34-42. DOI:10.1016/j.jclinepi.2006.03.012
  • 23
    Velicer WF, DiClement CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol 1985;48(5):1279-89. DOI:10.1037/0022-3514.48.5.1279
  • 24
    Warburton DER, Nicol CW, Bredin SSD. Health benefits of physical activity: the evidence. CMAJ 2006;174(6):801-9. DOI:10.1503/cmaj.051351
  • 25
    World Health Organization. Global health risks: mortality and burden of disease attributable to selected major risks. Geneva; 2009.

  • Based on the doctoral thesis by Rafael Martinez Tassitano, titled: “Impacto de uma intervenção para o aumento da atividade física e consumo de frutas, legumes e verduras em estudantes universitários: ensaio clínico randomizado”, presented at the Postgraduate Program in Nutrition at the Universidade Federal de Pernambuco, in 2013.
  • a
    PACE Projects. Measures: adolescent psychosocial scales [Internet]. [cited 2010 Apr 19]. Available from: http://www.paceproject.org/Measures.html
  • b
    Associação Brasileira de Empresas de Pesquisa (ABEP). Critério de Classificação Econômica do Brasil [cited 2011 Oct 20]. Available from: http:/www.abep.org

Publication Dates

  • Publication in this collection
    07 Aug 2015

History

  • Received
    24 Mar 2014
  • Accepted
    27 Oct 2014
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br