Evidence of the validity of the Multidimensional Scale of Perceived Social Support (MSPSS) in university students

Adriana Vieira Macêdo Brugnoli Tonantzin Ribeiro Gonçalves Renato Canevari Dutra da Silva Marcos Pascoal Pattussi About the authors

Abstract

Social support refers to the social resources that a person perceives to be available and has been strongly associated with physical and mental health outcomes. The present study aimed to evaluate the internal consistency, construct validity, and test-retest reliability of the Perceived Social Support Multidimensional Scale (PSSMS) in university students in the Midwest of Brazil. Exploratory and confirmatory factor analyses were performed with two independent random samples, both consisting of 1,147 students. The test-retest study was carried out with a sample of 347 medical students. Data were collected in two separate moments with a 14-day interval. The solution with the best fit was the three-factor model: family, friends, and significant others. The factor loadings of the scale items ranged between 0.767 and 0.950 and each factor showed high internal consistency (Cronbach’s alpha=0.96, 0.97, and 0.97, respectively). The model also attained adequate fit: χ2(d.f.)=380 (49), p<0.0001; SRMR=0.023; RMSEA=0.077; CFI=0.993; TLI=0.990. Test-retest reliability was moderate (weighted kappa ranging from 0.36 to 0.52). The results suggest that the PSSMS has acceptable psychometric properties for use with university students.

Key words:
Social support; Multidimensional Scale of Perceived Social Support; University students

Introduction

Social support can be understood as the perception that social resources are available or actual support provided by family, friends, or peers11 Cassel J. Psychosocial processes and "stress": theoretical formulation. Int J of Health Serv 1974; 4(3):471-482.,22 Gottlieb BH, Bergen AE. Social support concepts and measures. J Psychosom Res 2010; 69(5):511-520.. It means having someone to turn to in times of need33 Kaplan BH, Cassel JC, Gore S. Social support and health. Med Care 1977; 15(5):47-58.. Types of social support may be classified as emotional (empathy, love, trust, and generosity)3, instrumental (tangible aid in performing activities)1, informational (advice, information)44 Cassel J. The contribution of the social environment to host resistance: the fourth wade hampton frost lecture. Am J Epidemiol 1976; 104(2):107-123., social interaction (personal networks)3, appraisal (information that is useful for self-evaluation)4, and cognitive (the influence of learning on individual behavior, help with memory loss and reasoning)33 Kaplan BH, Cassel JC, Gore S. Social support and health. Med Care 1977; 15(5):47-58.,55 Kelly ME, Duff H, Kelly S, Power JEM, Brennan S, Lawlor BA, Loughrey DG. The impact of social activities, social networks, social support and social relationships on the cognitive functioning of healthy older adults: a systematic review. Syst Rev J 2017; 6(259):5-18..

Social support has been associated with better physical and mental health6. High levels of social support act as a protective factor against a range of morbidities, thus contributing to better health outcomes6. Having someone you can count on to provide emotional and material support in times of need has been associated with lower levels of anxiety, depression, and somatic disorders and helps people to adapt better to the effects of stressful life events66 Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161.,77 Aragão EIS, Portugal FB, Campos MR, Lopes CS, Fortes SLCL. Distintos padrões de apoio social percebido e sua associação com doenças físicas (hipertensão, diabetes) ou mentais no contexto da atenção primária. Cien Saude Colet 2017; 22(7):2367-2374..

Several instruments have been developed to assess social support and its various dimensions88 Rock DL, Green KE, Wise BK, Rock RD. Social support scales and social networks: a psychometric review. Res Nurs Health 1984; 7(4):325-332.,99 Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19., including the Multidimensional Scale of Perceived Social Support (MSPSS). The MSPSS was originally developed with a sample of 275 US university students10 and later tested on a wider sample including 265 pregnant women, 74 adolescents, and 55 pediatric residents11. The studies confirmed the theoretical formulation of the scale items and the existence of three moderately correlated factors. The MSPSS evaluates emotional support and social interaction from three sources: family, friends, and significant others1010 Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Soc Psychol 1988; 52(1):30-41.. Other commonly used scales assess other facets of social support such as informational and instrumental support, but without specifying the sources, meaning that the MSPSS is differentiated from other measures. The instrument is also used widely around the world because it is easy to use and has a relatively small number of items (12), making it the ideal measure when time is limited.

Recently, a systematic review of 70 studies with approximately 30,909 participants evaluating the MSPSS translated in 22 languages reported that most studies attained a Cronbach’s alpha of at least 0.70 and test-retest correlation ranging between 0.72 and 0.859. The MSPSS has demonstrated internal consistency, test-retest stability, and stable factor structure99 Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19.,1111 Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617., which is relatively consistent across the various countries where the scale has been translated and adapted9. However, the large majority of the 70 studies only performed exploratory analysis, with only nine performing confirmatory factor analysis99 Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19.. The scale’s psychometric properties have been studied in various groups, including adolescents1212 Canty-Mitchell J, Zimet GD. Psychometric properties of the multidimensional scale of perceived social support in urban adolescents. Am J Community Psychol 2000; 28(3):391-400.,1313 Merino-Soto C, Boluarte Carbajal A, Toledano-Toledano F, Nabors LA, Núñez-Benítez MÁ. A New Story on the Multidimensionality of the MSPSS: Validity of the Internal Structure through Bifactor ESEM. Int J Environ Res Public Health 2022; 19(2):935., adults with chronic diseases1414 De Maria M, Vellone E, Durante A, Biagioli V, Matarese M. Psychometric evaluation of the multidimensional scale of perceived social support (MSPSS) in people with chronic diseases. Ann Ist Super Sanita 2018; 54(4):308-315.,1515 Micozkadioglu H, Micozkadioglu I, Zumrutdal A, Erdem A, Ozdemir FN, Sezer S, Haberal M. Relationship between depressive affect and malnutrition-inflammation complex syndrome in haemodialysis patients. Nephrology 2006; 11(6):502-505., psychiatric patients11 Cassel J. Psychosocial processes and "stress": theoretical formulation. Int J of Health Serv 1974; 4(3):471-482.6, cancer patients1717 Calderón C, Ferrando PJ, Lorenzo-Seva U, Gómez-Sánchez D, Fernández-Montes A, Palacín-Lois M, Antoñanzas-Basa M, Rogado J, Manzano-Fernández A, Ferreira E, Asensio-Martínez E, Jiménez-Fonseca P. Multidimensional Scale of Perceived Social Support (MSPSS) in cancer patients: psychometric properties and measurement invariance. Psicothema 2021; 33(1):131-138., older persons1818 Pérez-Villalobos C, Briede-Westermeyer JC, Schilling-Norman MJ, Contreras-Espinoza S. Multidimensional scale of perceived social support: evidence of validity and reliability in a Chilean adaptation for older adults. BMC Geriatr 2021; 21(1):461., and family caregivers of people with dementia1919 Cartwright AV, Pione RD, Stoner CR, Spector A. Validation of the multidimensional scale of perceived social support (MSPSS) for family caregivers of people with dementia. Aging Ment Health 2022; 26(2):286-293..

The MSPSS has been adapted for use in Brazil and evidence of validity was reported by Garbado-Martins et al.2020 Gabardo-Martins LMD, Ferreira MC, Valentini F. Propriedades psicométricas da escala multidimensional de suporte social percebido. Temas Psicol 2017; 25(4):1873-1883. in a study with 831 male and female workers from 25 states, most of whom had post-graduate degrees. Factor analysis confirmed factor structure and resulted in acceptable estimates of internal consistency (Cronbach’s alfa: friends, 0.93; family, 0.91; and significant others, 0.90)2020 Gabardo-Martins LMD, Ferreira MC, Valentini F. Propriedades psicométricas da escala multidimensional de suporte social percebido. Temas Psicol 2017; 25(4):1873-1883.. In addition, confirmatory factor analysis showed that the three-factor solution presented good goodness-of-fit indices2020 Gabardo-Martins LMD, Ferreira MC, Valentini F. Propriedades psicométricas da escala multidimensional de suporte social percebido. Temas Psicol 2017; 25(4):1873-1883..

There is no doubt about the importance of social support for the health and well-being of young university students, a group with high prevalence of stress and psychological distress2121 Granieri A, Franzoi IG, Chung MC. Editorial: Psychological Distress Among University Students. Front Psychol 2021; 12:647940.. When evaluating social support in specific populations, it is important to consider the intrinsic variability of social networks and cultural standards22 Gottlieb BH, Bergen AE. Social support concepts and measures. J Psychosom Res 2010; 69(5):511-520.,66 Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161.. Studies investigating the validity of the MSPSS are therefore important to ensure the accurate evaluation of specific population groups. Evidence of the validity of the MSPSS in university students can help researchers and practitioners choose the best social support measures for this group. Furthermore, there is currently no evidence for test-retest reliability of the Brazilian version of the instrument. The aim of this study was therefore to obtain evidence of validity based on the structure (exploratory and confirmatory factor analysis), internal consistency (Cronbach’s alpha), and test-retest reliability of the MSPSS among university students in the Midwest region of Brazil.

Methods

The study population was taken from a cross-sectional study with 2,295 health students at a university in the Midwest region of Brazil. In 2018 a survey was conducted with all health students studying at the university using a pre-tested standardized questionnaire containing the MSPSS and questions devised to collect information about sociodemographic characteristics, behaviors, nutrition, and health. The present study was divided into two stages. The first stage assessed the construct validity and internal consistency of the MSPSS in the respondents of the above survey. The second stage explored MSPSS test-retest reliability in a sample of 347 medical students from the original study population. The data for the second stage were collected in November 2019 in two separate moments with a 14-day interval. The sample sizes used in both stages exceeded the minimum size per instrument question recommended in the literature by at least 10 people2222 Hair Junior JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7ª ed. New Jersey: Pearson Prentice Hall; 2009.. In both stages, the students were approached in the classroom and completed a self-administered questionnaire read out by a researcher in order to minimize missing answers. After completion, the questionnaire was placed in a sealed box.

As mentioned above, the MSPSS assesses emotional support and social interaction from three sources: friends, family, and significant others. The family support items (3, 4, 8 and 11) assess emotional support, availability of support, and help dealing with problems and making decisions, such as item 3: “My family really tries to help me”. The support from friends items (6, 7, 9 and 12) investigate help dealing with adverse situations, sharing joys and sorrows, and talking about problems, as illustrated by item 7: “I can count on my friends when things go wrong”. The significant others items (1, 2, 5 and 10) look at the presence of a special person in time of need as a source of comfort, to share joys and sorrows, and care about feelings, as shown by item 1: “There is a special person who is around when I am in need”. The questions are answered on a 7-point Likert scale, as follows: very strongly disagree (1); strongly disagree (2); mildly disagree (3); neutral (4); mildly agree (5); strongly agree (6); very strongly agree (7).

The data were double entered using EpiData version 3.1 and checked for typing errors. The analyses were performed using Mplus version 8.42323 Muthén LK, Muthén BO. Mplus user's guide. 7ª ed. Los Angeles: Muthén & Muthén; 2012.. The sample was described using absolute and relative frequencies, means, and standard deviations. Internal consistency was measured using Cronbach’s alpha, where values equal to or greater than 0.7 indicate a factor structure with good internal consistency2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55..

Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed with two random independent samples of 1,147 individuals (excluding one student who did not answer the scale). EFA was performed using the factor extraction method weighted least squares mean and variance adjusted (WLSMV), inputting the variables as categorical variables (PROBIT link) and using Geomin oblique factor rotation, which allows the factors to be correlated among themselves2323 Muthén LK, Muthén BO. Mplus user's guide. 7ª ed. Los Angeles: Muthén & Muthén; 2012.,2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55..

Factor structure was confirmed using CFA adopting the same estimation method. The analysis tested solutions with one to four factors to determine which model had the best fit2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55.,2525 Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006.. We opted for an open solution with up to four factors. The fit of the factor structure was measured considering the factor loading of the items, number of items per factor, the model’s fit indices2525 Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006., and the results of the analysis of internal consistency2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55..

The following fit indicators were used in the EFA and CFA: RV (residual variance)2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55., chi-squared (χ²), standardized root mean square residual (SRMR), root mean square error of approximation (RMSEA), comparative fit index (CFI), and the Tucker-Lewis index (TLI)2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55.,2525 Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006.. RV represents the variance not explained by the latent factor, where a value of less than 0.75 is deemed adequate2222 Hair Junior JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7ª ed. New Jersey: Pearson Prentice Hall; 2009..

Chi-squared tests difference between the empirical matrix and matrix of the theoretical model. For an acceptable fit, the χ² value should accept the null hypothesis (nonsignificant p-value>0.05)24. RMSEA2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55. values close to or less than 0.06 indicate good fit. SRMR2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55. values of close to or less than 0.08 are recommended, where the closer to zero the better the fit of the model. CFI2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55. and TLI2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55. values range between 0 and 1, where values greater than 0.90 and 0.95 are deemed acceptable and adequate respectively. Improvement in fit with the inclusion of covariances was determined using the Theta modification index24, added to the CFA only when theoretical plausibility was detected.

The test-retest stability (TR) of each scale item was tested using crude and weighted total percentage agreement and kappa coefficients (κ), using the following kappa reference values: 0, no agreement; 0.1 to 0.20, minimal agreement; 0.21 to 0.40, reasonable agreement; 0.41 to 0.60, moderate agreement; 0.61 to 0.80, substantial agreement; and 0.81 to 1.0, perfect or almost perfect agreement2424 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55.

25 Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006.
-2626 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1):159-174..

All participants signed an informed consent form. The study was conducted in accordance with the ethical, legal, and regulatory norms and standards for research involving human subjects set out in National Health Council resolutions 466/2012 and 510/2016. The study protocol was approved by the Universidade do Vale do Rio dos Sinos’s and Universidade de Rio Verde’s research ethics committees (certificate No. 97545818.2.0000.5344/reference No. 2.892.764 and certificate No. 97545818.2.3001.5077/reference No. 2.905.704, respectively, and reference numbers 3.649.203 and 3.688.985, respectively for the test-retest study).

Results

The EFA and CFA samples were both made up of 1,147 students (total=2,294). The test-retest study was conducted with a sample of 347 medical students. The students were predominantly white single females aged between 21 and 22 years. Economic class A accounted for 45.2%, 44.1%, and 23.9%, respectively, of the EFA, CFA, and test-retest samples (Table 1).

Table 1
Demographic and socioeconomic characteristics of the university students.

As expected, the solution with the best fit in the exploratory analysis was the four-factor model. However, this solution was immediately discarded and is not presented here because the fourth factor had only one item (I have a special person who is a real source of comfort to me). The two-factor solution loaded friends and significant others on factor 1 and maintained the original family factor in factor 2. The best solution was therefore deemed to be the three-factor model, which reproduced the factor structure suggested by the literature: significant others (factor 1), family (factor 2), and friends (factor 3). These factors obtained the following Cronbach’s alpha values: 0.96, 0.97, and 0.97, respectively.

The factor loadings of the three-factor model ranged between 0.636 and 0.972 and the following fit indices were obtained: χ²(d.f.) 660.425(33), p<0.0001; SRMR=0.025; RMSEA=0.130; CFI=0.987, and TLI=0.973 (Table 2). The Theta modification index indicated the inclusion of two correlations that made theoretical sense: item 1 (There is a special person who is around when I am in need) with item 2 (There is a special person with whom I can share my joys and sorrows) and item 5 (I have a special person who is a real source of comfort to me) with item 10 (There is a special person in my life who cares about my feelings). These correlations were therefore added to the CFA, resulting in a better fit to the data.

Table 2
Results of the exploratory factor analysis using Geomin rotation for a solution with one, two, and three factors and scale fit indices in Brazilian university students (n=1,130).

In the confirmatory factor analysis (CFA), the factor loadings of the items of the three-factor solution ranged between 0.76 and 0.95 and the model obtained the following fit indices: χ²(d.f.)=380.006 (49), p<0.0001; SRMR=0.023; RMSEA=0.077; CFI=0.993; TLI=0.990 (Figure 1).

Figure 1
Confirmatory factor analysis of the three-factor solution for the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students (n=1,143).

With regard to test-retest stability, the crude and weighted kappa coefficient values ranged between 0.26 and 0.39 and 0.36 and 0.52, respectively, while crude and weighted percentage agreement ranged between 48.7% and 62.5% and 83.5 and 89.7%, respectively (Table 3).

Table 3
Crude and weighted kappa coefficient values and percentage agreement of the test-retest of the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students (n=347).

Discussion

The aim of this study was to assess the internal consistency, construct validity, and test-retest reliability of the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students. Our findings confirm the three-factor structure (family, friends, and significant others) of the original version of the MSPSS1010 Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Soc Psychol 1988; 52(1):30-41.,1111 Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617.. These results are consistent with the literature on this population2727 Duru E. Re-examination of the psychometric characteristics of the Multidimensional Scale of Perceived Social Support among Turkish university students. Soc Behav Pers 2007; 35(4):443-452.

28 Guan NC, Seng LH, Ann AYH, Hui KO. Factorial validity and reliability of the malaysian simplified Chinese version of Multidimensional Scale of Perceived Social Support (MSPSS-SCV) among a group of university students. Asia Pac J Public Health 2015; 27(2):225-231.

29 Basol G. Validity and reliability of the multidimensional scale of perceived social support-revised, with a turkish sample. Soc Behav Personality 2008; 36(10):1303-1314.

30 Clara IP, Cox BJ, Enns MW, Murray LT, Torgrudc LJ. Confirmatory factor analysis of the multidimensional scale of perceived social support in clinically distressed and student samples. J Pers Soc Psychol 2003; 81(3):265-270.

31 Carvalho S, Pinto-Gouveia J, Pimentel P, Maia D, Mota-Pereira J. Características psicométricas da versão portuguesa da Escala Multidimensional de Suporte Social Percebido (Multidimensional Scale of Perceived Social Support - MSPSS). Psychol 2011; 54:331-357.

32 Eker D, Arkar H, Yaldiz H. Generality of support sources and psychometric properties of a scale of perceived social support in Turkey. Soc Psychiatry Psychiatr Epidemiol 2000; 35:228-233.
-3333 Ng CG, Amer Siddiq AN, Aida SA, Zainal NZ, Koh OH. Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in faculty of medicine, University of Malaya. Asian J Psychiatr 2010; 3(1):3-6.. The findings also demonstrate that the MSPSS and factors have high internal consistency and that the factor solution provides a good fit for study population, obtaining higher values than those reported for the original version of the scale1111 Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617. and a previous study with 237 medical students3333 Ng CG, Amer Siddiq AN, Aida SA, Zainal NZ, Koh OH. Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in faculty of medicine, University of Malaya. Asian J Psychiatr 2010; 3(1):3-6..

The CFA results, except for the significant χ² value, which is strongly influenced by sample size, suggest that the model has good fit. The other indicators demonstrated adequate values for the three-factor model in comparison to the one- and two-factor models and considering the values obtained by the study that evaluated the original version of the scale1414 De Maria M, Vellone E, Durante A, Biagioli V, Matarese M. Psychometric evaluation of the multidimensional scale of perceived social support (MSPSS) in people with chronic diseases. Ann Ist Super Sanita 2018; 54(4):308-315. and other studies with university students2727 Duru E. Re-examination of the psychometric characteristics of the Multidimensional Scale of Perceived Social Support among Turkish university students. Soc Behav Pers 2007; 35(4):443-452.

28 Guan NC, Seng LH, Ann AYH, Hui KO. Factorial validity and reliability of the malaysian simplified Chinese version of Multidimensional Scale of Perceived Social Support (MSPSS-SCV) among a group of university students. Asia Pac J Public Health 2015; 27(2):225-231.
-2929 Basol G. Validity and reliability of the multidimensional scale of perceived social support-revised, with a turkish sample. Soc Behav Personality 2008; 36(10):1303-1314.,3333 Ng CG, Amer Siddiq AN, Aida SA, Zainal NZ, Koh OH. Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in faculty of medicine, University of Malaya. Asian J Psychiatr 2010; 3(1):3-6.,3434 Ekbäck M, Benzein E, Lindberg M, Årestedt K. The Swedish version of the multidimensional scale of perceived social support (MSPSS) - a psychometric evaluation study in women with hirsutism and nursing students. Health Qual Life Outcomes 2013; 11:168.. The RMSEA was acceptable despite being slightly higher than the desired value. A previous study with 549 university students reported similar results, supporting the three-factor model and showing that the MSPSS had high internal consistency and acceptable RMSEA3030 Clara IP, Cox BJ, Enns MW, Murray LT, Torgrudc LJ. Confirmatory factor analysis of the multidimensional scale of perceived social support in clinically distressed and student samples. J Pers Soc Psychol 2003; 81(3):265-270..

In addition, factor loadings in the CFA were high (above 0.78) and the factors reproduced the results of the original version of the scale1111 Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617., which is consistent with previous studies99 Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19.,2828 Guan NC, Seng LH, Ann AYH, Hui KO. Factorial validity and reliability of the malaysian simplified Chinese version of Multidimensional Scale of Perceived Social Support (MSPSS-SCV) among a group of university students. Asia Pac J Public Health 2015; 27(2):225-231.. In our study, we found correlations with lower factor loadings in items 1, 2, 5, 10, which belong to the “significant others” factor. This may be explained by the fact that university students may perceive family and friends to be a more acceptable source of support than significant others, which has been shown by other studies3232 Eker D, Arkar H, Yaldiz H. Generality of support sources and psychometric properties of a scale of perceived social support in Turkey. Soc Psychiatry Psychiatr Epidemiol 2000; 35:228-233.,3434 Ekbäck M, Benzein E, Lindberg M, Årestedt K. The Swedish version of the multidimensional scale of perceived social support (MSPSS) - a psychometric evaluation study in women with hirsutism and nursing students. Health Qual Life Outcomes 2013; 11:168.. Based on the results of the theoretical plausibility test, we therefore introduced correlations between items 1 and 2 and items 5 and 10, improving the fit of the confirmatory model.

With regard to test-retest reliability, the MSPSS showed reasonable stability over time for a 14-day interval and moderate agreement for scale items with their respective factors, as reported by Portugal3131 Carvalho S, Pinto-Gouveia J, Pimentel P, Maia D, Mota-Pereira J. Características psicométricas da versão portuguesa da Escala Multidimensional de Suporte Social Percebido (Multidimensional Scale of Perceived Social Support - MSPSS). Psychol 2011; 54:331-357. for the friends factor. In addition, the results of a study assessing the validity of a Russian version of the MSPSS with 1,018 adults3535 Pushkarev GS, Zimet GD, Kuznetsov VA, Yaroslavskaya EI. The Multidimensional Scale of Perceived Social Support (MSPSS): reliability and validity of Russian version. Clin Gerontol 2018; 43(3):331-339. indicated acceptable test-retest reliability. It is possible that changes in perceived social support occurred during the time interval given that this construct is strongly mediated by other psychosocial aspects66 Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161., which may explain the insubstantial Kappa values found in the present study. In addition, it is important to consider measure errors that are intrinsic to the construct assessed by the scale in consecutive applications.

Finally, it can be concluded that the MSPSS has acceptable psychometric properties, adequate internal consistency and construct validity, and moderated test-retest reliability, suggesting that the instrument has good fit for use with university students. As proposed by Zimmet, the three-factor solution showed the best fit. The availability of MSPSS and evidence for validity can help in investigating mechanisms and causal relationships between social support and physical and mental health among university students66 Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161.,1212 Canty-Mitchell J, Zimet GD. Psychometric properties of the multidimensional scale of perceived social support in urban adolescents. Am J Community Psychol 2000; 28(3):391-400..

Although our findings support the use of the Brazilian version of the scale, certain limitations need to be considered. The study sample comprised health students and is therefore not representative of students doing other courses or young people in general. Studies evaluating evidence for the validity of the MSPSS with clinical samples have yet to be conducted and would be an interesting direction for future research. Future studies with other population groups, using robust methods to assess measurement invariance of the MSPSS in minority groups for example, could help make the measure more accurate and enable comparison between results obtained with different populations.

References

  • 1
    Cassel J. Psychosocial processes and "stress": theoretical formulation. Int J of Health Serv 1974; 4(3):471-482.
  • 2
    Gottlieb BH, Bergen AE. Social support concepts and measures. J Psychosom Res 2010; 69(5):511-520.
  • 3
    Kaplan BH, Cassel JC, Gore S. Social support and health. Med Care 1977; 15(5):47-58.
  • 4
    Cassel J. The contribution of the social environment to host resistance: the fourth wade hampton frost lecture. Am J Epidemiol 1976; 104(2):107-123.
  • 5
    Kelly ME, Duff H, Kelly S, Power JEM, Brennan S, Lawlor BA, Loughrey DG. The impact of social activities, social networks, social support and social relationships on the cognitive functioning of healthy older adults: a systematic review. Syst Rev J 2017; 6(259):5-18.
  • 6
    Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161.
  • 7
    Aragão EIS, Portugal FB, Campos MR, Lopes CS, Fortes SLCL. Distintos padrões de apoio social percebido e sua associação com doenças físicas (hipertensão, diabetes) ou mentais no contexto da atenção primária. Cien Saude Colet 2017; 22(7):2367-2374.
  • 8
    Rock DL, Green KE, Wise BK, Rock RD. Social support scales and social networks: a psychometric review. Res Nurs Health 1984; 7(4):325-332.
  • 9
    Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19.
  • 10
    Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Soc Psychol 1988; 52(1):30-41.
  • 11
    Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617.
  • 12
    Canty-Mitchell J, Zimet GD. Psychometric properties of the multidimensional scale of perceived social support in urban adolescents. Am J Community Psychol 2000; 28(3):391-400.
  • 13
    Merino-Soto C, Boluarte Carbajal A, Toledano-Toledano F, Nabors LA, Núñez-Benítez MÁ. A New Story on the Multidimensionality of the MSPSS: Validity of the Internal Structure through Bifactor ESEM. Int J Environ Res Public Health 2022; 19(2):935.
  • 14
    De Maria M, Vellone E, Durante A, Biagioli V, Matarese M. Psychometric evaluation of the multidimensional scale of perceived social support (MSPSS) in people with chronic diseases. Ann Ist Super Sanita 2018; 54(4):308-315.
  • 15
    Micozkadioglu H, Micozkadioglu I, Zumrutdal A, Erdem A, Ozdemir FN, Sezer S, Haberal M. Relationship between depressive affect and malnutrition-inflammation complex syndrome in haemodialysis patients. Nephrology 2006; 11(6):502-505.
  • 16
    Vaingankar JA, Abdin E, Chong SA. Exploratory and confirmatory factor analyses of the Multidimensional Scale of Perceived Social Support in patients with schizophrenia. Compr Psychiatry 2012; 53(3):286-291.
  • 17
    Calderón C, Ferrando PJ, Lorenzo-Seva U, Gómez-Sánchez D, Fernández-Montes A, Palacín-Lois M, Antoñanzas-Basa M, Rogado J, Manzano-Fernández A, Ferreira E, Asensio-Martínez E, Jiménez-Fonseca P. Multidimensional Scale of Perceived Social Support (MSPSS) in cancer patients: psychometric properties and measurement invariance. Psicothema 2021; 33(1):131-138.
  • 18
    Pérez-Villalobos C, Briede-Westermeyer JC, Schilling-Norman MJ, Contreras-Espinoza S. Multidimensional scale of perceived social support: evidence of validity and reliability in a Chilean adaptation for older adults. BMC Geriatr 2021; 21(1):461.
  • 19
    Cartwright AV, Pione RD, Stoner CR, Spector A. Validation of the multidimensional scale of perceived social support (MSPSS) for family caregivers of people with dementia. Aging Ment Health 2022; 26(2):286-293.
  • 20
    Gabardo-Martins LMD, Ferreira MC, Valentini F. Propriedades psicométricas da escala multidimensional de suporte social percebido. Temas Psicol 2017; 25(4):1873-1883.
  • 21
    Granieri A, Franzoi IG, Chung MC. Editorial: Psychological Distress Among University Students. Front Psychol 2021; 12:647940.
  • 22
    Hair Junior JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7ª ed. New Jersey: Pearson Prentice Hall; 2009.
  • 23
    Muthén LK, Muthén BO. Mplus user's guide. 7ª ed. Los Angeles: Muthén & Muthén; 2012.
  • 24
    Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55.
  • 25
    Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006.
  • 26
    Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1):159-174.
  • 27
    Duru E. Re-examination of the psychometric characteristics of the Multidimensional Scale of Perceived Social Support among Turkish university students. Soc Behav Pers 2007; 35(4):443-452.
  • 28
    Guan NC, Seng LH, Ann AYH, Hui KO. Factorial validity and reliability of the malaysian simplified Chinese version of Multidimensional Scale of Perceived Social Support (MSPSS-SCV) among a group of university students. Asia Pac J Public Health 2015; 27(2):225-231.
  • 29
    Basol G. Validity and reliability of the multidimensional scale of perceived social support-revised, with a turkish sample. Soc Behav Personality 2008; 36(10):1303-1314.
  • 30
    Clara IP, Cox BJ, Enns MW, Murray LT, Torgrudc LJ. Confirmatory factor analysis of the multidimensional scale of perceived social support in clinically distressed and student samples. J Pers Soc Psychol 2003; 81(3):265-270.
  • 31
    Carvalho S, Pinto-Gouveia J, Pimentel P, Maia D, Mota-Pereira J. Características psicométricas da versão portuguesa da Escala Multidimensional de Suporte Social Percebido (Multidimensional Scale of Perceived Social Support - MSPSS). Psychol 2011; 54:331-357.
  • 32
    Eker D, Arkar H, Yaldiz H. Generality of support sources and psychometric properties of a scale of perceived social support in Turkey. Soc Psychiatry Psychiatr Epidemiol 2000; 35:228-233.
  • 33
    Ng CG, Amer Siddiq AN, Aida SA, Zainal NZ, Koh OH. Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in faculty of medicine, University of Malaya. Asian J Psychiatr 2010; 3(1):3-6.
  • 34
    Ekbäck M, Benzein E, Lindberg M, Årestedt K. The Swedish version of the multidimensional scale of perceived social support (MSPSS) - a psychometric evaluation study in women with hirsutism and nursing students. Health Qual Life Outcomes 2013; 11:168.
  • 35
    Pushkarev GS, Zimet GD, Kuznetsov VA, Yaroslavskaya EI. The Multidimensional Scale of Perceived Social Support (MSPSS): reliability and validity of Russian version. Clin Gerontol 2018; 43(3):331-339.

Publication Dates

  • Publication in this collection
    17 Oct 2022
  • Date of issue
    Nov 2022

History

  • Received
    31 Jan 2022
  • Accepted
    15 June 2022
  • Published
    17 June 2022
ABRASCO - Associação Brasileira de Saúde Coletiva Rio de Janeiro - RJ - Brazil
E-mail: revscol@fiocruz.br