Transcultural adaptation to Brazilian Portuguese and reliability of the effort-reward imbalance in household and family work

Ilmeire Ramos Rosembach de Vasconcellos Rosane Härter Griep Luciana Portela Márcia Guimarães de Mello Alves Lúcia Rotenberg About the authors

ABSTRACT

OBJECTIVE

To describe the steps in the transcultural adaptation of the scale in the Effort-reward imbalance model to household and family work to the Brazilian context.

METHODS

We performed the translation, back-translation, and initial psychometric evaluation of the questionnaire that comprised three dimensions: (i) effort (eight items, emphasizing quantitative workload), (ii) reward (11 items that seek to capture the intrinsic value of family and household work, societal esteem, recognition from the spouse/partner, and affection from the children), and (iii) overcommitment (four items related to intrinsic effort). The scale was included in a sectional study conducted with 1,045 nursing workers. A subsample of 222 subjects answered the questionnaire for a second time, seven to 15 days thereafter. The data were collected between October 2012 and May 2013. The internal consistency of the scale was evaluated using Cronbach’s alpha and test-retest reliability analysis, square weighted kappa, prevalence and bias adjusted Kappa, and intraclass correlation coefficient.

RESULTS

Prevalence and bias-adjusted Kappa (ka) of the scale dimensions ranged from 0.80-0.83 for overcommitment, 0.78-0.90 for effort, and 0.76-0.93 for reward. In most dimensions, the values of minimum and maximum scores, average, standard deviation, and Cronbach’s alpha were similar in test and retest scores. Only on societal esteem subdimension (reward) was there little variation in standard deviation (test score of 2.24 and retest score of 3.36) and in Cronbach’s alpha coefficient (test score of 0.38 and retest score of 0.59).

CONCLUSIONS

The Brazilian version of the scale was found to have proper reliability indices regarding time stability, which suggests adapting it to be used in population with characteristics that are similar to the one in this study.

Homemaker Services; Evaluation, methods; Questionnaires; Translations; Reproducibility of Results; Validation Studies

INTRODUCTION

Several studies point towards negative health impacts from household and family work. A Brazilian study with 2,057 women from Feira de Santana, BA, Northeastern Brazil, found significant association between household and family work overload and the most common disorders, which are characterized by symptoms such as fatigue, memory lapses, insomnia, irritability, difficulty concentrating, headaches, and psychosomatic symptoms88. Pinho PS, Araújo TM. Associação entre sobrecarga doméstica e transtornos mentais comuns em mulheres. Rev Bras Epidemiol. 2012;15(3):560-72. DOI:10.1590/S1415-790X2012000300010
https://doi.org/10.1590/S1415-790X201200...
. Another line of studies discusses household and family work demands in combination with stress at professional work, and problems were identified regarding depression55. Ertel KA, Koenen KC, Berkman LF. Incorporating home demands into models of job strain: findings from the work, family, and health network. J Occup Environ Med. 2008;50(11):1244-52. DOI:10.1097/JOM.0b013e31818c308d
https://doi.org/10.1097/JOM.0b013e31818c...
, common mental disorders and difficulty recovering after professional work1212. Rotenberg L, Silva-Costa A, Griep RH. Mental health and poor recovery in female nursing workers: a contribution to the study of gender inequities. Rev Panam Salud Publica. 2014;35(3):179-85., and arterial blood pressure changes22. Brisson C, Laflamme N, Moisan J, Milot A, Mâsse B, Vézina M. Effect of family responsibilities and job strain on ambulatory blood pressure among white-collar women. Psychosom Med. 1999;61(2):205-13. DOI:10.1097/00006842-199903000-00013
https://doi.org/10.1097/00006842-1999030...
,99. Portela LF, Rotenberg L, Almeida AL, Landsbergis P, Griep RH. The influence of domestic overload on the association between job strain and ambulatory blood pressure among female nursing workers. Int J Environ Res Public Health. 2013;10(12):6397-408. DOI:10.3390/ijerph10126397
https://doi.org/10.3390/ijerph10126397...
. Despite the evidence suggesting household and family work may be a source of diseases and physical exhaustion; up until recently no specific tools to evaluate psychosocial stress from household and family work existed.

In 2012, Sperlich et al.1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
proposed an adaptation of the effort-reward imbalance model (ERI) to the household environment1515. Siegrist J. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol. 1996;1(1):27-41. DOI:10.1037/1076-8998.1.1.27
https://doi.org/10.1037/1076-8998.1.1.27...
. Such tool is recognized in the occupational health field as adequate to evaluate stress from professional work. The ERI model1515. Siegrist J. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol. 1996;1(1):27-41. DOI:10.1037/1076-8998.1.1.27
https://doi.org/10.1037/1076-8998.1.1.27...
considers stress as the result from an imbalance between effort that is made and rewards that are received due to work. Thus, the higher the effort (a worker’s duties), the smaller the reward (support and respect from colleagues, proper wages, possibility of promotions, tenure, and social status), causing a higher imbalance that could generate frustration and feelings of injustice1515. Siegrist J. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol. 1996;1(1):27-41. DOI:10.1037/1076-8998.1.1.27
https://doi.org/10.1037/1076-8998.1.1.27...
. A third dimensions is part of the model – overcommitment to work –, which is an internal component of effort that is related to a worker’s personality and to the way they deal with their work requirements. This dimension supposedly acts by changing the effects from the negative consequences from the imbalance between effort and reward at work1515. Siegrist J. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol. 1996;1(1):27-41. DOI:10.1037/1076-8998.1.1.27
https://doi.org/10.1037/1076-8998.1.1.27...
. Several studies found an association between ERI and the different health outcomes, such as arterial hypertension2020. Xu W, Yu H, Hang J, Gao W, Zhao Y, Guo L. The interaction effect of effort-reward imbalance and overcommitment on hypertension among Chinese workers: findings from SHISO study. Am J Ind Med. 2013;56(12):1433-41. DOI:10.1002/ajim.22254
https://doi.org/10.1002/ajim.22254...
, low quality of life1818. Tzeng DS, Chung WC, Lin CH, Yang CY. Effort-reward imbalance and quality of life of healthcare workers in military hospitals: a cross-sectional study. BMC Health Serv Res. 2012;12(1):309. DOI:10.1186/1472-6963-12-309
https://doi.org/10.1186/1472-6963-12-309...
, and physical and psychic morbidity symptoms1313. Shimazu A, Jonge J. Reciprocal relations between effort-reward imbalance at work and adverse health: a three-wave panel survey. Soc Sci Med. 2009;68(1):60-8. DOI:10.1016/j.socscimed.2008.09.055
https://doi.org/10.1016/j.socscimed.2008...
.

According to Sperlich et al.1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
, household and family work, as well as professional work, has a social identity and can be equally strenuous and gratifying, thus implying costs and gains. However, its demands can be less obvious, once the basic household chores are considered to be “natural” responsibilities of women. The rewards are generally emotional in nature, such as the social acknowledgment of the role mothers and wives perform, and the social affection from their children and husbands. Thus, generalizing reward aspects in the professional environment (related to issues regarding financial matters, careers, esteem, gratification, and job security) to unpaid work is not possible. In this context, the authors adapted the ERI model to household and family work performed by women1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
.

Sperlich et al.1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
evaluate that, as posited by the ERI model, stress in household and family work is tied to the dynamics between effort and reward. Thus, when there is an imbalance between the high effort performed at household and family work and the low reward received from children or partners, emotions such as anger and frustration could arise as a result from the feeling of having been treated unfairly, which causes both stress and sickening. In this perspective, the Effort-Reward Imbalance in Household and Family Work (herein referred to as “domestic ERI”) focuses on the peculiarities of household and family work, which is still predominantly performed by women44. Carr D, Springer KW. Advances in families and health research in the 21st Century. J Marriage Fam. 2010;72(3):743- 61. DOI:10.1111/j.1741-3737.2010.00728.x
https://doi.org/10.1111/j.1741-3737.2010...
. Effort is measured by the workload in activities such as cooking, washing and ironing, tidying up and cleaning the house, and organizing tasks related to family and child care. Reward is measured by considering the intrinsic value of family and household work, societal esteem from work as mothers and wives, recognition from spouses or partners, and affection from children. Still in a way that is similar to the original ERI model, we included the “overcommitment to household and family work” dimension to the new scale. This dimension refers to the excessively motivational character related to work. People with that characteristic have increased risk of experiencing imbalance between costs and gains, as they tend to be too invested at work. Thus, the high effort made rarely finds proper reward1919. Xu L, Siegrist J, Cao W, Li L, Tomlinson B, Chan J. Measuring job stress and family stress in Chinese working women: a validation study focusing on blood pressure and psychosomatic symptoms. Women Health. 2004;39(2):31-46. DOI:10.1300/J013v39n02_03
https://doi.org/10.1300/J013v39n02_03...
.

Domestic ERI comprises 23 items based on women’s demands regarding their daily domestic environments and are divided in three dimensions: (i) effort, which is measured using eight items concerning work overload and household chores; (ii) reward, which comprises 11 items divided in four subdimensions (intrinsic value of family and household work, societal esteem, recognition from spouses or partners, and affection from children); and (iii) overcommitment, which is evaluated according to four items regarding the component of personal nature (intrinsic effort), which evaluates a woman’s ability to have herself removed from household and family duties. This scale was developed and validated in a study in Germany with 3,129 women with children younger than 18 years old1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
. Its results pointed towards a factorial structure compatible with the theoretical imbalance model between effort and reward. Besides that, family ERI was found to be associated with milder psychic disorders (anxiety and depression), with worse self-reported health statuses, and to higher arterial blood pressure levels1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
.

This article aimed to describe the steps in the transcultural adaptation of domestic ERI scale to the Brazilian context.

METHODS

The process of adapting the domestic ERI scale to the Brazilian cultures, shown in Figure 1, has followed the recommendations from Herdman et al.66. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7(4):323-35. DOI:10.1023/A:1024985930536
https://doi.org/10.1023/A:1024985930536...
and Reichenheim and Moraes1010. Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica. 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035
https://doi.org/10.1590/S0034-8910200600...
.

Figure 1
Scheme of steps in the transcultural adaptation of the Effort-reward imbalance model to household and family work scale.

The translation was performed by three independent native Brazilian Portuguese-speaking translators, asked to give grades indicating the difficulty level to translate each item in the scale, on a specific form. These scores ranged from zero (no difficulty) to 10 (maximum difficulty). According to these instructions, the priority was to translate the meanings of terms (semantic equivalence) rather than to just translate excerpts literally.

In compliance with the authors of the original scale on household and family work1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
, recent recommendations were followed regarding the formats of answer categories to the items in the ERI scale1414. Siegrist J, Wege N, Pühlhofer F, Wahrendorf M. A short generic measure of work stress in the era of globalization: effort-reward imbalance. Int Arch Occup Environ Health. 2009;82(8):1005-13. DOI:10.1007/s00420-008-0384-3
https://doi.org/10.1007/s00420-008-0384-...
. A Likert scale was adopted (completely disagree; partially disagree; partially agree; completely agree) (operational equivalence).

The first consensus version for the three translations of the scale was obtained by a panel of specialists (two epidemiologists and two workers’ health care researchers) that were experienced in the use of scales and in the adaptation of questionnaires to Brazilian Portuguese. This version was pre-tested with eight women who had been asked to review how clearly they could understand the items.

A new consensus version containing changes suggested in the tests was the submitted to two native English-speaking translators who independently retranslated the Brazilian version of the scale (first version of the scale) back to English. They had no access to the original English version of the scale.

After that, the specialists compared the original English version, its translation to Portuguese, and the back-translation, and achieved the final translated version of the scale. Doubts on the most adequate translations for the terms were discussed with one of the authors of the original scale, Stephanie Sperlich. This version, which was obtained from previous steps, was submitted to two pre-testing rounds, to evaluate for a second time the clarity and appropriateness of the terms in the Brazilian culture.

The final version of the scale was inserted into a multidimensional questionnaire, which was applied to a group of female workers from a large general hospital in Rio de Janeiro. The data were collected from October 2012 to May 2013, on the hospital’s different work shifts and on the seven days of the week. The questionnaire was filled by the subjects with help from trained interviewers. Among the 1,332 eligible professionals, 1,224 workers (91.9%) took part in the study. Losses regarded to refusals (81) and subjects not found (27), totaling 108 workers (8.8%). Only women were included in the presented analyses (n = 1,045).

A convenience subsample (n = 222) took part in the test-retest reliability study to test for time stability of the questionnaire. The nursing workers (nurses, nursing technicians, and nursing auxiliaries) were invited to fill out the same questionnaire again after seven to 15 days.

After being filled out, the questionnaires were revised by a trained research assistant. The answers obtained in the sectional study and in the test-retest reliability analysis were double typed into a database (EpiInfo software, version 3.5.4), and had their inconsistencies rectified. The data were analyzed in softwares Statistical Package for Social Science for Windows (SPSS, version 20) and Computer Programs for Epidemiologists for Windows (WinPepi, version 11.39).

The domestic ERI scores were calculated by adding the points in each alternative in dimensions effort, reward, and overcommitment, whose points were distributed as follows: (1) completely disagree, (2) partially disagree, (3) partially agree, and (4) completely agree. The following items from reward dimension had their scores inverted: “from my child/children I usually feel the appreciation and affection that I would wish for”, “I receive a great deal in return from my child/children for my efforts at home”, “I feel that overall, household and family work are worth the effort”, “The work I do for my family provides a deeper meaning to my life”, “I usually obtain an appropriate level of recognition and appreciation from my partner for my work at home”, and “my partner often thanks me for my work at home”. This inversion was necessary so the same pattern in the answers to the remaining questions, whose scores increase as the negative evaluation of each item increases, could be followed. The imbalance between effort and reward was calculated according the following equation: Domestic ERI = e/(r x c), where e is the sum of the scores of effort items, r is the sum of reward scores and c is the 0.73 correction factor, which derives from the division between the number of items regarding effort and reward (8/11). Values above 1 indicate imbalance in the relationships between effort and reward, which means that the effort made outweighs the reward received in regards to household and family work. The commitment to household chores and family duties was evaluated by summing the scores in each item. Equal results of the ones above 12 indicate overcommitment1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
.

The internal consistency of the items that compose each dimension of the scale was evaluated using Cronbach’s alpha. Time stability (test-retest reliability analysis) was evaluated by the square weighted kappa index with its respective 95% confidence intervals (95%CI) and the prevalence and bias-adjusted Kappa (PABAK)33. Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423-9. DOI:10.1016/0895-4356(93)90018-V
https://doi.org/10.1016/0895-4356(93)900...
, calculated in the Winpepi software (version 11.39). Test-retest reliability of dimensions was evaluated using the intraclass correlation coefficient (ICCC) with its 95%CI (SPSS, version 20). Byrt’s criteria33. Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423-9. DOI:10.1016/0895-4356(93)90018-V
https://doi.org/10.1016/0895-4356(93)900...
were adopted for interpreting the reliability results in the study, as follows: weak (0 to 0.20), mild (0.21 to 0.40), reasonable (0.41 to 0.60), good (0.61 to 0.80), very good (0.81 and 0.92), and excellent (0.93 to 1.00) (measurement equivalence).

The research was approved by Oswald Cruz Foundation’s Human Research Ethics Committee – Oswaldo Cruz Institute (CEP Fiocruz-IOC: 635/11). All subjects signed consent forms.

RESULTS

The marks given by the translators regarding the difficulty level of their translations ranged from zero to three. During the translation process, the longer headers caused more doubts, which were properly resolved while the consensus version was drafted. This version was sent for back-translation, which produced two English versions. After that, the original version, the back translations, and the final translation were compared by the panel of specialists. The professionals in this panel considered the difficulties pointed out by the translators in the first step and by the back translators, and attempted to achieve a pre-test version. This process also generated instructions to be observed in the following pre-test stage.

The professionals overseeing the subjects filling out the questionnaires were requested to solve the respondents’ doubts regarding the questions in both pre-test stages. The remaining doubts were solved by comparing the original German, the English, and the Portuguese versions. The original author of the scale, Stephanie Sperlich, was also inquired.

During these stages, four items in the scale caused doubts, and they were discussed with one of the scale’s authors. The items were the following:

1) In the case of item “I easily run into time pressures in my household and family work”, the doubt regarded the best adaptation for the expression “run into time pressures” based on what the original version intended to convey. The issue was: was the person being pressed for time due to excess duties (i.e., “being subject to time pressure”) or feeling pressed because of their own private feelings? Reward dimension can be observed to have an item that concerns to time pressure (There is often great time pressure because of the many household and family duties). Thus, for the first item to be able to capture the intrinsic dimension regarding overcommitment, the final translation, in Portuguese, “I am easily subjected to time pressure during household and family work”.

2) Item “Nowadays, a person is regarded disapprovingly if he/she is ‘only’ involved in household and family work brought the word ‘only’ between quotes. We understand that emphasis was placed on the word ‘only’, as if the idea of someone working at home performing household chores only, out of the job market, could not be conceived. In the Brazilian reality, depending on a person’s social class, that is a frequent situation. We talked to one of the authors of the original scale about the intended use of quotes, and she suggested they be removed.

3) Item In my interactions with other people, I often have the experience that the roles of housewife and mother are poorly recognized and appreciated caused doubts regarding what was sought to be measured in the seemingly vague Portuguese phrase “nas minhas interações com outras pessoas”, a literal translation of in my interactions with other people. Thus, we chose to maintain the meaning, although if it was not literal, and the phrase was replaced by “Quando me relaciono com outras pessoas” (“When I interact with other people”).

4) The doubt caused by item “Often my partner does not notice my work in the household and for the family” regarded the phrase “does not notice”, which, in the translation that was proposed by the translators, became “não nota ou não vê” (does not notice or see it). After the pre-tests and the discussion with one of the authors of the original scale, the translation of this item was “Muitas vezes meu parceiro não enxerga o meu trabalho doméstico e familiar” (“My partner oftentimes does not see the work I do around the house”) as it was easier for respondents to understand.

The original version and the final version of the scale, which was obtained after the adaptation process, are shown in Table 1.

Table 1
Questionnaire for measuring effort-reward imbalances in household and family work, in its original English version* and in its final Portuguese version.

Although the subsample of nursing workers has been obtained by convenience in the test-retest reliability analysis, their sociodemographic characteristics were very similar to the ones of the population in the sectional study (Table 2). The average age of the respondents was 45 years; more than half of them had attended college; and a third of them reported that their families earned income of up to two times the minimum monthly wage. More than half of them were married, and around one fourth of the subjects reported having children under six years of age. Regarding their occupational characteristics, most subjects were observed to work as nursing auxiliaries; they reported spending 24.5 hours weekly with household and family duties in average, and spending 33.5 hours weekly with their professional duties in average. However, a significant difference was observed in the range of hours spent with domestic and professional duties in the subsample. The time spent with household chores, as reported in the sectional study, was 20 to 106 hours; in the test-retest reliability analysis, it ranged between 0.5 and 102 hours. The time spent with professional duties, as reported in the sectional study, was from four to 105 hours; in the test-retest reliability analysis, it ranged between six and 72 hours.

Table 2
Sociodemographic and occupational characteristics of the sectional study subjects (n = 1,045) and of the test-retest reliability analysis of domestic ERI (n = 222). Rio de Janeiro, RJ, Southeastern Brazil, 2013.

The time stability of each item in the dimensions that compose household and family ERI questionnaire is shown in Table 3. The prevalence and bias-adjusted Kappa (PABAK) values ranged from 0.80 to 0.83 (good to very good) for items overcommitment, from 0.78 to 0.90 (good to very good) for items related to effort, and from 0.76 to 0.93 (good to excellent) for the reward items. Generally speaking, time stability values increased after being adjusted for prevalence for most items.

Table 3
Test-retest reliability analysis of the items in the effort-reward imbalance model to household and family work questionnaire. (N = 222)

The four items that were found to be the most difficult to translate, which were included in the probing stage, had the following values for their kappa indices: “I easily run into time pressures in my household and family work” (kappa = 0.83; very good); “In my interactions with other people, I often have the experience that the roles of housewife and mother are poorly recognized and appreciated” (kappa = 0.76; good); “Nowadays, a person is regarded disapprovingly if he/she is ‘only’ involved in household and family work” (kappa = 0.76; good); and “Often my partner does not notice my work in the household and for the family” (kappa = 0.83; very good).

The descriptive statistics and the reliability of dimensions and sub-dimensions proposed by the original version of the questionnaire are shown in Table 4. In most dimensions, the values of minimum and maximum scores, average, standard deviation, and Cronbach’s alpha were similar in test and retest analyses. On societal esteem subdimension (reward), we observed little variation in standard deviation (test score of 2.24 and retest score of 3.36) and in Cronbach’s alpha coefficient (test score of 0.38 and retest score of 0.59). The values of the intraclass correlation coefficients ranged from 0.89 to 0.93 (very good to excellent) for dimensions overcommitment, effort, and global reward; in the reward sub-dimensions, they ranged from 0.78 (good) for “intrinsic value” to 0.88 (very good) for “recognition from the partner”. Reward dimension comprises 11 items; however, five of them were not applied to the unmarried or childless subjects. In this case, some subjects in the study only answered six questions, which justifies the minimum score of 6 for test and retest evaluations.

Table 4
Mean, standard deviation, and Cronbach’s alpha coefficient of the scores in the dimensions of the effort-reward imbalance scale in household and family work. Test-retest reliability study Rio de Janeiro, RJ, Southeastern Brazil, 2013. (N = 222)

Evaluating the internal consistency of each subdimension in the scale in case any items were removed was shown to decrease the Cronbach’s alpha for most of them, which suggests such items contributed to the internal consistency of this dimension (Table 5). However, removing one of the items in “intrinsic value” subdimension (“I often question the meaning of household and family work, since I have to start all over again every day”) raised the Cronbach’s alpha value from 0.45 to 0.57. Besides that, removing one item from overcommitment dimension (“If I postpone something that I really should have finished today, I have trouble sleeping at night”) raised the internal consistency value of the subdimension from 0.80 to 0.83.

Table 5
Cronbach’s alpha coefficient of the scores in the dimensions of the effort-reward imbalance scale in household and family work in case an item were removed. Test-retest reliability study Rio de Janeiro, RJ, Southeastern Brazil, 2013. (N = 1,045)

DISCUSSION

The results in this study showed that the Brazilian version of domestic ERI was found to fall within an acceptable range regarding the time stability of its items, which were evaluated using the test-retest reliability analysis. Besides that, they suggest that most items be adjusted in their respective dimensions by having their internal consistency evaluated. Each step in the process of transculturally adapting the scale to the Brazilian culture, including the initial psychometric evaluation, was conducted according to the criteria from the specialized literature66. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7(4):323-35. DOI:10.1023/A:1024985930536
https://doi.org/10.1023/A:1024985930536...
. The changes required in the scale were based on the discussions between the researchers in charge and specialists, as well as on advice from one of the authors of the original scale, Stephanie Sperlich.

The education levels of the subjects allowed them to fill out the questionnaires regarding the domestic ERI scale by themselves in the test-retest reliability analysis, which prevented sources of variability between interviewers from arising. No missing information was observed in the questionnaires, which suggested that the items in the scale were clear and well understood.

The test-retest reliability analysis of the items and of the dimensions in the scale for evaluating effort-reward imbalances in household and family work was found to have proper levels and good questionnaire stability in the different dimensions, according to the predefined criteria. For most items, time stability as evaluated by the kappa index was partially found to be related to the high frequencies of positive answers in our population, as they were found to be high after being adjusted for prevalence and bias. We should also point out that the items with the lowest time stability values are also included in subdimensions with lower Cronbach’s alpha values (reward and societal esteem). However, we did not find any other studies analyzing the test-retest reliability of the scale, which prevents it from being compared to others.

As in the original study1717. Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health. 2012;12:12. DOI:10.1186/1471-2458-12-12.
https://doi.org/10.1186/1471-2458-12-12...
, the results found have satisfactory internal consistency for most dimensions in the domestic ERI scale, with values that are very similar in dimensions overcommitment (alpha = 0.81), effort (alpha = 0.92), and recognition from the partner (alpha = 9.82). Besides that, the German study authors also found lower internal consistency values in subdimensions intrinsic value and societal esteem, and these were yet higher than the ones found in this article (respectively, alpha = 0.69 and alpha = 0.73). Nonetheless, some differences between this investigation and the German study limit comparing the results between each other, as the latter was developed with a wide range of professions and included women who were exclusively dedicated to household duties. It is also possible that cultural differences regarding the recognition of intrinsic value and societal esteem may have different meanings in both contexts. However, we suggest the performance of qualitative studies to allow us to capture the meaning of the items in these dimensions among Brazilian workers, and to understand them. Important elements such as age, number of children, exclusive dedication to household and family work, and partner’s participation in these tasks must be considered in future investigations that make use of the domestic ERI scale, because of its relationship with the domestic workloads of women.

Although this study comprised a sample of female nursing workers with different characteristics (nighttime and daytime workers with different education levels), including a restricted category limits the generalization of results to the general population of female workers. The process shown was fundamental for the inclusion of a questionnaire in a new context; however, the steps conducted do not necessary mean the relevance of the study was fully examined. There are complementary psychometric evaluations of the questionnaire in the context of the studied population that are still in progress. In this phase, construct validity will be examined, including the dimensional structure, the relevance of the items in the respective dimensions and subdimensions, and construct validity.

Some authors77. Huysamen GK. Coefficient alpha: unnecessarily ambiguous; unduly ubiquitous. SA J Ind Psychol. 2006;32(4):34-40. DOI:10.4102/sajip.v32i4.242
https://doi.org/10.4102/sajip.v32i4.242...
,1111. Revelle W, Zinbarg RE. Coefficients alpha, beta, omega, and the glb: comments on Sijtsma. Psychometrika. 2009;74(1):145-54. DOI:10.1007/s11336-008-9102-z
https://doi.org/10.1007/s11336-008-9102-...
criticize the use of Cronbach’s alpha as the only tool to estimate the internal consistency of a questionnaire. However, a recent study1616. Silva Junior SHA, Vasconcelos AGG, Griep RH, Rotenberg L. Validade e confiabilidade do índice de capacidade para o trabalho (ICT) em trabalhadores de enfermagem. Cad Saude Publica. 2011;27(6):1077-87. DOI:10.1590/S0102-311X2011000600005
https://doi.org/10.1590/S0102-311X201100...
pointed this indicator out as a more conservative one; i.e., it yields values that are inferior to the ones of other estimators, such as McDonald’s Omega. Besides that, using Cronbach’s alpha allowed direct comparison to the original study. Finally, the debate on to which extent household and family work contributes to health problems in female populations has been highlighted in the literature11. Borrell C, Muntaner C, Benach J, Artazcoz L. Social class and self-reported health status among men and women: what is the role of work organisation, household material standards and household labour? Soc Sci Med. 2004;58(10):1869-87. DOI:10.1016/S0277-9536(03)00408-8
https://doi.org/10.1016/S0277-9536(03)00...
. Domestic ERI scale allows investigating aspects that involve women’s illnesses and health, which are related to stress in a scenario that is so specific of the female universe. However, the questions involving participation in domestic activities, in the work-health relationship, are not restricted to accumulating duties. Therefore, the transcultural adaptation of this questionnaire to Brazilian Portuguese, whose steps are shown in this text, may help composing an initial panorama of household and family work in Brazil. The results indicate proper time stability for the items in the scale, which suggests it can be properly used in populations whose characteristics are similar to the ones in this study. Applying the questionnaire in other categories would reinforce the process and favor the evaluation of whether the questionnaire is relevant for the general population of female workers. Besides that, the scale may be useful in the evaluation of psychosocial stress, considering the professional and domestic realms, thus opening new perspectives for analyzing female work in all its dimensions and meanings.

Acknowledgments

To Stephanie Sperlich for gently offering us the Effort-reward imbalance model to household and family work scale.

REFERENCES

  • 1
    Borrell C, Muntaner C, Benach J, Artazcoz L. Social class and self-reported health status among men and women: what is the role of work organisation, household material standards and household labour? Soc Sci Med 2004;58(10):1869-87. DOI:10.1016/S0277-9536(03)00408-8
    » https://doi.org/10.1016/S0277-9536(03)00408-8
  • 2
    Brisson C, Laflamme N, Moisan J, Milot A, Mâsse B, Vézina M. Effect of family responsibilities and job strain on ambulatory blood pressure among white-collar women. Psychosom Med 1999;61(2):205-13. DOI:10.1097/00006842-199903000-00013
    » https://doi.org/10.1097/00006842-199903000-00013
  • 3
    Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol 1993;46(5):423-9. DOI:10.1016/0895-4356(93)90018-V
    » https://doi.org/10.1016/0895-4356(93)90018-V
  • 4
    Carr D, Springer KW. Advances in families and health research in the 21st Century. J Marriage Fam 2010;72(3):743- 61. DOI:10.1111/j.1741-3737.2010.00728.x
    » https://doi.org/10.1111/j.1741-3737.2010.00728.x
  • 5
    Ertel KA, Koenen KC, Berkman LF. Incorporating home demands into models of job strain: findings from the work, family, and health network. J Occup Environ Med 2008;50(11):1244-52. DOI:10.1097/JOM.0b013e31818c308d
    » https://doi.org/10.1097/JOM.0b013e31818c308d
  • 6
    Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res 1998;7(4):323-35. DOI:10.1023/A:1024985930536
    » https://doi.org/10.1023/A:1024985930536
  • 7
    Huysamen GK. Coefficient alpha: unnecessarily ambiguous; unduly ubiquitous. SA J Ind Psychol 2006;32(4):34-40. DOI:10.4102/sajip.v32i4.242
    » https://doi.org/10.4102/sajip.v32i4.242
  • 8
    Pinho PS, Araújo TM. Associação entre sobrecarga doméstica e transtornos mentais comuns em mulheres. Rev Bras Epidemiol 2012;15(3):560-72. DOI:10.1590/S1415-790X2012000300010
    » https://doi.org/10.1590/S1415-790X2012000300010
  • 9
    Portela LF, Rotenberg L, Almeida AL, Landsbergis P, Griep RH. The influence of domestic overload on the association between job strain and ambulatory blood pressure among female nursing workers. Int J Environ Res Public Health 2013;10(12):6397-408. DOI:10.3390/ijerph10126397
    » https://doi.org/10.3390/ijerph10126397
  • 10
    Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035
    » https://doi.org/10.1590/S0034-89102006005000035
  • 11
    Revelle W, Zinbarg RE. Coefficients alpha, beta, omega, and the glb: comments on Sijtsma. Psychometrika 2009;74(1):145-54. DOI:10.1007/s11336-008-9102-z
    » https://doi.org/10.1007/s11336-008-9102-z
  • 12
    Rotenberg L, Silva-Costa A, Griep RH. Mental health and poor recovery in female nursing workers: a contribution to the study of gender inequities. Rev Panam Salud Publica 2014;35(3):179-85.
  • 13
    Shimazu A, Jonge J. Reciprocal relations between effort-reward imbalance at work and adverse health: a three-wave panel survey. Soc Sci Med 2009;68(1):60-8. DOI:10.1016/j.socscimed.2008.09.055
    » https://doi.org/10.1016/j.socscimed.2008.09.055
  • 14
    Siegrist J, Wege N, Pühlhofer F, Wahrendorf M. A short generic measure of work stress in the era of globalization: effort-reward imbalance. Int Arch Occup Environ Health 2009;82(8):1005-13. DOI:10.1007/s00420-008-0384-3
    » https://doi.org/10.1007/s00420-008-0384-3
  • 15
    Siegrist J. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol 1996;1(1):27-41. DOI:10.1037/1076-8998.1.1.27
    » https://doi.org/10.1037/1076-8998.1.1.27
  • 16
    Silva Junior SHA, Vasconcelos AGG, Griep RH, Rotenberg L. Validade e confiabilidade do índice de capacidade para o trabalho (ICT) em trabalhadores de enfermagem. Cad Saude Publica 2011;27(6):1077-87. DOI:10.1590/S0102-311X2011000600005
    » https://doi.org/10.1590/S0102-311X2011000600005
  • 17
    Sperlich S, Peter R, Geyer S. Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers. BMC Public Health 2012;12:12. DOI:10.1186/1471-2458-12-12.
    » https://doi.org/10.1186/1471-2458-12-12
  • 18
    Tzeng DS, Chung WC, Lin CH, Yang CY. Effort-reward imbalance and quality of life of healthcare workers in military hospitals: a cross-sectional study. BMC Health Serv Res 2012;12(1):309. DOI:10.1186/1472-6963-12-309
    » https://doi.org/10.1186/1472-6963-12-309
  • 19
    Xu L, Siegrist J, Cao W, Li L, Tomlinson B, Chan J. Measuring job stress and family stress in Chinese working women: a validation study focusing on blood pressure and psychosomatic symptoms. Women Health 2004;39(2):31-46. DOI:10.1300/J013v39n02_03
    » https://doi.org/10.1300/J013v39n02_03
  • 20
    Xu W, Yu H, Hang J, Gao W, Zhao Y, Guo L. The interaction effect of effort-reward imbalance and overcommitment on hypertension among Chinese workers: findings from SHISO study. Am J Ind Med 2013;56(12):1433-41. DOI:10.1002/ajim.22254
    » https://doi.org/10.1002/ajim.22254

  • Funding: Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ – Process E-26/110.833/2013). RHG and LR are recipients of research grants from Conselho Nacional de Desenvolvimento científico e Tecnológico (CNPq – Processes 303251/2013-1 and 312060/2012-2, respectively).

Publication Dates

  • Publication in this collection
    27 June 2016

History

  • Received
    21 Jan 2015
  • Accepted
    20 July 2015
Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br