Satisfaction with mental health community services among patients’ relatives

Satisfação com serviços comunitários de saúde mental entre os familiares dos pacientes

Luciane Prado Kantorski Vanda Maria da Rosa Jardim Carlos Alberto dos Santos Treichel Daiane Aquino Demarco Aline dos Santos Neutzling Michele Mandagará de Oliveira Valéria Cristina Chirstello Coimbra About the authors

ABSTRACT:

Objective:

This study aims to assess the satisfaction of family members of patients of mental health community services through a tested, validated and previously applied scale in order to allow comparison of results.

Methods:

The results were obtained by applying the scale SATIS-BR to 1242 relatives of patients of 40 mental health community services in Brazil. The average scores of the three subscales of the SATIS-BR scale were compared using the Wilcoxon test. To measure statistical significance for each item of the scale, the Friedman test was applied, considering significant p-value < 0.05.

Results:

The average overall satisfaction score was 4.35 with a standard deviation (SD) of 0.44, with a range varying from 1 to 5. The subscale with the highest score refers to the “Results of Treatment”, what presents scores of 4.54 with SD of 0.66. As for the other subscales, which refer to “Reception and Staff Competence” and “Service Privacy and Confidentiality” had scores of 4.25 (SD: 0.51) and 4.17 (SD: 0.51).

Conclusion:

The high level of satisfaction with the service among families of patients highlights the potential of these services and their contribution to the advance of a model of mental health community care, as it seems to be the global trend. The different results between the scales further suggest that the family distinguishes different aspects of the service and evaluates separately, providing a good reference for evaluation studies.

Keywords:
Personal Satisfaction; Community Mental Health Services; Caregivers; Mental Health; CAPS

RESUMO:

Objetivo:

Este estudo objetivou avaliar a satisfação dos familiares de pacientes de serviços comunitários de saúde mental através de uma escala testada, validada e aplicada anteriormente, a fim de permitir a comparação de resultados.

Métodos:

Os resultados foram obtidos através da aplicação da escala SATIS-BR em 1242 familiares de pacientes de 40 serviços comunitários de saúde mental no Brasil. Os escores médios das três subescalas da escala SATIS-BR foram comparados pelo teste de Wilcoxon. Para medir a significância estatística para cada item da escala, o teste de Friedman foi aplicado, considerando-se como significância valor de p < 0,05.

Resultados:

A pontuação satisfação global média foi de 4,35, com desvio padrão (DP) de 0,44, em uma escala que varia de 1 a 5. A subescala com maior pontuação se refere aos “Resultados do Tratamento”, que apresentou escore de 4,54 com DP de 0,66 . Quanto as outras subescalas, que se referem a “Recepção e Competência da Equipe” e “Privacidade e Confidencialidade do Serviço” as pontuações foram de 4,25 (DP: 0,51) e 4,17 (DP: 0,51) respectivamente.

Conclusão:

O elevado nível de satisfação com o serviço entre os familiares dos pacientes destaca o potencial desses serviços e a sua contribuição para o avanço de um modelo comunitário de atenção à saúde mental. Os resultados diferentes entre as escalas sugerem ainda que o familiar distingue os diversos aspectos do serviço e os avalia separadamente, constituindo uma boa referência para estudos de avaliação.

Palavras-chave:
Satisfação Pessoal; Serviços comunitários de saúde mental; Cuidadores; Saúde mental

INTRODUCTION

It is estimated that mental disorders reach about 20 to 25% of the world’s population at some point in life, creating a major impact on the quality of life of these individuals and their families. Thus emerges the need to structure and qualify services that are able to manage and support these individuals according to their demands and needs. In this sense, studies show that, in many countries, there have been initiatives to develop community services in order to care for the individuals within the community, preserving their family and social ties, promoting their autonomy and reducing high costs with hospitalizations11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,22. Thornicroft G, Tansella M. Good Practices in Community Mental Health. Barueri: Manole; 2010.,33. World Health Organization. Mental Health: New Understanding, New Hope. World Health Report. Geneva: World Health Organization; 2001..

Brazil currently counts with a structured policy in the mental health area, ensuring community care. However, among the factors highlighted as difficulties in consolidating a network effective community mental health in the country, as well as in other countries that have adopted similar models, are the difficulty of defining criteria for evaluation and the setting of priorities in assistance.

In this way, as indicated by Pitta et al.44. Pitta AMF, Silva Filho JF, Souza GW, Lancman S, Kinoshita RT, Cavalcanti MT, et al. Quality determinants on mental health services in Brazilian cities: satisfaction study on developed activities outcomes by patients, family members and health workers. Rev Bras Psiquiatr 1995; 44(9): 441-52.; Carvalho and Amarante55. Carvalho AL, Amarante PDC. Qualitative evaluation in new mental health services: a search for new parameters. Saúde Debate 1996; 52: 74-82.; Silva Filho et al.66. Silva Filho JF, Cavalcanti MT, Cadilhe GR, Vilaça AT, Avancini E, Machado HO, et al. Quality assurance of outcome mental health services at Niterói, Brazil: The patient satisfaction as a methodological criteria. Rev Bras Psiquiatr 1996; 45(7): 393-402.; Almeida77. Almeida PF. The challenge of producing indicators for evaluating mental health services: a case study of the psychosocial care center Rubens Correa/RJ. [Dissertation] Rio de Janeiro: Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz; 2002.; Wetzel and Kantorski88. Wetzel C, Kantorski LP. Evaluation of mental health services in the context of psychiatric reform. Texto Contexto Enferm 2005; 13(4): 593-8.; Kantorski et al.99. Kantorski LP, editor. CAPSUL - Avaliação dos CAPS da Região Sul do Brasil: Relatório. Pelotas: Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq, Ministério da Saúde; 2007.,1010. Kantorski LP, editor. Redes que reabilitam: avaliando experiências inovadoras de composição de redes de atenção psicossocial: relatório final. Pelotas: Faculdade de Enfermagem, Universidade Federal do Rio Grande do Sul; 2011.,1111. Kantorski LP, editor. CAPSUL II - Avaliação dos CAPS da Região Sul do Brasil II: Relatório. Pelotas: Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq, Ministério da Saúde ; 2012.; Onocko-Campos and Furtado1212. Onocko-Campos RT, Furtado JP. Public health and mental health: methodological tools to evaluate the Brazilian Network of Referral Centers for Psycho-Social Care (CAPS) in the Brazilian Unified Health System. Cad Saúde Pública 2006; 22(5): 1053-62.; Furtado et al.1313. Furtado JP. Evaluation as a device. [Thesis]. Campinas: Departamento de Medicina Preventiva e Social, Universidade Estadual de Campinas; 2001.,1414. Furtado JP. Evaluation of the situation of Therapeutic Residential Services in the Brazilian public health system. Ciênc Saúde Colet 2006; 11(3): 785-95.,1515. Furtado JP, Onocko-Campos RT, Moreira MIB, Trapé TL. Participatory development of indicators for assessing mental health. Cad Saúde Pública 2013; 29(1): 102-10. the realization of evaluative studies seems to be an important ally in the consolidation of structured health systems based on community service, since it allows the identification of areas that require investment and strengthening and allow to include the family in discussions on this perspective.

The inclusion of the family in the evaluative processes, besides being an important strategy of valorization, allows perceiving their impressions, needs and desires, provided that they are the primary unit of socialization of its members1616. Doornbos MM. Predicting Family Health in Families of Young Adults with Severe Mental Illness. J Fam Nurs 2002; 8(3): 241-63. and constitute an important part of users of mental health community services.

Among the various possible evaluations, studies regarding users’ satisfaction with the service can be powerful tools, since they allow users to express their views on different aspects. Like so, restructuring can be planned according to the perspective of those who are affected by the activities of the service.

Understanding the user’s family as a subject also involved in service actions, previous studies have evaluated the satisfaction of relatives of patients with mental health community services1717. Tung WC, Beck SL. Family caregivers’ satisfaction with home care for mental illness in Taiwan. Int J Ment Health Nurs 2007; 16: 62-9.,1818. Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010.,1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.,2020. Perreault M, Rousseau M, Provencher H, Roberts S, Milton D. Predictors of Caregiver Satisfaction with Mental Health Services. Community Ment Health J 2012; 48: 232-7.,2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013..

Therefore, this study aims to assess the satisfaction of patients’ relatives of 40 mental health community services in Brazil.

METHODS

This is a cross-sectional quantitative study to assess the satisfaction of 1,242 relatives interviewed between July/December 2011 in mental health community services in 39 municipalities of the three southern states of Brazil.

This study is part of the Research of Epidemiological Evaluation of Centers for Psychosocial Care in Southern Brazil (CAPSUL II), which was approved by the Ethics Committee of the School of Nursing of the Universidade Federal de Pelotas - UFPel under technical opinion No. 176/2011. The respondents agreed to participate in the study and signed the Informed Consent.

The data collect was carried in 40 Community Mental Health Services (named CAPS), type I, II and III among three states of Southern Brazil (Paraná, Santa Catarina and Rio Grande do Sul). According to the Brazilian Institute of Geography and Statistics (IBGE)2222. IBGE - Instituto Brasileiro de Geografia e Estatística. Censo Demográfico 2010. Disponível em: <http://www.censo2010.ibge.gov.br>.
http://www.censo2010.ibge.gov.br...
during the data collection, the states had estimated 2,756,1827 inhabitants; from these inhabitants, 1,051,2151 were living in Paraná, 6,31,6906 in Santa Catarina and 1,073,2770 in Rio Grande do Sul. In agreement with the regional health planning principles, each state is split into health regions. In this sense, the states of Paraná, Santa Catarina and Rio Grande do Sul, count respectively with 6, 9 and 7 health macro-regions each.

The amount of CAPS type I, II and III available in the three states during the research corresponded to 232 services, divided in a ratio of 66, 32 and 2% to CAPS type I, II and III respectively. In the state of Paraná, during the research, there was 43 CAPS type I, 23 CAPS type II and 2 CAPS type III. In the state of Santa Catarina, during the research, there was 45 CAPS type I, 12 CAPS type II and 2 CAPS type III. In the state of Rio Grande do Sul, during the research, there were 65 CAPS type I, 40 CAPS type II and none CAPS type III.

The proportionality of services in each state was respected for the selection of the services included in the study; this way, the sample included 12 services from Paraná, 10 services from Santa Catarina and 18 services from Rio Grande do Sul. First, it was decided to intentionally include all CAPS type III (4) available in the three states and later it was adopted drowns that take account the health regions existing in each state and the proportion of CAPS type I and II.

The ratio calculation between CAPS type I and II resulted in 67 and 33% respectively. Thus, it was decided that the 36 services to be selected should be divided into 24 CAPS type I and 12 CAPS type II. This way, considering the proportionality of services in each state, it was defined the inclusion of 7 CAPS type I for the state of Paraná, 6 for the state of Santa Catarina and 11 for the state of Rio Grande do Sul. In the same sense, it was defined the inclusion of 3 CAPS type II for the state of Paraná, 2 for the state of Santa Catarina and 7 for the state of Rio Grande do Sul.

The draws of the services included in the study were conducted state by state based on the health regions existing in each one. In the state of Paraná, which has six health regions and the inclusion of 7 CAPS type I was planned, first it was defined that one service would be drawn in each health region and later, by drawn, the health region in which would be carried out a new draw for the 7th service selection to be studied was defined. For the selection of CAPS type II, a first draw defined the three health regions in which the draws of services would be conducted. Subsequently, the draws were carried out in each of these health regions in order to define the services included in the sample.

In the state of Santa Catarina, which has nine health regions and the inclusion of 6 CAPS type I was planned, a first draw defined the six health regions in which the draws of services would be conducted. Subsequently, the draws were carried out in each of these health regions to define the services included in the sample. Also, for the selection of CAPS type II, a first draw defined the two health regions in which the draws of services would be conducted. Subsequently the draws in each of these health regions was carried out to define the services included in the sample.

In the state of Rio Grande do Sul, which has 7 health regions and the inclusion of 11 CAPS type I was planned, first it was defined that there would be the drawn of one service in each health region and subsequently, by drawn, it was defined the four regions which would conduce a new draw to select the 8th, 9th, 10th and 11th services to be studied. For the selection of CAPS type II, it was decided that one service would be drawn in each health region.

Based on the sample calculated, the study sought to apply the questionnaire in 1600 users’ relatives of CAPS. For the prevalence, the sample calculation considered an estimated frequency of 50% with a margin of 3 points and alpha (α) of 5%, resulting in the need of n = 1,066. For the association, there was considered a sample’ power of 90%, with a 95% confidence interval (95%CI), ratio of non-exposed/exposed of 2:1, relative risk of 1.3 and a prevalence of 40% in non-exposed. So, the sample indicated was n = 1,038. However, in order to consider expected losses and confounding factors control, there was added in the higher indicated n (n = 1,066) 50% of individuals.

The selection of respondents was carried out through non-probability sampling. All users’ relatives who attended the service during data collection (period of one week) were invited to participate in the study. In addition, in order to complete the sample, users’ relatives were screened through the services recorders, and home visits were conducted. The percentage of losses in the users’ relatives sample was 23%, related to denials and difficulties in finding them; therefore, the final population accessed by this study was of 1,242 users’ relatives of CAPS.

The outcome satisfaction was assessed using the Scale for Assessment of Family Satisfaction with Mental Health Services (SATIS-BR), elaborated by the Division of Mental Health of the World Health Organization (WHO) in 1996 and validated to Brazil by Bandeira et al.2323. Bandeira M, Mercier C, Perreault M, Liberio MMA, Pitta AMF. Scale for the assessment of family satisfaction with mental health services: SATIS-BR. J Bras Psiquiatr 2002; 51(3): 153-66.. The scale has eight items divided into three subscales, which are: results of treatment, reception and staff competence, and service privacy and confidentiality. The answers to the items are arranged on a Likert scale with 5 points, where: 1 = very dissatisfied; 2 = dissatisfied; 3 = indifferent; 4 = satisfied; and 5 = very satisfied1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.. The SATIS-BR scale indicators show good internal consistency, evaluated by the analysis of the Cronbach’s alpha coefficient, having obtained an alpha value of 0.79 for the overall score and values between 0.76 and 0.89 for its subscales, showing that the items of the scale are homogeneous, without being repetitive1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.. Construct validity was evaluated by examining their dimensional structure with Principal Components Analysis with Varimax rotation, and three factors were obtained with eigenvalues above 1.0, which explained 77% of data variance2323. Bandeira M, Mercier C, Perreault M, Liberio MMA, Pitta AMF. Scale for the assessment of family satisfaction with mental health services: SATIS-BR. J Bras Psiquiatr 2002; 51(3): 153-66..

The data went through double entry by independent typist in the software Epi-Info 6.04, and the analysis was made by using the Stata 11.02424. StataCorp. Stata Statistical Software: Release 11. College Station, TX: StataCorp LP; 2009. and SPSS Statistics 20.02525. IBM Corp. Released. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp; 2011. software.

To evaluate the overall satisfaction scores for subscales and items, we used descriptive statistics. The average scores of the three subscales of the SATIS-BR were compared using the Wilcoxon test two by two, in order to identify which pairs of subscales showed significant differences. To measure statistical significance between the items that made up each scale, we used the Friedman test settling as significant a p-value < 0.05.

RESULTS

Data regarding relatives’ satisfaction measured by SATIS-BR scale can be observed in Table 1, which shows the overall score and the relatives’ average satisfaction with comparison of subscales. The nonparametric Wilcoxon test is represented by p values, and shows the comparison between the subscales, two by two.

Table 1:
Average scores and standard deviation of relatives’ satisfaction by subscale, overall score and comparison of subscale’s averages by the nonparametric Wilcoxon test.

The average overall satisfaction score was 4.35 with a standard deviation of 0.44, with a range varying from 1 to 5. The subscale with the highest score refers to the “Results of Treatment”, and stood at 4.54 with standard deviation (SD) of 0.66 also in a variation range from 1 to 5. As for the other subscales, which refer to “Reception and Staff Competence” and “Service Privacy and Confidentiality”, obtained scores of 4.25 (SD: 0.51) and 4.17 (SD: 0.51) were observed, respectively. Using the Wilcoxon test, it is possible to observe that the comparison of the subscales two by two resulted in a significant statistical difference between all subscales.

Average relative satisfaction scores for each item in the SATIS-BR scale are shown in Table 2, where it can also be observed, through the Friedman test, the presence or absence of statistical significance between the items of the subscales.

Table 2:
Average scores and standard deviation of relatives’ satisfaction for the items of the subscales of the SATIS-BR scale.

Of the eight items evaluated to measure the satisfaction of relatives with the service, the items that had the highest scores were those related to the subscale referring to the “Results of Treatment”. Among them, the highest scoring item was the one regarding the benefit of the user with the treatment offered by the service, the estimated score for this item being 4.64 with a standard deviation of 0.77. The second highest score was related to the item assessing whether the services received by the patient helped him deal with his problem, followed by the item that evaluated whether the patient obtained the type of care he needed, these scores being 4.55 (SD: 0.79) and 4.44 (SD: 0.83) respectively.

It is noteworthy that within the subscale “Results of Treatment” there was statistically significant difference between items, with a p-value of 0.001. The same occurs with the subscale “Reception and Staff Competence”, which also showed a statistically significant difference between the items, and the item of highest score in the subscale refers to professional competence within the service. The score for this item was 4.28 with a sta,ndard deviation of 0.58.

The items with lowest score were related to the subscale “Service Privacy and Confidentiality”, their scores were 4.18 (SD: 0.54) and 4.17 (SD: 0.58) for the items on the measures taken to ensure privacy on the patient’s treatment and the measures taken to ensure the confidentiality of information, respectively. There was no statistically significant difference among them, the p-value derived from the Friedman test for these items, being 0.113.

DISCUSSION

Conducting evaluative studies of relatives’ satisfaction with health services meets the recommendations of the WHO3, which has been encouraging new perspectives on evaluation of services, so that the evaluation integrates all parts involved in the factual process of health.

In this sense, previous studies involving family caregivers receiving support from community mental health services conducted in other countries11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,77. Almeida PF. The challenge of producing indicators for evaluating mental health services: a case study of the psychosocial care center Rubens Correa/RJ. [Dissertation] Rio de Janeiro: Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz; 2002.,2020. Perreault M, Rousseau M, Provencher H, Roberts S, Milton D. Predictors of Caregiver Satisfaction with Mental Health Services. Community Ment Health J 2012; 48: 232-7. have been exploring the levels of satisfaction of these relatives. The same occurs with other studies done in Brazil11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,88. Wetzel C, Kantorski LP. Evaluation of mental health services in the context of psychiatric reform. Texto Contexto Enferm 2005; 13(4): 593-8.,1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.,2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013., which, as this study, used the SATIS-BR scale. It is noteworthy that using instruments that can be reapplied in other contexts, such as rating scales, enables constant reevaluation and comparison of findings.

As in previous studies of Santos1818. Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010., Bandeira et al.1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93. and Zendron2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013., the relatives of this study showed high levels of satisfaction, indicating that families are satisfied with the services they have been receiving.

In our study, we found an overall satisfaction score of 4.35 with a standard deviation of 0.44 on a Likert scale with variance of 1 to 5. This score was lower than the one found by Bandeira et al.1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93. and Zendron2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013., whose scores were 4.41 in both studies, but greater than the overall score found by Santos1818. Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010., whose study showed an average satisfaction of 4 with a SD of 0.66.

It is possible to point out that relatives have shown themselves globally satisfied with the service, even presenting high levels of satisfaction. However, when working with the satisfaction of these relatives, caution is demanded, as in addition to considering that caregivers can experience both positive and negative aspects in care situations; we should take into account that part of the caregivers expressed satisfaction, regardless of other factors such as burden, and the condition of health2626. Andrén S, Elmstahl S. Family caregivers’ subjective experiences of satisfaction in dementia care: aspects of burden, subjective health and sense of coherence. Scand J Caring Sci 2005; 19: 157-68..

Among the factors that could explain this phenomenon, is the idea that the service can offer the family some release and relief when assisting the user, and, in this way, the relative can handle other demands of their life. Also, the fact that the service is the largest source of aid to family caregivers, by a possible relation of dependence, can limit the manifestations of dissatisfaction1818. Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010..

This excess of positive responses from family members can be attenuated by the use of multifactorial instruments2525. IBM Corp. Released. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp; 2011.. In this sense, the SATIS-BR scale earns credit, since it has eight items covering satisfaction with three distinct aspects.

The different aspects covered by the scale refer to its subscales and include “Results of Treatment”, “Reception and Staff Competence” and “Service Privacy and Confidentiality”. The subscale with the highest satisfaction score in our study corresponds to the results of treatment, followed by reception and staff competence and service privacy and confidentiality, respectively. The presentation of results in this disposition differs from that found previously in other studies11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,88. Wetzel C, Kantorski LP. Evaluation of mental health services in the context of psychiatric reform. Texto Contexto Enferm 2005; 13(4): 593-8.,2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013., which had higher scores when compared to privacy and confidentiality and the reception staff competency.

It is noteworthy that the averages of the subscales showed significant difference from a statistical standpoint when compared two-by-two using the Wilcoxon test, suggesting that the relative critically evaluates different aspects of the service, being more or less satisfied with many points.

Observing the subscales we can infer that, if on one hand we have relatives satisfied with the results of the treatment, on the other hand we have more apprehensive relatives with the privacy and confidentiality of the service. It is known that, historically, individuals in psychological distress and their families suffer from the stigmatization of madness, which may contribute to the concerns with the maintenance of privacy and confidentiality, so that they become more critical about this aspect in the service. On the contrary, after realizing that the community mental health service is able to keep the patient out of a psychotic break1818. Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010., assisted within the community and acting as the protagonist of their own social identity, the relative can evaluate more positively the results of treatment.

The subscale that showed a score lower than the results of treatment subscale, but higher than the score of the subscale relating to privacy and confidentiality, refers to the reception and competence of the staff. Within this subscale, the highest scoring item corresponds to the professional competence, and the lowest to the understanding of the patient’s problem by the professional who admitted them. A statistically significant difference of averages between items suggests that there is need for more qualified hearing at the moment of the reception of the patient to the service, so that both patient and family feel better understood in their demands.

There was a statistically significant difference also between the averages of the corresponding subscale of treatment results items. Among these items, the highest score alluded to benefit from treatment and the lowest score referred to the help the patient received to deal with their problem. This scenario reinforces the previously suggested one, that although the relatives recognize the results of the treatment, there are issues that require further investments. It is noteworthy that both the item with the lowest score in this subscale and the lowest scoring item in the subscale reception and competence of the staff have to do with the service’s understanding of the users’ needs. In this sense, reframing the spaces for exchange of information between staff and patients and their caregivers, so that there is greater understanding among the parts involved in care, can be a useful strategy for improvement in the services offered. So that the actual demands are identified and the more effective pacts are performed.

The perspective that the families are generally satisfied with the services even though some aspects need to be improved, was found in studies with family caregivers linked to community mental health services in the country11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,88. Wetzel C, Kantorski LP. Evaluation of mental health services in the context of psychiatric reform. Texto Contexto Enferm 2005; 13(4): 593-8.,1919. Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.,2121. Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013. as well as in international studies11. Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.,77. Almeida PF. The challenge of producing indicators for evaluating mental health services: a case study of the psychosocial care center Rubens Correa/RJ. [Dissertation] Rio de Janeiro: Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz; 2002.,2020. Perreault M, Rousseau M, Provencher H, Roberts S, Milton D. Predictors of Caregiver Satisfaction with Mental Health Services. Community Ment Health J 2012; 48: 232-7.. Suggesting that exploring the satisfaction of these relatives is an important mechanism for rethinking and qualifying the mental health services in a continuous and universal way.

CONCLUSION

The high level of satisfaction with the service by relatives highlights the potential of these services and their contribution to the advance of a model of community mental health care, as it seems to be the global trend.

It is also possible to observe that the results of this study corroborate with previous findings that the relative is generally satisfied with the services offered. The different results between the scales further suggest that the family distinguishes different aspects of the service and evaluates separately, providing a good reference for evaluation studies.

Thus, reframing the spaces of exchanges between the service, your patients and caregivers can be a useful strategy for improvement in the services offered.

REFERENCES

  • 1
    Thornicroft G, Tansella M, Law A. Steps, challenges and lessons in developing community mental health care. World Psychiatry 2008; 7(2): 87-92.
  • 2
    Thornicroft G, Tansella M. Good Practices in Community Mental Health. Barueri: Manole; 2010.
  • 3
    World Health Organization. Mental Health: New Understanding, New Hope. World Health Report. Geneva: World Health Organization; 2001.
  • 4
    Pitta AMF, Silva Filho JF, Souza GW, Lancman S, Kinoshita RT, Cavalcanti MT, et al. Quality determinants on mental health services in Brazilian cities: satisfaction study on developed activities outcomes by patients, family members and health workers. Rev Bras Psiquiatr 1995; 44(9): 441-52.
  • 5
    Carvalho AL, Amarante PDC. Qualitative evaluation in new mental health services: a search for new parameters. Saúde Debate 1996; 52: 74-82.
  • 6
    Silva Filho JF, Cavalcanti MT, Cadilhe GR, Vilaça AT, Avancini E, Machado HO, et al. Quality assurance of outcome mental health services at Niterói, Brazil: The patient satisfaction as a methodological criteria. Rev Bras Psiquiatr 1996; 45(7): 393-402.
  • 7
    Almeida PF. The challenge of producing indicators for evaluating mental health services: a case study of the psychosocial care center Rubens Correa/RJ. [Dissertation] Rio de Janeiro: Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz; 2002.
  • 8
    Wetzel C, Kantorski LP. Evaluation of mental health services in the context of psychiatric reform. Texto Contexto Enferm 2005; 13(4): 593-8.
  • 9
    Kantorski LP, editor. CAPSUL - Avaliação dos CAPS da Região Sul do Brasil: Relatório. Pelotas: Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq, Ministério da Saúde; 2007.
  • 10
    Kantorski LP, editor. Redes que reabilitam: avaliando experiências inovadoras de composição de redes de atenção psicossocial: relatório final. Pelotas: Faculdade de Enfermagem, Universidade Federal do Rio Grande do Sul; 2011.
  • 11
    Kantorski LP, editor. CAPSUL II - Avaliação dos CAPS da Região Sul do Brasil II: Relatório. Pelotas: Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq, Ministério da Saúde ; 2012.
  • 12
    Onocko-Campos RT, Furtado JP. Public health and mental health: methodological tools to evaluate the Brazilian Network of Referral Centers for Psycho-Social Care (CAPS) in the Brazilian Unified Health System. Cad Saúde Pública 2006; 22(5): 1053-62.
  • 13
    Furtado JP. Evaluation as a device. [Thesis]. Campinas: Departamento de Medicina Preventiva e Social, Universidade Estadual de Campinas; 2001.
  • 14
    Furtado JP. Evaluation of the situation of Therapeutic Residential Services in the Brazilian public health system. Ciênc Saúde Colet 2006; 11(3): 785-95.
  • 15
    Furtado JP, Onocko-Campos RT, Moreira MIB, Trapé TL. Participatory development of indicators for assessing mental health. Cad Saúde Pública 2013; 29(1): 102-10.
  • 16
    Doornbos MM. Predicting Family Health in Families of Young Adults with Severe Mental Illness. J Fam Nurs 2002; 8(3): 241-63.
  • 17
    Tung WC, Beck SL. Family caregivers’ satisfaction with home care for mental illness in Taiwan. Int J Ment Health Nurs 2007; 16: 62-9.
  • 18
    Santos AFO. Family caregivers of mental health service users: burden and satisfaction towards the service. [Thesis] Ribeirão Preto: Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto; 2010.
  • 19
    Bandeira M, Silva MA, Camilo CA, Felício CM. Family satisfaction in mental health services and associated factors. J Bras Psiquiatr 2011; 60(4): 284-93.
  • 20
    Perreault M, Rousseau M, Provencher H, Roberts S, Milton D. Predictors of Caregiver Satisfaction with Mental Health Services. Community Ment Health J 2012; 48: 232-7.
  • 21
    Zendron PFD. Satisfaction of family caregivers of patients with mental disorders with a mental health service in an interior city. [Thesis] Ribeirão Preto: Escola de Enfermagem de Ribeirão Preto da Universidade de São Paulo; 2013.
  • 22
    IBGE - Instituto Brasileiro de Geografia e Estatística. Censo Demográfico 2010. Disponível em: <http://www.censo2010.ibge.gov.br>.
    » http://www.censo2010.ibge.gov.br
  • 23
    Bandeira M, Mercier C, Perreault M, Liberio MMA, Pitta AMF. Scale for the assessment of family satisfaction with mental health services: SATIS-BR. J Bras Psiquiatr 2002; 51(3): 153-66.
  • 24
    StataCorp. Stata Statistical Software: Release 11. College Station, TX: StataCorp LP; 2009.
  • 25
    IBM Corp. Released. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp; 2011.
  • 26
    Andrén S, Elmstahl S. Family caregivers’ subjective experiences of satisfaction in dementia care: aspects of burden, subjective health and sense of coherence. Scand J Caring Sci 2005; 19: 157-68.

  • Financial support: Ministério da Saúde (Ministry of Health).

Publication Dates

  • Publication in this collection
    Apr-Jun 2017

History

  • Received
    20 Jan 2016
  • Accepted
    28 Nov 2016
Associação Brasileira de Pós -Graduação em Saúde Coletiva São Paulo - SP - Brazil
E-mail: revbrepi@usp.br