ABSTRACT

OBJECTIVE:

to adapt the Hospital Survey on Patient Safety Culture (HSOPSC) to the Brazilian context and validate a computer program that facilitates the collection and analysis of data in hospitals with different types of management.

METHODS:

methodological study developed in six hospitals in Natal-RN, Brazil; a software which allows data collection via e-mail, cloud storage and automatic data report was developed; validity was verified through confirmatory factor analysis and reliability, through consistency analysis with Cronbach's alpha.

RESULTS:

863 professionals participated in the study; the adapted version presented total Cronbach's alpha of 0.92 and median of 0.69 in the 12 dimensions (90% confidence interval: 0.53;0.87); the model was fitted and showed good indexes in the confirmatory factor analysis.

CONCLUSION:

the results confirmed the validity and reliability of the instrument with adequate psychometric properties for the assessment of patient’s safety culture in Brazilian hospitals.

Keywords:
Validation Studies as Topic; Organizational Culture; Security Management; Quality of Health Care; Patient Safety

Introduction

The occurrence of adverse events in health services has caused avoidable damages to patients and there is an urgent need for preventing it in Brazil and worldwide.¹1. Mendes W, Martins M, Rozenfeld S, Travassos C. The assessment of adverse events in hospitals in Brazil. Int J Qual Health Care. 2009 Aug;21(4):279-84.^,22. Institute of Medicine, Kohn LT, Corrigan JM, Donaldson MS.To err is human: building a safer health system. Washington: National Academies Press; 2000. The awareness towards this issue transformed the patient safety into a priority of health care quality and an important component of systems’ management and health services.³3. Reis CT, Martins M, Languardia J. A segurança do paciente como dimensão da qualidade do cuidado em saúde: um olhar sobre a literatura. Cienc Saude Coletiva. 2013 jul;8(7):2029-36.

The safety culture in an organization may be defined as the product of individuals and group values, attitudes, perceptions, competences and behavior patterns that determine compromise, style, proficiency, health in an organization and safety management.⁴4. Sammer CE, Lykens K, Singh KP, Mains DA, Lackan NA. What is patient safety culture? A review of the literature. J Nurs Scholarsh. 2010 Jun;42(2):156-65. Organization with a positive safety culture are characterized by communications based on mutual trust, common perceptions towards the importance of safety and conviction in the efficacy of preventable measures.⁵5. Health and Safety Commission Advisory Committee on the Safety of Nuclear Installations. Organizing for safety: third report of the ACSNI study group on human factors. Sudbury: HSE Books; 1993.

The consensus over the importance of the safety culture is also present in guidelines of health organizations, such as the National Quality Forum (NQF), from the United States of America; this institution is responsible for preparing a document advising about the establishment and maintenance of a patient safety culture based on four recommendations: (i) development of leadership structures and systems for safety; (ii) measurement, feedback and intervention on safety culture; (iii) teamwork training and skill building; and (iv) systematic implementation of risk management.⁶6. National Quality Forum. Safe practices for healthcare - 2010 update: a consensus report. Washington: The National Quality Forum; 2010.

In the context of Brazilian health care policies, we can highlight the National Patient Safety Program, which aims to promote and support the implementation of actions related to the patient safety.⁷7. Brasil. Ministério da Saúde. Portaria nº 529, de 1º de abril de 2013. Institui o Programa Nacional de Segurança do Paciente (PNSP). Diário Oficial da República Federativa do Brasil, Brasília (DF), 2013 abr 2; Seção 1:43. The current sanitary regulation supports these actions through the mandatory preparation of the Patient Safety Plans and implementation of Centers for Patients Safety in health facilities.⁸8. Brasil. Ministério da Saúde. Resolução da Diretoria Colegiada nº 36 de 25 de julho de 2013. Institui ações para a segurança do paciente em serviços de saúde e dá outras providências. Diário Oficial da República Federativa do Brasil, Brasília (DF), 2013 jul 26;Seção 1:32.

To promote the patient safety culture, the diagnosis and planning of interventions to minimize or reduce the fragilities detected are essential. It is important to highlight that the safety culture must be periodically assessed, as a monitoring activity for the improvements achieved.⁶6. National Quality Forum. Safe practices for healthcare - 2010 update: a consensus report. Washington: The National Quality Forum; 2010.

Among the instruments used to assess the safety culture, the Hospital Survey on Patient Safety Culture (HSOPSC) is, probably, one of the most used worldwide. The HSOPSC had its psychometric properties assessed in a big sample of North-American hospitals;⁹9. Agency for Healthcare Research and Quality. Hospital Survey on Patient Safety Culture. Rockville: Agency for Healthcare Research and Quality; 2004. this tool is internationally recognized and was translated into several languages.¹⁰10. Occelli P, Quenon JL, Kret M, Domecq S, Delaperche F, Claverie O, et al. Validation of the french version of the Hospital Survey on Patient Safety Culture questionnaire. Int J Qual Health Care. 2013 Jul;25(4):459-68.^,1111. Waterson P, Griffiths P, Stride C, Murphy J, Hignett S. Psychometric properties of the Hospital Survey on Patient Safety Culture: findings from the UK. Qual Saf Health Care. 2010 Oct;19(5):e2.

HSOPSC was translated into Portuguese and validated.¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1414. Reis CT. A cultura de segurança do paciente: validação de um instrumento de mensuração para o contexto hospitalar brasileiro [tese]. Rio de Janeiro (RJ): Escola Nacional de Saúde Pública Sergio Arouca; 2013. However, the final version presented low Cronbach's alpha in some dimensions, probably due to translation flaws.¹⁵15. Gama ZAS, Batista AM, Silva IG, Souza RM, Freitas MR. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: oportunidades de melhoria. Cad Saude Publica. 2013 jul;29(7):1473-7.

The objective of this study was to adapt the Hospital Survey on Patient Safety Culture (HSOPSC) to the Brazilian context and validate a computer program that facilitates the collection and analysis of data in hospitals with different types of management.

Methods

This is a methodological study that aims to make a cross-cultural adequacy and validation of an electronic tool to assess the patient safety culture: the HSOPSC.⁹9. Agency for Healthcare Research and Quality. Hospital Survey on Patient Safety Culture. Rockville: Agency for Healthcare Research and Quality; 2004.

The original tool was translated into Portuguese and, then, passed through a cross-cultural adequacy to the context of Brazilian hospitals. After that, a computer program was developed, in which the electronic survey was provided, to make the data collection easier and to allow automatic analysis of results and reports. Finally, an assessment of the psychometric properties of this instrument was conducted in six hospitals under different types of management.

The assessment tool HSOPSC, object of this research, is self-administered and covers 12 dimensions of the patient safety culture, two of them related to results on patient safety: (i) frequency of events reported and (ii) overall perceptions of patient safety; and ten about safety culture: (i) supervisor/manager expectations and actions promoting patient safety, (ii) organizational learning/ continuous improvement, (iii) team work within units, (iv)communication openness, (v) feedback and communication about error, (vi) nonpunitive response to errors, (vii) staffing, (viii) management support for patient safety, (ix) teamwork across units and (x) Handoffs and transitions. Besides these 12 dimensions, the tool covers two more items: (i) number of events reported and (ii) patient safety grade.

The original survey was developed and validated by the Agency for Health Care Research and Quality (AHRQ)⁹9. Agency for Healthcare Research and Quality. Hospital Survey on Patient Safety Culture. Rockville: Agency for Healthcare Research and Quality; 2004., located in the United States, where this survey is widely used, as well as in other countries which made their own validation and adaptation.¹⁰10. Occelli P, Quenon JL, Kret M, Domecq S, Delaperche F, Claverie O, et al. Validation of the french version of the Hospital Survey on Patient Safety Culture questionnaire. Int J Qual Health Care. 2013 Jul;25(4):459-68.

11. Waterson P, Griffiths P, Stride C, Murphy J, Hignett S. Psychometric properties of the Hospital Survey on Patient Safety Culture: findings from the UK. Qual Saf Health Care. 2010 Oct;19(5):e2.

12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.

13. Reis CT, Laguardia J, Vasconcelos AGG , Martins M. Realiability validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study. Cad Saude Publica, 2016 Nov;32(11) :e00115614

14. Reis CT. A cultura de segurança do paciente: validação de um instrumento de mensuração para o contexto hospitalar brasileiro [tese]. Rio de Janeiro (RJ): Escola Nacional de Saúde Pública Sergio Arouca; 2013.^-1515. Gama ZAS, Batista AM, Silva IG, Souza RM, Freitas MR. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: oportunidades de melhoria. Cad Saude Publica. 2013 jul;29(7):1473-7. This survey allows blank answers, in case they do not apply to that professional or unit.

The HSOPSC was translated into Portuguese by a native English speaker translator, from a translation company. Then, a panel composed of five Brazilian specialists performed the back translation: four health professionals - from pharmacy, medicine and physiotherapy areas -and one specialist from quality management in health services, all of them with experience in patient safety. Afterwards, both translations were compared.

A universalist approach was adopted for the cross-cultural adaptation, which highlights that every measurement instrument, when out of its original context, must consider the fact that the concepts can be different between countries.¹⁶16. Saturno PJ. Formação a distância em gestão da qualidade nos serviços de saúde: módulo VI: participação do usuario nos programas de gestão da qualidade: exploração e medição de necesidades, expectativas e satisfação: unidade temática 4: estudo piloto: métodos de validação. 2. ed. Murcia: Universidad de Murcia; 2008. Initially, the technical group assessed concepts and items, for which each member of the group gave a score from 1 to 5 (1 = totally disagree; 5 = totally agree), for each item of the survey and also for the survey as a whole. In this stage, the criterion adopted was the conceptual coherence of the instrument and the items with what was intended to be measured (content validity): safety culture and culture dimensions, according to the original survey. The criterion for items approval was the presentation of a median equal to 4 or 5 in the scores of the technical group. After this stage, a semantic review was conducted, by comparing the Portuguese translation draft of HSOPSC with other reference translations (Spanish,¹⁷17. Eiras M. Avaliação da cultura de segurança do doente em meio hospitalar: investigação ação numa unidade de radioterapia [tese]. Lisboa (Portugal): Universidade Nova de Lisboa; 2011. European Portuguese¹⁸18. Muthén LK, Muthén BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Modeling. 2009 Nov;9(4):599-620. and initial stage of the Brazilian Portuguese¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1313. Reis CT, Laguardia J, Vasconcelos AGG , Martins M. Realiability validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study. Cad Saude Publica, 2016 Nov;32(11) :e00115614), enabling the adaptation of the assessed version to the local language and terminology.

The computer program was developed using open access technology, with the following programming language: Java, PostgreSQL and Linux, and Play! Framework, a fast tool in the development of Internet applications. The fast development methodology chosen was XP (Extreme Programming), whose objective is to optimize the project development and ensure the client satisfaction. This methodology allows small and medium teams of software creators to develop objective and practical projects, from a focal point. Thus, the HSOPSC was adapted for online and offline collection and analysis, based on the proposals of data analysis of AHRQ, available at: www.ahrq.gov/professionals/quality-patient-safety/patientsafetyculture/hospital/index.html

The program developed is composed by two main modules, electronic survey and administrative system. The first module aims at data collection and enables the instrument to be sent to the e-mail of a previously registered participant, together with a presentation letter of the research and a model of the Free Informed Term of Consent to be signed. In this electronic survey, there is an extra tab with 10 indicator-questions related to good practices on patient safety, recommended by the NQF 2010.⁶6. National Quality Forum. Safe practices for healthcare - 2010 update: a consensus report. Washington: The National Quality Forum; 2010. The second module aims to evaluate the management of hospitals and professionals that are taking part in the research, tabulate the data and conduct descriptive analyses of the respondents’ characteristics.

Each form is recognized by a unique identifier, automatically and randomly generated by the system, known as access token. This technique enables the confidentiality over the identification of the professional respondent, not hampering the aggregate analysis for the hospital. During the survey filling, the system saves the inserted information, every minute, to ensure the storage of data in case of accidental system closure, blackout or problems on the device used (computer, tablet or smartphone).

After filling and submitting the first survey, the administrative system allows the researchers to view the statistical analysis of the answers in an informative panel with the percentage of answers, average time for filling, frequency of participants per profession, sex, and hospital service, among other professional characteristics. Tables and charts of indicators are built for the Percentage of Positive, Neutral and Negative Answers, in relation to the individual items, the dimensions of safety culture and the general survey. All the results are automatically generated, in real-time, for each hospital and for the total of hospitals assessed.

The computer program enables data to be exported to other softwares, to achieve a more detailed analysis, such as Excel, Statistical Package for the Social Sciences (SPSS) and Google Drive. The file with exported data is created in CSV (Comma Separated Values), a format adopted worldwide to export and integrate data between systems.

The assessment tool developed does not require Internet connection to answer the survey and saves answers in the device used. It needs connection only to send the answers to the administrative system, making the data collection in places with no Internet access easier. The software is of open access, free and is available, in Portuguese, for all hospitals interested, at Telessaúde/RN website: http://www.telessaude.ufrn.br/index.php/2013-11-04-22-58-23/seguranca-do-paciente

This research was developed in six hospitals that present different types of management: three federal public hospitals, two state public hospitals and one private hospital in Rio Grande do Norte State. Among the three federal public hospitals that participated, two are maternity wards and one is a general hospital. Only the maternity wards have emergency rooms (ER) and five hospitals have intensive care units (ICU) - except one of the maternity wards. Of the state hospitals, one is a reference center for infectious diseases and another one for trauma and emergency care, both with ER and ICU. The private facility is a general hospital with ER and ICU and is level 1, according to the National Commission on Accreditation.

The professionals that took part in the survey had high school or higher education degree, worked with health assistance, or hospital management, and had permanent or temporary working contracts. To ensure more reliable information from the hospitals and reduce the probability of including professionals with little knowledge on patient safety, all the substitute professionals were excluded from the study. Convenience sampling was chosen.

The sample size should be large enough to perform factor analysis. For this study there were approximately 20 cases for each item of the survey (42 items x 20 = 840 cases), which is recommended for the adequate statistical confirmatory factor analysis: approximately 140 cases for each one of the six hospitals.¹⁸18. Muthén LK, Muthén BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Modeling. 2009 Nov;9(4):599-620.

Initially, the data collection was conducted via e-mail. The human resources sectors from each hospital provided a list with the electronic addresses of the professionals of health assistance and management, who were active and had available e-mails. In each hospital, posters and memos were distributed into their units, aiming a wide dissemination of the research and gathering a high number of answers, in order to avoid selection bias related to lack of responses. Professionals who did not answer within 7, 10 and 15 days also received automatic reminders in their e-mails.

To increase the number of participants, we also collected data in person, using electronic devices (tablets and smartphones with operational system Android 4.0 or higher) with the self-administered survey available for the professionals. This stage extended the collection to professionals who did not use e-mails or did not answer the survey via e-mail.

Data were collected from January to March 2015, after a pilot-study with 215 participants.

The answers followed Likert scale from 1 to 5, covering the following options: strongly disagree; disagree; neither; agree; strongly agree; or never; rarely; sometimes; most of the time; and always. The scale was recoded and the percentage of specific positive answers - in the dimension or the item - was the main analysis indicator. The database analyses were automatically generated, by the specific software for databases analyses. In the case of reverse questions - formulated with negative clauses -, the answers for Likert scale from 1 to 5 were inverted.

The reliability of the tool was analyzed in an internal consistency study, through the calculation of Cronbach's alpha. This indicator measured the level that the translated items are related within each dimension of the safety culture and in the whole survey. That is, the higher the covariates and correlations are, the higher will be the consistency of measure in the same dimension or the concepts. Regarding the reliability of dimensions and of the full survey, Cronbach's alpha higher than 0.6 is considered as acceptable reliability, higher than 0.7, good reliability, and higher than 0.9, excellent.¹⁹19. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998 May;7(4):323-35.^,2020. Kline RB. Principles and practice of structural equation modeling. 3. ed. New York: The Guilford Press, 2011. p. 3-427.

The verification of concept validity and the analysis of the multidimensional model were conducted through confirmatory factor analysis. We used the model for structure equations to investigate the adjustment of the data observed to the dimension proposed by the HSOPSC.

The statistical package MPlus v.7 (Muthen & Muhthen) was used, with robust estimation method with weighted least squares adjusted for the average and variance (WLSMV). The analysis, thus, was based on the polychoric matrix used for ordinal data. The assessment measures of the fit used to verify the adequacy of the model to the data were (i) chi-square ratio/degree of freedom, (ii) root mean square error of approximation (RMSEA), (iii) comparative fit index (CFI) and (iv) Tucker-Lewis index (TLI). We considered good fit when the chi-square ratio/degree of freedom was <3.²¹21. Hair JR, William B, Babin B, Anderson RE. Análise multivariada de dados. 6.ed. Porto Alegre: Bookman; 2009.

For the RMSEA, in an ideal situation, the lower value of the 90% confidence interval (90%CI) includes or is close to zero, or is not worse than 0.05; and the higher value is lower than 0.08. In general, values lower than 0.08 are considered good, and values under 0.05, ideal. For CFI and TLI indexes, big adjustments are those over 0.90 and close to 0.95.²¹21. Hair JR, William B, Babin B, Anderson RE. Análise multivariada de dados. 6.ed. Porto Alegre: Bookman; 2009. Thus, the lower values of the 90%CI provide optimistic estimates for RMSEA value, whilst higher 90%CI values indicate pessimistic values.²¹21. Hair JR, William B, Babin B, Anderson RE. Análise multivariada de dados. 6.ed. Porto Alegre: Bookman; 2009.

This study project was approved by the Ethics Research Committee (CEP Central) of the Federal University of Rio Grande do Norte (UFRN), on April 26^th 2013. Report No. 261.289. All the institutions and individuals formally authorized their participation. The professionals’ names were not released, to ensure the anonymity of participants and get more reliable answers.

Results

A total of 863 respondents from the six hospitals participated, most of them were females: 77.2%. The majority of respondents worked on health assistance, and 84.7% of the participants had direct contact with patients. Among the participants, most were nursing professionals, especially nurse technicians (44.6%), and nurses (16.2%). These numbers reflect the higher proportions of those professionals in Brazilian hospitals. A small amount of the staff had been working for less than a year (5.7%). As two of the hospitals were maternity wards and the private hospital also has maternal-infant care, the most prevalent area/unit of work was obstetrics: 12.7% (Table 1).

The reliability of the tool, confirmed by Cronbach's alpha, was excellent, except for dimensions ‘Nonpunitive response to errors’ and ‘Staffing’. The internal consistency in three dimensions - ‘Overall perceptions of patient safety’, ‘Management support for patient safety’ and ‘Staffing’ - increased with the exclusion or change of one of the questions, but the first two already presented good reliability. For example, this latter dimension, ‘Staffing’, after the exclusion of the item ‘We use more temporary/agency staff than is best for patient care.’, was the only one that presented good internal consistency (Table 2).

The assessment measures of adjustments used to verify the adequacy to the model of data showed that the instrument is valid and adequate to the 12 dimensions, as proposed by the original HSOPSC, with chi-square ratio and degrees of freedom <3 (X²/gl=2.82; p-value<0.001). The RMSEA criterion reinforced that the model tested was good, since the p-value found was over 0.05, highlighting failure in refute the null hypothesis, supporting the model tested (estimate=0.046/90%CI=0.044;0.048; RMSEA probability ≤0.05=0.998). Two other tests also confirmed the adequacy of the multidimensional model, presenting values from 0.90 to 0.95 (CFI=0.944 and TLI=0.936).

The standard model shows that almost all the indicators - except the questions ‘We use more temporary/agency staff than is best for patient care’ and ‘Staff worry that mistakes they make are kept in their personnel file’ - presented factorial load over 0.40, showing weak indicators for their respective factors. However, as there are statistically significant factorial loads (p<0.05), they could be kept as indicators in the confirmatory factor analysis (Table 3). The tool also presented better psychometric properties than the first Brazilian version¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1313. Reis CT, Laguardia J, Vasconcelos AGG , Martins M. Realiability validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study. Cad Saude Publica, 2016 Nov;32(11) :e00115614 (Table 4).

Discussion

The translated and validated version of the HSOPSC presented good internal consistency and excellent reliability to measure the safety culture in Brazilian hospitals within different management systems. The electronic application enabled a practical data collection and analysis, and is available for all Brazilian hospitals.

The tool presented better psychometric properties than the first Brazilian version.¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1313. Reis CT, Laguardia J, Vasconcelos AGG , Martins M. Realiability validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study. Cad Saude Publica, 2016 Nov;32(11) :e00115614 This may be, in part, due to the improvement opportunities from the initial stage of translation,¹⁴14. Reis CT. A cultura de segurança do paciente: validação de um instrumento de mensuração para o contexto hospitalar brasileiro [tese]. Rio de Janeiro (RJ): Escola Nacional de Saúde Pública Sergio Arouca; 2013. which aimed to reduce ambiguities and improve terminology, resulting in a more clear text and similar with the original propose.¹⁵15. Gama ZAS, Batista AM, Silva IG, Souza RM, Freitas MR. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: oportunidades de melhoria. Cad Saude Publica. 2013 jul;29(7):1473-7. As examples of such improvements, we can cite the expression ‘events report’, which was replaced by ‘events notification’, aligned with the jargon of adverse events used in Brazil.²²22. Agência Nacional de Vigilância Sanitária. NOTIVISA: Sistema de Notificações em Vigilância Sanitária [Internet]. Brasília: Agência Nacional de Vigilância Sanitária; 2016 [citado 2017 fev 02]. Disponível em: Disponível em: http://www.anvisa.gov.br/hotsite/notivisa/index.htm
http://www.anvisa.gov.br/hotsite/notivis... The expression ‘report’ does not imply that the occurrence has been notified in data records, different from what is intended with organizational learning, through the investigation of causes and actions, with the objective of reducing health risk.

The reliability of the tool in general (for all the survey items) was excellent¹⁹19. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998 May;7(4):323-35.^,2020. Kline RB. Principles and practice of structural equation modeling. 3. ed. New York: The Guilford Press, 2011. p. 3-427. - Cronbach's alpha=0.92 - and slightly higher than the one found in other studies;¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1313. Reis CT, Laguardia J, Vasconcelos AGG , Martins M. Realiability validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study. Cad Saude Publica, 2016 Nov;32(11) :e00115614^,2323. Silva-Batalha EMS, Melleiro MM. Cultura de segurança do paciente em um hospital de ensino: diferenças de percepção existentes nos diferentes cenários dessa instituição. Texto Contexto Enferm. 2015 abr-jun;24(2):432-41. however, it is important to remember that this result is usually high when there is a higher number of items. About the dimensions with lower values on reliability (Cronbach's alpha), ‘Nonpunitive response to error’, ‘Communication openness’, and ‘Staffing’, we should take other factors possibly related into consideration. The first dimension aforementioned - ‘Nonpunitive response to error’ - also presents issues related to low reliability in other studies.¹⁷17. Eiras M. Avaliação da cultura de segurança do doente em meio hospitalar: investigação ação numa unidade de radioterapia [tese]. Lisboa (Portugal): Universidade Nova de Lisboa; 2011.^,2323. Silva-Batalha EMS, Melleiro MM. Cultura de segurança do paciente em um hospital de ensino: diferenças de percepção existentes nos diferentes cenários dessa instituição. Texto Contexto Enferm. 2015 abr-jun;24(2):432-41.

Concerning ‘Communication openness’, the value obtained may be related to the proposed translation or even to the culture variation, capable of interfering on the understanding of the questions; still, it is important to highlight that this dimension may be considered acceptable (approximately 0.60), within the classification parameter. Regarding ‘Staffing’, its low internal consistency is related to the item ‘We use more temporary/agency staff than is best for patient care’; after this latter was excluded, the dimension internal consistency reached an acceptable level, because in the analyzed hospital contexts, there were no temporary/agency workers that would fit into the inclusion criteria for the research.

Regarding the dimension ‘Nonpunitive response to error’, there are some important aspects to consider. This dimension was also little consistent (Cronbach's alpha <0.60) in the other Brazilian adaptation,¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210. which may show little applicability of the items for the Brazilian context. A reason for this finding may be found in the Brazilian punitive culture, which induces respondents to omit non-consistent answers in all three items of this dimension.

The concept analysis and per items, the semantic analysis by the specialists group, the translations proofreading¹²12. Reis CT, Laguardia J, Martins M. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: etapa inicial. Cad Saude Publica. 2012 nov; 28(11):2199-210.^,1515. Gama ZAS, Batista AM, Silva IG, Souza RM, Freitas MR. Adaptação transcultural da versão brasileira do Hospital Survey on Patient Safety Culture: oportunidades de melhoria. Cad Saude Publica. 2013 jul;29(7):1473-7.^,1717. Eiras M. Avaliação da cultura de segurança do doente em meio hospitalar: investigação ação numa unidade de radioterapia [tese]. Lisboa (Portugal): Universidade Nova de Lisboa; 2011. and the factor analysis conducted confirmed the multidimensional structure of the survey, leading to the consensus that if it was adapted to the national context, there would be impairments in the comparison with other studies. Other assessments conducted²⁴24. Pfeiffer Y, Manser T. Development of the German version of the Hospital Survey on Patient Safety Culture: dimensionality and psychometric properties. Saf Sci. 2010 Dec;48(10):1452-62.^,2525. Smits M, Christiaans-Dingelhoff I, Wagner C, Wal GV, Groenewegen PP. The psychometric properties of the ‘Hospital Survey on Patient Safety Culture’ in Dutch hospitals. BMC Health Serv Res. 2008 Nov; 8:230. showed that the design composed by 12 dimensions of the original instrument were not applicable to other countries’ realities. In the validation of this instrument in Holland,²⁵25. Smits M, Christiaans-Dingelhoff I, Wagner C, Wal GV, Groenewegen PP. The psychometric properties of the ‘Hospital Survey on Patient Safety Culture’ in Dutch hospitals. BMC Health Serv Res. 2008 Nov; 8:230. for example, the best adjusted model presented 11 dimensions. Another validation, conducted in Germany,²⁴24. Pfeiffer Y, Manser T. Development of the German version of the Hospital Survey on Patient Safety Culture: dimensionality and psychometric properties. Saf Sci. 2010 Dec;48(10):1452-62. also obtained a dimension structure smaller than the original: the German tool presented eight dimensions after adjustment. Therefore, when compared to other studies,²⁴24. Pfeiffer Y, Manser T. Development of the German version of the Hospital Survey on Patient Safety Culture: dimensionality and psychometric properties. Saf Sci. 2010 Dec;48(10):1452-62.^,2525. Smits M, Christiaans-Dingelhoff I, Wagner C, Wal GV, Groenewegen PP. The psychometric properties of the ‘Hospital Survey on Patient Safety Culture’ in Dutch hospitals. BMC Health Serv Res. 2008 Nov; 8:230. the validation proposed in this research is closer to the original, conducted by AHRQ.⁹9. Agency for Healthcare Research and Quality. Hospital Survey on Patient Safety Culture. Rockville: Agency for Healthcare Research and Quality; 2004.

The computer program developed for this study may help the collection and data analysis, reduce the application costs and enable the monitoring of patient safety culture in Brazilian hospitals. Notwithstanding, this study presented some limitations. One of them is a time limitation, given the dynamic characteristic of safety culture: it is possible that the items and questions considered valid now, may become obsolete with the development of safety culture in Brazilian hospitals. Another limitation is operational: some professionals who are not used to accessing their e-mails may not have answered the survey sent to them. The disadvantage of a low response rate of electronic surveys, compared to paper-based surveys, may be solved with data collection in person.²⁶26. Greenlaw CL, Brown-Welty S. A comparison of web-based and paper-based survey methods: testing assumptions of survey mode and response cost. Eval Rev. 2009 Oct;33(5):464-80. This type of collection, by mobile electronic devices, increases the response rate and does not hamper the efficacy of electronic collection and analysis.

We recommend health managers interested in using this assessment tool to, initially, confirm with their staff their electronic addresses. They should also provide electronic devices (computers, tablets, or smartphones) so the staff can fill in the survey in their workplace, to stimulate responses and to obtain information on the patient safety culture in the assessed hospital. The access to these data and the full diagnose about the safety culture of the assessed institution provide subsidies to intervention plans in the dimensions diagnosed with culture problems, improving the patient safety and the quality of the health care provided.

This study presents the Hospital Survey on Patient Safety Culture - HSOPSC - as a valid and reliable tool, with suitable psychometric properties for the assessment of patient safety culture in Brazilian hospitals. Regarding the feasibility of the survey, we recommend the data collection to be done by e-mail and, if necessary, in person too, to achieve a higher number of responses. It is important to highlight that the computer program developed by the proposed tool counts with an automatic analysis tool, which makes the data collection easier and helps hospital managers build reports, improving feedback to the staff and directors about their actions related to hospital patient safety culture.

References

Publication Dates

History