Abstract
This study aims to analyze studies that evaluated the performance of Primary Health Care (PHC) services by using the Primary Care Assessment Tool (PCATool) under a worldwide user perspective. This is a systematic review that implemented the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) model, from the following databases: Lilacs, Medline, SciELO, PubMed and the Coordination for the Improvement of Higher Education Personnel (CAPES) Journals Website, using descriptors Primary Care Assessment Tool and PCATool. Considering inclusion and exclusion criteria, we analyzed 22 research papers published from 2007 to 2015. The best-evaluated attributes were cultural competence, first contact use and longitudinality. On the other hand, the worst evaluated were first contact accessibility, family orientation, community orientation and comprehensiveness. Most of the health services evaluated were from Brazil, applied to “traditional” primary care clinic (UBS) and the Health Family Strategy (FHS). Services evaluated should strengthen structure and process components to achieve a better performance in PHC.
Primary care assessment tool; Primary Health Care; PCATool; Systematic review; Health evaluation
Introduction
In 1978, with the Alma-Ata International Conference11. Organização Pan-Americana da Saúde. Declaração de Alma-Ata. In: ConferênciaInternacional Sobre Cuidados Primários de Saúde;1978, Alma Ata., Primary Health Care (PHC) gains momentum as a strategy to be implemented in the operationalization of health services (HS) under ongoing health care that provides prevention, promotion, treatment and rehabilitation at affordable costs11. Organização Pan-Americana da Saúde. Declaração de Alma-Ata. In: ConferênciaInternacional Sobre Cuidados Primários de Saúde;1978, Alma Ata.
2. Organização Mundial da Saúde (OMS). Relatório mundial de saúde 2008: Atenção Primária em Saúde. Agora mais do que nunca. Genebra: OMS; 2008.
3. Fracolli LA, Gomes MFP, Nabão FRZ, Santos MS, Cappellini VK, Almeida ACC. Instrumentos de avaliação da Atenção Primária à saúde: revisão de literatura e metassíntese. Cien Saude Colet 2014; 19(12):4851-4860.-44. Mendes EV. Uma agenda para a saúde. São Paulo: Hucitec; 1996..
Based on the assumptions defined in Alma-Ata11. Organização Pan-Americana da Saúde. Declaração de Alma-Ata. In: ConferênciaInternacional Sobre Cuidados Primários de Saúde;1978, Alma Ata., Starfield55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002. codified PHC into four essential attributes and three derivatives, which qualify services as PHC and increase their interaction power with users and communities. The essential attributes are first contact access, access and use of HS whenever necessary; longitudinality, understood as a professional-subject-of-care temporal relationship, leading to the establishment of a strong mutual trust; coordination, understood as the integration of all the care that the user receives and needs with the other HS; comprehensiveness, represented by actions of promotion, prevention, treatment and rehabilitation appropriate to the PHC context, recognizing the biopsychosocial character of the health-disease-illness process66. Cotta RMM, Campos AOC, Mendonça EO, Costa GD, Machado JC, Silva LS, Siqueira RL, Leão RT, Reis RS. Políticas de saúde: desenhos, modelos e paradigmas. Viçosa: UFV, Abrasco; 2013.. Derivative attributes include family orientation, which is the knowledge of family factors that interfere in the health-disease-illness process by the health team, considering the family as the subject of care; community orientation, understood as the recognition of community health needs, guiding services for their benefit and, finally, cultural competence, which means adapting the HS to the cultural specificities of the community served55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002..
According to Fracolli et al.33. Fracolli LA, Gomes MFP, Nabão FRZ, Santos MS, Cappellini VK, Almeida ACC. Instrumentos de avaliação da Atenção Primária à saúde: revisão de literatura e metassíntese. Cien Saude Colet 2014; 19(12):4851-4860. and Ibanez et al.77. Ibañez N, Rocha JSY, Castro PC, Ribeiro MCSA, Forster AC, Novaes MHD, Viana ALd’A. Avaliação do desempenho da atenção básica no Estado de São Paulo. Cien Saude Colet 2006; 11(3):683-703., due to the lack of research to evaluate the performance of PHC, the Primary Care Assessment Tool (PCATool)88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.,99. Cassady CE, Starfield B, Hurtado MP, Berk R, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt 2):998-1003. was based on Donabedian1010. Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748. theory on the evaluation quality of HS structure, process and results.
The publicly-owned instrument implemented by the World Health Organization (WHO) consists of a structured questionnaire that empirically measures the essential PHC attributes and derivatives through the evaluation of users88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.,99. Cassady CE, Starfield B, Hurtado MP, Berk R, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt 2):998-1003., managers and health professionals1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil)., which has been adapted and validated in different countries, namely, Brazil1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil).,1212. Almeida C, Macinko J. Validação de uma metodologia de avaliação rápida das características organizacionais e do desempenho dos serviços de atenção básica do Sistema Único de Saúde (SUS) em nível local. Brasília: Organização Pan-Americana da Saúde (OPAS); 2006. (Série técnica desenvolvimento de sistemas e serviços de saúde)., South Korea1313. Lee JHO, Choi YJ, Sung NJ, Kim SY, Chung SH, Kim J, Jeon TH, Park K. Development of the Korean primary care assessment tool - measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care 2009; 21(2):103-111. and Catalonia-Spain1414. Berra S, Rocha KB, Rodríguez-Sanz M, Pasarín I, Rajmil L, Borrell C, Starfield B. Properties of a short questionnaire for assessing primary care experiences for children in a population survey. BMC Public Health 2011; 11:285..
According to Donabedian1010. Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748., the quality component of the structure corresponds to the characteristics of the service; the process refers to actions by health professionals and populations; and results reflect the health status achieved. Regarding the PCATool88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.,99. Cassady CE, Starfield B, Hurtado MP, Berk R, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt 2):998-1003. instrument, the attributes enable the evaluation of services’ structure and process. Longitudinality and coordination attributes involve both structure and process characteristics, while the structure aspect of services is strongly linked to the first contact access/sub-item accessibility and comprehensiveness/sub-item available services, whereas the process category is more involved in first contact access/sub-item use and comprehensiveness/sub-item services provided55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002..
To this end, this study aims to analyze the performance of PHC services worldwide, through studies available in the national and international literature in relation to the attributes originally proposed by Starfield55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002. in the PCATool instrument.
Methods
This is a systematic review built on the recommendations proposed in the Guide Preferred Reporting Items for Systematic Reviews and Meta-Analyzes - PRISMA1515. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009; 339:b2535., based on studies that used the PCATool instrument to evaluate SH’s performance.
The PCATool appears as a questionnaire divided into sections by evaluated attribute, which are divided into essential attributes and their sub-items: first contact access, with sub-items accessibility and use; longitudinality; coordination, with sub-items integrated care and information system; and comprehensiveness, with sub-items available services and services provided.
The identification and selection of studies occurred from June to October 2015, independently by two trained researchers, through the guiding question: “Which studies evaluated the performance of PHC services worldwide using the PCATool instrument, from the user’s perspective?”
The main health databases consulted were the Latin American and Caribbean Health Sciences Literature (LILACS), Medical Literature Analysis and Retrieval System Online (MEDLINE), CAPES Journals Website, Scientific Electronic Library Online (SciELO), PubMed (US National Library of Medicine National Institutes of Health). The Pan American Health Organization (PAHO) and WHO databases were also included. Descriptors used in the search were “primary care assessment tool” and “PCATool” and in their Spanish and Portuguese versions.
Secondary data qualitative papers were excluded from the study whose evaluated users were tuberculosis patients, since in order to cover this condition, the PCATool instrument underwent considerable adaptations, theses, manuals, editorials and studies that exclusively evaluated professionals and managers. The inclusion criteria were original studies that applied the PCATool to target users, which evidenced defined performance classification criteria, i.e. a cut-off point from which the evaluated service could be classified as adequate to PHC principles.
In total, 466 papers were identified, of which 311 were excluded due to duplication within and between the databases, leaving out 155 papers, which were analyzed. Then, applying the exclusion criteria, 83 studies were fully analyzed. In the end, applying the inclusion criteria, we analyzed 22 original papers that implemented the PCATool to users which included, at least, an essential or derivative attribute in the instrument and that defined a minimum value for the performance of the evaluated PHC services.
Regarding the services’ performance assessment, studies evaluated used different methods, and 19 studies used the Likert-type scale with an adjusted score from zero to ten. Of these, one paper1616. Araújo LUA, Gama ZAS, Nascimento FLA, Oliveira HFV, Azevedo WM, Almeida Júnior HJB. Avaliação da qualidade da atenção primária à saúde sob a perspectiva do idoso. Cien Saude Colet 2014; 19(8):3521-3532. considered satisfactory performance values above 7.0; 11 papers1717. Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.
18. Araújo JP, Viera CS, Toso BRGO, Collet N, Nassar PO. Avaliação dos atributos de orientação familiar e comunitária na saúde da criança. Acta Paul Enferm 2014; 27(5):440-446.
19. Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618.
20. Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Silva MGC. Avaliação do atributo coordenação da Atenção Primária à Saúde: aplicação do PCATool a profissionais e usuários. Saúde Debate 2014; 38(n. esp.):279-295.
21. Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605.
22. Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046.
23. Leão CDA, Caldeira AP, Oliveira MMC. Atributos da atenção primária na assistência à saúde da criança: avaliação dos cuidadores. Rev. Bras. Saúde Matern. Infant 2011; 11(3):323-334.
24. Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559.
25. Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.
26. Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36.
27. Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331.
28. Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.-2929. Silva AS, Fracolli LA. Avaliação da Estratégia Saúde da Família: perspectiva dos usuários em Minas Gerais, Brasil. Saúde Debate 2014; 38(103):692-705., values equal to or above 6.6; one paper2727. Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331., values above 4 and 6 papers1919. Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618.,3030. Furtado MCC, Braz JC, Pina JC, Mello DF, Lima RAG. A avaliação da atenção à saúde de crianças com menos de um ano de idade na Atenção Primária. Rev. Latino-Am. Enfermagem 2013, 21(2):554-561.
31. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.
32. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123.
33. Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT):the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care 2011;19(2):85-103.-3434. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282., values above 3.0. Another 3 papers adjusted the Likert scale from 0 to 100, and 2 studies3535. Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499.,3636. Wang HHX, Wong SYS, Wong MCS, Wang JJ, Wei JL, Li DKT, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2014; 108(7):549-560. evaluated the performance of services according to the percentile achieved by the attribute and one study3737. Pereira MJB, Abrahão-Curvo P, Fortuna CM, Coutinho SS, Queluz MC, Campos LVO, Fermino TZ, Santos CB. Avaliação das características organizacionais e de desempenho de uma unidade de Atenção Básica à Saúde. Rev Gaúcha Enferm 2011; 32(1):48-55. classified values of 50% or greater as satisfactory. In this study, as a form of standardization, attributes related to the performance of services were classified as adequate and inadequate, according to the papers evaluated.
Results
Chart 1 lists 22 studies published between 2007 and 2015, of which 15 (68.20%) are Brazilian1616. Araújo LUA, Gama ZAS, Nascimento FLA, Oliveira HFV, Azevedo WM, Almeida Júnior HJB. Avaliação da qualidade da atenção primária à saúde sob a perspectiva do idoso. Cien Saude Colet 2014; 19(8):3521-3532.
17. Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.-1818. Araújo JP, Viera CS, Toso BRGO, Collet N, Nassar PO. Avaliação dos atributos de orientação familiar e comunitária na saúde da criança. Acta Paul Enferm 2014; 27(5):440-446.,2020. Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Silva MGC. Avaliação do atributo coordenação da Atenção Primária à Saúde: aplicação do PCATool a profissionais e usuários. Saúde Debate 2014; 38(n. esp.):279-295.
21. Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605.
22. Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046.
23. Leão CDA, Caldeira AP, Oliveira MMC. Atributos da atenção primária na assistência à saúde da criança: avaliação dos cuidadores. Rev. Bras. Saúde Matern. Infant 2011; 11(3):323-334.
24. Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559.
25. Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.
26. Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36.
27. Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331.
28. Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.
29. Silva AS, Fracolli LA. Avaliação da Estratégia Saúde da Família: perspectiva dos usuários em Minas Gerais, Brasil. Saúde Debate 2014; 38(103):692-705.-3030. Furtado MCC, Braz JC, Pina JC, Mello DF, Lima RAG. A avaliação da atenção à saúde de crianças com menos de um ano de idade na Atenção Primária. Rev. Latino-Am. Enfermagem 2013, 21(2):554-561.,3737. Pereira MJB, Abrahão-Curvo P, Fortuna CM, Coutinho SS, Queluz MC, Campos LVO, Fermino TZ, Santos CB. Avaliação das características organizacionais e de desempenho de uma unidade de Atenção Básica à Saúde. Rev Gaúcha Enferm 2011; 32(1):48-55. , 3 (13.63%) are Canadian3131. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.,3232. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123.,3434. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282., 2 (9,09%) Korean3333. Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT):the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care 2011;19(2):85-103.,3535. Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499., one (4,54%) is Spanish1919. Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618. and one (4,54%) Chinese3636. Wang HHX, Wong SYS, Wong MCS, Wang JJ, Wei JL, Li DKT, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2014; 108(7):549-560.. Only one (4.54%) study was implemented in two stages, before the health reform in Quebec and then3434. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282., all the others were applied in a single stage. Four (18.2%) studies were applied in different PHC services to compare them to each other2121. Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605.,2626. Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36.,2828. Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.,3535. Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499..
Regarding the studied population, 8 (36.36%) studies addressed only the child user population1717. Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.
18. Araújo JP, Viera CS, Toso BRGO, Collet N, Nassar PO. Avaliação dos atributos de orientação familiar e comunitária na saúde da criança. Acta Paul Enferm 2014; 27(5):440-446.-1919. Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618.,2222. Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046.,2323. Leão CDA, Caldeira AP, Oliveira MMC. Atributos da atenção primária na assistência à saúde da criança: avaliação dos cuidadores. Rev. Bras. Saúde Matern. Infant 2011; 11(3):323-334.,2525. Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.,2626. Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36.,3030. Furtado MCC, Braz JC, Pina JC, Mello DF, Lima RAG. A avaliação da atenção à saúde de crianças com menos de um ano de idade na Atenção Primária. Rev. Latino-Am. Enfermagem 2013, 21(2):554-561., through the application of PCATool to caregivers, 6 (27.27%) papers covered the adult population2020. Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Silva MGC. Avaliação do atributo coordenação da Atenção Primária à Saúde: aplicação do PCATool a profissionais e usuários. Saúde Debate 2014; 38(n. esp.):279-295.,2828. Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.,2929. Silva AS, Fracolli LA. Avaliação da Estratégia Saúde da Família: perspectiva dos usuários em Minas Gerais, Brasil. Saúde Debate 2014; 38(103):692-705.,3333. Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT):the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care 2011;19(2):85-103.,3434. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282.,3636. Wang HHX, Wong SYS, Wong MCS, Wang JJ, Wei JL, Li DKT, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2014; 108(7):549-560., 5 (22,73%) evaluated services in the adult and child population2727. Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331.,3131. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.,3232. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123.,3535. Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499.,3737. Pereira MJB, Abrahão-Curvo P, Fortuna CM, Coutinho SS, Queluz MC, Campos LVO, Fermino TZ, Santos CB. Avaliação das características organizacionais e de desempenho de uma unidade de Atenção Básica à Saúde. Rev Gaúcha Enferm 2011; 32(1):48-55., 2 (9,1%) targeted the elderly population1616. Araújo LUA, Gama ZAS, Nascimento FLA, Oliveira HFV, Azevedo WM, Almeida Júnior HJB. Avaliação da qualidade da atenção primária à saúde sob a perspectiva do idoso. Cien Saude Colet 2014; 19(8):3521-3532.,2121. Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605. and 1 (4.54%) focused on adult women as the research subject2424. Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559..
Regarding the type of services evaluated, eight studies exclusively evaluated Family Health Strategy (FHS)1616. Araújo LUA, Gama ZAS, Nascimento FLA, Oliveira HFV, Azevedo WM, Almeida Júnior HJB. Avaliação da qualidade da atenção primária à saúde sob a perspectiva do idoso. Cien Saude Colet 2014; 19(8):3521-3532.,1717. Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.,2020. Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Silva MGC. Avaliação do atributo coordenação da Atenção Primária à Saúde: aplicação do PCATool a profissionais e usuários. Saúde Debate 2014; 38(n. esp.):279-295.,2424. Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559.,2525. Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.,2727. Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331.,2929. Silva AS, Fracolli LA. Avaliação da Estratégia Saúde da Família: perspectiva dos usuários em Minas Gerais, Brasil. Saúde Debate 2014; 38(103):692-705.,3030. Furtado MCC, Braz JC, Pina JC, Mello DF, Lima RAG. A avaliação da atenção à saúde de crianças com menos de um ano de idade na Atenção Primária. Rev. Latino-Am. Enfermagem 2013, 21(2):554-561., one exclusively addressed “traditional” primary care clinic (UBS)3737. Pereira MJB, Abrahão-Curvo P, Fortuna CM, Coutinho SS, Queluz MC, Campos LVO, Fermino TZ, Santos CB. Avaliação das características organizacionais e de desempenho de uma unidade de Atenção Básica à Saúde. Rev Gaúcha Enferm 2011; 32(1):48-55., two jointly evaluated FHS and UBS1818. Araújo JP, Viera CS, Toso BRGO, Collet N, Nassar PO. Avaliação dos atributos de orientação familiar e comunitária na saúde da criança. Acta Paul Enferm 2014; 27(5):440-446.,2222. Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046., two evaluated comparatively FHS versus UBS2121. Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605.,2626. Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36., two evaluated FHS in comparison with other PHC services (Health Center and Community Health Worker Program - PACS)2323. Leão CDA, Caldeira AP, Oliveira MMC. Atributos da atenção primária na assistência à saúde da criança: avaliação dos cuidadores. Rev. Bras. Saúde Matern. Infant 2011; 11(3):323-334.,2828. Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.. In relation to Canadian studies, one evaluated only the services provided by the Family Medicine Group3434. Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282. and two evaluated several PHC services: Group practice, Solo practice, Stand-alone walk-in clinic and Community Health Centers (CHCs)3131. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.,3232. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123.. With regard to Korean studies, one evaluated services from CHCs and private clinics offering general practice, general surgery, family medicine, gynecology and obstetrics services3333. Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT):the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care 2011;19(2):85-103. and the other evaluated PHC services in private clinics, school hospitals, public health centers and clinical cooperatives3535. Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499.. One Chinese study evaluated only CHCs3636. Wang HHX, Wong SYS, Wong MCS, Wang JJ, Wei JL, Li DKT, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2014; 108(7):549-560. and the Spanish study assessed the Catalan population ascribed to Arees Integrals de Salut1919. Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618.. Two studies jointly evaluated urban and rural population3131. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.,3232. Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123., and one study exclusively evaluated the rural population2525. Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.(Table 2).
The most evaluated attributes were longitudinality (24), first contact access/sub-item accessibility (19), community orientation (18) and family orientation (15). The least evaluated were cultural competence (2) and comprehensiveness (7).
Regarding the performance of services, derivative attribute cultural competence achieved the highest percentage of adequate performance (100%); first contact access attribute showed a low adequate performance (33.33%), as well as its sub-item accessibility (15.78%), while sub-item use showed a high adequate performance (71.42%); essential attribute longitudinality showed an adequate performance (62.50%); attribute coordination showed a lower performance than its sub-item integrated care (35.71% and 54.54%, respectively); finally, attribute comprehensiveness showed a lower performance than its sub-item services provided (50%) and higher performance than its sub-item available services (25%).
Discussion
The PCATool instrument is recent in the evaluation of PHC services, which justifies the publication period of the studies found (2007 and 2015). Its first version was shown in 2000 to evaluate services provided to the child user99. Cassady CE, Starfield B, Hurtado MP, Berk R, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt 2):998-1003., followed by the mirrors instruments for the evaluation of services by adult users88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175., by professionals and by health service providers1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil).. In Brazil, the original version of the instrument was adapted and validated for existing PHC services in the country by Almeida and Macinko1212. Almeida C, Macinko J. Validação de uma metodologia de avaliação rápida das características organizacionais e do desempenho dos serviços de atenção básica do Sistema Único de Saúde (SUS) em nível local. Brasília: Organização Pan-Americana da Saúde (OPAS); 2006. (Série técnica desenvolvimento de sistemas e serviços de saúde)., conducted in the city of Petrópolis, and by Harzheim et al., applied to PHC services in Porto Alegre, Rio Grande do Sul.
This study evidenced that most of the studies listed were performed in Brazil. This is due to the following reasons: a) in 2010, the Ministry of Health launched/introduced the PHC Evaluation Instrument Manual (PCATool-BR)1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil)., an adaptation of the original instrument made by Harzheim et al.39 for the evaluation of PHC services from the perspective of adult and child users, health professionals and managers; b) in the manual, the Ministry of Health recommends that the instrument be used for the evaluation and monitoring of PHC quality as a routine of the Family Health teams, at various levels of management and for academic use; c) Brazil, as well as Canada, which presented the second largest representation in the sample, have PHC-oriented health systems. Thus, an instrument for evaluating the performance of health services is very useful in feeding and feeding back policies geared to the sector33. Fracolli LA, Gomes MFP, Nabão FRZ, Santos MS, Cappellini VK, Almeida ACC. Instrumentos de avaliação da Atenção Primária à saúde: revisão de literatura e metassíntese. Cien Saude Colet 2014; 19(12):4851-4860..
In relation to the evaluation of attributes, cultural competence had the best performance, however, it appeared only twice in the papers analyzed, which does not allow us to infer that this attribute is strongly incorporated in PHC services. One of the factors that may explain the low frequency found may be the non-inclusion of this attribute in the PCATool-BR1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil). instrument, although it is included in the original version for the assessment of adults88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175. and its evaluation encouraged in later publications55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002..
The first contact access attribute and its sub-item accessibility had poor performance, both making up part of the evaluation of HS structure according to the Donabedian model55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002.,1010. Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748.. The low performance found may reflect geographical and organizational barriers to PHC services, such as reduced facility working hours, difficulties faced in scheduling appointments, and waiting time at the facility in order to be serviced. This low percentage impairs individual comprehensive health care, since, when faced with access barriers, health care tends to be postponed, hampering the impact of possible prevention actions, incurring future additional expenses55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002.. However, first contact access attribute’s sub-item use, corresponding to Donabedian1010. Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748. process category, had a high performance, suggesting that the user seeks health services whenever necessary1111. Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde. Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil)., before visiting a service of greater specialization22. Organização Mundial da Saúde (OMS). Relatório mundial de saúde 2008: Atenção Primária em Saúde. Agora mais do que nunca. Genebra: OMS; 2008.,55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002.. Thus, its high performance may indicate that, while there are structural hurdles in accessing the evaluated services, users recognize PHC services as their primary source of health care.
The longitudinality attribute, belonging to process category1010. Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748., had the third best evaluation in this review. Longitudinality is not an exclusive PHC attribute, but is essential to it. It develops insofar as users identify the location or provider of PHC services as their usual source of health care55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002.. In this respect, the definition of an ascribed population, a PHC44. Mendes EV. Uma agenda para a saúde. São Paulo: Hucitec; 1996. characteristic, and the universal access to healthcare in Brazil through expanded FHS2424. Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559.can be variables that explain the good performance found.
The essential attribute coordination and its sub-items integrated care and information system had low adequate performance. To achieve a satisfactory coordination, PHC and subspecialty care must be closely linked through appropriate communication and a strengthened referral and counter-referral system. The low performance of the attribute may show flaws in this interrelationship, which evidences the need for greater integrated and articulated PHC in the HS44. Mendes EV. Uma agenda para a saúde. São Paulo: Hucitec; 1996..
In the same perspective, the essential attribute comprehensiveness and its sub-item available services had inadequate performance, below sub-item services provided. The low performance found can show the critical difficulty of assessed HS in PHC in offering a complete range of individual health-related needs and in making available the resources needed to include them55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002.. Comprehensiveness requires different levels of complexity in health promotion, prevention, recovery and rehabilitation services66. Cotta RMM, Campos AOC, Mendonça EO, Costa GD, Machado JC, Silva LS, Siqueira RL, Leão RT, Reis RS. Políticas de saúde: desenhos, modelos e paradigmas. Viçosa: UFV, Abrasco; 2013.,2222. Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046. from health counseling to small surgeries88. Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.. The good performance of comprehensiveness demands constant investments in physical, material and human resources, which requires assigning to PHC its real significance and not to be characterized as a service of low complexity and requiring low investment44. Mendes EV. Uma agenda para a saúde. São Paulo: Hucitec; 1996.. However, comprehensiveness sub-item services provided had a better performance, evidencing a greater capacity of the facility to provide services well rather than to supply a greater variety of these services.
With the exception of cultural competence, the attributes community orientation and family orientation evidenced the worst performance rates of the entire study. According to Starfield55. Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília: Unesco, Ministério da Saúde; 2002., a high level of achievement of the exclusive and fundamental qualities of PHC results in these three derivative attributes. The low performance achieved by family orientation and community orientation may be associated with a difficulty in PHC services evaluated to provide comprehensive care geared to family and community, being still far from the of Social Production of Health model66. Cotta RMM, Campos AOC, Mendonça EO, Costa GD, Machado JC, Silva LS, Siqueira RL, Leão RT, Reis RS. Políticas de saúde: desenhos, modelos e paradigmas. Viçosa: UFV, Abrasco; 2013..
However, some limitations should be pointed out: the difficulty of finding studies that presented a defined and standardized classification of adequate performance of PHC services; studies that evaluated, in a limited way, only some attributes; the non-homogeneity of PHC services; the limitations of the PCATool itself, considering that all the attributes showed the same weight in the orientation of PHC services, as well as, the conception that the quality of PHC services are included in the attributes of the instrument.
Conclusion
This review shows an overview of the performance of PHC services worldwide based on studies that have used PCATool as an assessment tool. We found that some attributes of assessed PHC services – cultural competence, service use and longitudinality – were well evaluated. However, other attributes – first contact access, first contact access/accessibility, comprehensiveness, family orientation and community orientation – evidenced weaknesses. It was observed that most of the evaluated services are Brazilian and represented by UBS and FHS, whose performance still requires improvement. Therefore, considering the PHC model addressed in the PCATool, the need to strengthen the process and structure components for better PHC performance is highlighted.
Acknowledgment
This work was performed with the support of the Coordination for the Improvement of Higher Education Personnel (CAPES), a Brazilian Government body geared to the training of human resources.
References
- 1Organização Pan-Americana da Saúde. Declaração de Alma-Ata. In: ConferênciaInternacional Sobre Cuidados Primários de Saúde;1978, Alma Ata.
- 2Organização Mundial da Saúde (OMS). Relatório mundial de saúde 2008: Atenção Primária em Saúde. Agora mais do que nunca. Genebra: OMS; 2008.
- 3Fracolli LA, Gomes MFP, Nabão FRZ, Santos MS, Cappellini VK, Almeida ACC. Instrumentos de avaliação da Atenção Primária à saúde: revisão de literatura e metassíntese. Cien Saude Colet 2014; 19(12):4851-4860.
- 4Mendes EV. Uma agenda para a saúde São Paulo: Hucitec; 1996.
- 5Starfield B. Atenção Primária: equilíbrio entre necessidades de saúde, serviços e tecnologia Brasília: Unesco, Ministério da Saúde; 2002.
- 6Cotta RMM, Campos AOC, Mendonça EO, Costa GD, Machado JC, Silva LS, Siqueira RL, Leão RT, Reis RS. Políticas de saúde: desenhos, modelos e paradigmas. Viçosa: UFV, Abrasco; 2013.
- 7Ibañez N, Rocha JSY, Castro PC, Ribeiro MCSA, Forster AC, Novaes MHD, Viana ALd’A. Avaliação do desempenho da atenção básica no Estado de São Paulo. Cien Saude Colet 2006; 11(3):683-703.
- 8Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.
- 9Cassady CE, Starfield B, Hurtado MP, Berk R, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4 Pt 2):998-1003.
- 10Donabedian A. The quality of care: How can it be assessed? JAMA 1988; 260(12):1743-1748.
- 11Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde Brasilia: MS; 2008. (Primary Care Assessment Tool. PCATool-Brasil).
- 12Almeida C, Macinko J. Validação de uma metodologia de avaliação rápida das características organizacionais e do desempenho dos serviços de atenção básica do Sistema Único de Saúde (SUS) em nível local Brasília: Organização Pan-Americana da Saúde (OPAS); 2006. (Série técnica desenvolvimento de sistemas e serviços de saúde).
- 13Lee JHO, Choi YJ, Sung NJ, Kim SY, Chung SH, Kim J, Jeon TH, Park K. Development of the Korean primary care assessment tool - measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care 2009; 21(2):103-111.
- 14Berra S, Rocha KB, Rodríguez-Sanz M, Pasarín I, Rajmil L, Borrell C, Starfield B. Properties of a short questionnaire for assessing primary care experiences for children in a population survey. BMC Public Health 2011; 11:285.
- 15Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009; 339:b2535.
- 16Araújo LUA, Gama ZAS, Nascimento FLA, Oliveira HFV, Azevedo WM, Almeida Júnior HJB. Avaliação da qualidade da atenção primária à saúde sob a perspectiva do idoso. Cien Saude Colet 2014; 19(8):3521-3532.
- 17Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.
- 18Araújo JP, Viera CS, Toso BRGO, Collet N, Nassar PO. Avaliação dos atributos de orientação familiar e comunitária na saúde da criança. Acta Paul Enferm 2014; 27(5):440-446.
- 19Berra S, Rodríguez-Sanz M, Rajmil L, Pasarín MI, Borrell C. Experiences with primary care associated to health, socio-demographics and use of services in children and adolescentes. Cad Saude Publica 2014; 30(12):2607-2618.
- 20Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Silva MGC. Avaliação do atributo coordenação da Atenção Primária à Saúde: aplicação do PCATool a profissionais e usuários. Saúde Debate 2014; 38(n. esp.):279-295.
- 21Carvalho VCHS, Rossato SL, Fuchs FD, Harzheim, Fuchs SC. Assessment of primary health care received by the elderly and health related quality of life: a cross-sectional study. BMC Public Health 2013, 13:605.
- 22Mesquita-Filho M, Luz BSR, Araújo CS. A Atenção Primária à Saúde e seus atributos: a situação das crianças menores de dois anos segundo suas cuidadoras. Cien Saude Colet 2014; 19(7):2033-2046.
- 23Leão CDA, Caldeira AP, Oliveira MMC. Atributos da atenção primária na assistência à saúde da criança: avaliação dos cuidadores. Rev. Bras. Saúde Matern. Infant 2011; 11(3):323-334.
- 24Lima EFA, Sousa AI, Primo CC. Avaliação dos atributos da atenção primária na perspectiva das usuárias que vivenciam o cuidado. Rev. Latino-Am. Enfermagem 2015; 23(3):559-559.
- 25Marques AS, Freitas DA, Leão CDA, Oliveira SKM, Pereira MM, Caldeira AP. Atenção Primária e saúde materno-infantil: a percepção de cuidadores em uma comunidade rural quilombola. Cien Saude Colet 2014; 19(2):365-371.
- 26Oliveira VBCA, Veríssimo MLOR. Assistência à saúde da criança segundo suas famílias: comparação entre modelos de atenção primária. Rev Esc Enferm USP 2015; 49(1):30-36.
- 27Reis RS, Coimbra LC, Silva AAM, Santos AM, Britto e Alves MTSS, Lamy ZC, Ribeiro SVO, Dias MAS, Silva RA. Acesso e utilização dos serviços na Estratégia Saúde da Família na perspectiva dos gestores, profissionais e usuários. Cien Saude Colet 2013; 18(11):3321-3331.
- 28Silva OCS, Fonseca ADG, Souza e Souza LP, Siqueira LG, Belasco AGS, Barbosa DA. Integralidade e Atenção Primária à Saúde: avaliação sob a ótica dos usuários. Cien Saude Colet 2014; 19(11):4407-4415.
- 29Silva AS, Fracolli LA. Avaliação da Estratégia Saúde da Família: perspectiva dos usuários em Minas Gerais, Brasil. Saúde Debate 2014; 38(103):692-705.
- 30Furtado MCC, Braz JC, Pina JC, Mello DF, Lima RAG. A avaliação da atenção à saúde de crianças com menos de um ano de idade na Atenção Primária. Rev. Latino-Am. Enfermagem 2013, 21(2):554-561.
- 31Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Room for improvement: Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007; 53(6):1056-1057.
- 32Haggerty JL, Pineault R, Beaulieu MD, Brunelle Y, Gauthier J, Goulet F, Rodrigue J. Practice features associated with patient reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008, 6(2):116-123.
- 33Jeon KY. Cross-cultural adaptation of the US consumer form of the short Primary Care Assessment Tool (PCAT):the Korean consumer form of the short PCAT (KC PCAT) and the Korean standard form of the short PCAT (KS PCAT). Qual Prim Care 2011;19(2):85-103.
- 34Tourigny A, Aubin M, Haggerty J, Bonin L, Morin D, Reinharz D, Leduc Y, St-Pierre M, Houle N, Giguère A, Benounissa Z, Carmichael PH. Patients’ perceptions of the quality of care after primary care reform: Family medicine groups in Quebec. Can Fam Physician 2010; 56(7):273-282.
- 35Sung NJ, Suh SY, Lee DW, Ahn HP, Choi YJ, Lee JH. Patient’s assessment of primar y care of medical institutions in South Korea by structural type. Int J Qual Health Care 2010; 22(6):493-499.
- 36Wang HHX, Wong SYS, Wong MCS, Wang JJ, Wei JL, Li DKT, Tang JL, Griffiths SM. Attributes of primary care in community health centres in China and implications for equitable care: a cross-sectional measurement of patients’ experiences. QJM 2014; 108(7):549-560.
- 37Pereira MJB, Abrahão-Curvo P, Fortuna CM, Coutinho SS, Queluz MC, Campos LVO, Fermino TZ, Santos CB. Avaliação das características organizacionais e de desempenho de uma unidade de Atenção Básica à Saúde. Rev Gaúcha Enferm 2011; 32(1):48-55.
Publication Dates
- Publication in this collection
June 2017
History
- Received
28 Dec 2015 - Reviewed
19 July 2016 - Accepted
21 July 2016