ABSTRACT

The study aimed to identify available instruments in the literature to evaluate the structure of primary health network in health systems. An integrated review of literature was carried out in health sciences, education, and management Databases, as follows: Medical Literature Analysis and Retrieval System Online (Medline), including the Cochrane Library, Embase, PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), ABI Inform, Latin American and Caribbean on Health Sciences Literature (Lilacs), and the Business Source Complete (Ebsco). Manuscripts published in English and Portuguese from 1995 to 2019 were included. The final sample contained nine articles, in which eight instruments were identified. They had as a common feature the approach on longitudinality, interprofessional communication, care coordination, access to health services, and quality of care. An emphasis was noted on an instrument developed in the Brazilian health system context as a useful tool to support health care workers and managers in the situational diagnosis of potentialities and fragilities of Primary Health Care and Health Care Networks.

KEYWORDS
Health evaluation; Surveys and questionnaires; Primary Health Care

Introduction

The integration of health systems has been considered an essential component for transformation of practices and qualification of care, being obtained with well-structured primary care and with integrated networks of service provision¹1 Suter E, Oelke ND, Lima MADS, et al. Indicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis. Int J Integr Care. 2017; 17(6):4,1-17.. The existence of a structured primary care network, assuming responsibility for a registered population, has been considered as an indicator of the principle of integration of health systems relating to geographical coverage, which aims at maximizing patient accessibility and minimizing duplication of service utilization²2 Oelke ND, Suter E, Lima MADS, et al. Indicators and measurement tools for health system integration: a knowledge synthesis protocol. Syst Ver [internet]. 2015. [acesso em 2019 nov 12]; 4(99):1-8. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4518647/pdf/13643_2015_Article_90.pdf.
https://www.ncbi.nlm.nih.gov/pmc/article... .

The proposal of integrated systems is presented as an alternative to hegemonic models, as it seeks to overcome the fragmentation of care, acting in an articulated manner in response to the needs of the population through the coordination of care. Its modeling in regionalized care networks, with defined population and territory, aims to guarantee a comprehensive health supply, with increased access and greater efficiency and quality in care, through relationships and flows established between health services at different levels of health system. The strengthening of Primary Health Care (PHC) has been pointed out as an important measure for the coordination of care and organization of health systems, establishing it in the position of care coordinator and care network organizer³3 Almeida PF, Medina MG, Fausto MCR, et al. Coordenação do cuidado e Atenção Primária à Saúde no Sistema Único de Saúde. Saúde debate [internet]. 2018 [acesso em 2019 nov 12]; 42(esp1):244-260. Disponível em: http://www.scielo.br/pdf/sdeb/v42nspe1/0103-1104-sdeb-42-spe01-0244.pdf.
http://www.scielo.br/pdf/sdeb/v42nspe1/0... .

Many health systems have set goals that focus on comprehensive health care; and, despite broad support for integration, there is few information on how to achieve successful integration in different contexts and how to evaluate performance towards an integrated system⁴4 Mounier-Jack S, Mayhew SH, Mays N. Integrated care: learning between high-income, and low- and middle-income country health systems. Health Policy Plan [internet]. 2017 [acesso em 2019 nov 12]; 32(supl4):iv6-iv12. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5886259/pdf/czx039.pdf.
https://www.ncbi.nlm.nih.gov/pmc/article... . However, assessing integrated care is a challenge because of the limited availability of tools to measure different aspects of integration and the difficulties inherent in tracking existing tools in the literature¹1 Suter E, Oelke ND, Lima MADS, et al. Indicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis. Int J Integr Care. 2017; 17(6):4,1-17.. In contrast to research areas that have clear research methods, analyzing a dynamic and multifaceted system can be complex. However, systematic measurement methods are essential for continued integrated care knowledge. The ability to measure and evaluate the consistency of the results obtained in successful integration strategies is critical to making progress in the design and implementation of an integrated health system⁵5 Bautista MC, Nurjono M, Lim, YW, et al. Instruments measuring integrated care: A systematic review of measurement properties. Milbank Quarterly. 2016; 94(4):862-917..

In recent years, the use of instruments to assess health care networks performance has aroused growing interest of researchers and managers in the national and international scenario due to the concern with the improvement of health care quality and the production of knowledge. The results obtained by the application of instruments allow approximations to the perceptions of participants, care models, care and management practices implemented in the health area⁶6 Fracolli LA, Gomes MFP, Nabão FRZ, et al. Instrumentos de avaliação da Atenção Primária à saúde: revisão de literatura e metassíntese. Ciênc. Saúde Colet. [internet]. 2014 [acesso em 2019 nov 12]; 19(12):4851-4860. Disponível em: http://www.scielo.br/pdf/csc/v19n12/pt_1413-8123-csc-19-12-04851.pdf.
http://www.scielo.br/pdf/csc/v19n12/pt_1... .

Considering the strategic role of PHC in the context of national and international health, as the care network organizer and care coordinator, it is relevant to evaluate its structure and performance through evaluative tools. In this context, this article aims to identify instruments available in the literature to evaluate the structure of primary care network in health systems.

Methods

The study was designed as an integrative literature review, originated from a broad synthesis of knowledge²2 Oelke ND, Suter E, Lima MADS, et al. Indicators and measurement tools for health system integration: a knowledge synthesis protocol. Syst Ver [internet]. 2015. [acesso em 2019 nov 12]; 4(99):1-8. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4518647/pdf/13643_2015_Article_90.pdf.
https://www.ncbi.nlm.nih.gov/pmc/article... . The integrative review allows the analysis of studies from different research designs and generates synthesis of available evidence on a given theme, using a narrative analysis⁷7 Whittemore R, Chao A, Jang M, et al. Methods for knowledge synthesis: an overview. Heart Lung. 2014; 43(5):453-61..

The review was structured according to the following steps: problem identification, literature search, data evaluation, data analysis and presentation of the synthesis of the knowledge⁸8 Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005; 52(5):546-53..

The guiding question was: what instruments are available in the literature to assess the structuring of primary care networks in health systems?

Data collection took place in April 2019. In order to identify the studies, a search was conducted in databases of the health sciences, education and management, namely: Medical Literature Analysis and Retrieval System Online (Medline) including Cochrane virtual library, Embase, PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), ABI Inform, Latin American and Caribbean Health Science Literature (Lilacs), and Business Source Complete. As a search strategy, the combination of the following descriptors was adopted: (Community health OR Community care OR Primary care OR Primary health OR Integrated care OR Integrated health) AND (network OR coalition OR partnership).

The eligibility of the studies was due to the inclusion of publications in English and Portuguese, from 1995 to 2019, which were available in full for online access. The studies should contain tools for evaluating the structure of primary care network, in different scenarios and methodological research designs (qualitative, quantitative and mixed methods), validated or not. Studies containing instruments but not referring to the assessment of the structure of the primary care network, review articles, experience reports, theses, dissertations and monographs, abstracts, documents and annals of events were excluded.

The search resulted in 267 records. The references identified were submitted to the EndNote® bibliography manager software. Duplicate studies were excluded (n = 59), with 208 articles left. For the selection, two independent reviewers analyzed the study titles and abstracts. When there was doubt or disagreement, the studies were evaluated in groups by four researchers. According to the eligibility criteria, 33 articles were selected for full analysis. Of these, nine studies were included in the sample, as illustrated in Figure 1.

For data extraction, an instrument was used, containing the following topics of interest: authors, year of publication, language, objective, design, scenario and name of the identified instruments.

Results

In the nine selected studies⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.

11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0...

12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.

15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-...

16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., whose characteristics are shown in chart 1, eight instruments were identified to assess the structure of the primary care network in health systems.

Six studies⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^-1111 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1313 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.^-1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... were performed in the United States of America (USA); two studies¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., which correspond to the same instrument, were developed in Brazil; and a study¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816. in the Netherlands. As for language, eight are written in English⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.

11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0...

12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.^-1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... ^,1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., and one is in Portuguese¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390..

The characteristics of the instruments, such as name, sample used, study scenario, dimensions, type of validation, measurement properties and psychometric values, are presented in chart 2.

The eight instruments that evaluate the structuring of primary care networks in healthcare systems are: Components of Primary Care Index (CPCI)⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74., Primary Care Assessment Tool-Child Edition (PCAT-CE)¹⁰10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003., Medical Home Index (MHI) – long version¹¹11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... , Safety Net Medical Home Scale (SNMHS)¹⁵15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... , Assessment Tool of the Health Care Network Coordination by PHC (Copas)¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., three questionnaire-type instruments, without specified names¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.^-1414 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.. Among the issues addressed, most of the instruments included longitudinality assessment, interprofessional communication, care coordination, access to health services and quality of care.

It is identified that six instruments were answered by health service professionals, managers or employees¹¹11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0...

12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.

15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-...

16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9.; and two by service users⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.^-1010 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.. Three instruments were applied in person at the study sites⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^-1111 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1616 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., three were sent by email¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.^-1313 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.^,1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... and two were answered by telephone¹⁰10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^,1414 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.. Five instruments were evaluated for psychometric properties⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^-1111 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-...

16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., and, in one of them, there was only semantic validation and pilot test¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9.. One of the studies proposed a safety net evaluation scale in palliative care¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816., without validating it, and three studies applied instruments in a questionnaire format to obtain the data¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.^-1414 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258..

Discussion

It was found that the studies were concentrated in the USA⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^-1111 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1313 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.^-1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... , one being Dutch¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816., and two are Brazilian and deal with the same instrument¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9.. The time interval between publications was approximately three years, though as of 2015, no studies on the subject were found. It is assumed that there is no systematic culture of assessment through instruments in health services, or, if any, the results have not been disseminated in scientific circles.

During the study period, eight instruments were found to measure the components of the structuring of primary care networks⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.

11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0...

12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.

13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.

14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.

15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-...

16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., and, of these, five underwent some type of validation test⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74.

10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003.^-1111 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1515 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-...

16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9.. Validated instruments are useful resources as their items have been tested for psychometric qualities. Its use can save researchers time and work¹⁸18 Keszei A, Novak M, Streiner DL. Introduction to health measurement scales. J Psychosom Res. 2010; 68(4);319-323., besides subsidizing managers, health professionals and researchers in the choice of instruments that are appropriate for their purpose.

The strength of the results obtained in a study depends on the instrument chosen. Therefore, validated instruments regarding psychometric properties may bring more robustness to the research results¹⁹19 Olivo SA, Macedo LG, Gadotti IC, et al. Scales to assess the quality of randomized controlled trials: a systematic review. Phys Ther. 2008; 88(2):156-175.. The performance of the results is given by the validity and reliability of the instrument. Validity is related to the accuracy of measuring what the instrument intends to measure; reliability assesses whether instrument measurements are as accurate as possible. Validity is given by determining the representativeness of items expressing content. This means that this type of validation determines whether the content of a measuring instrument effectively exploits the requirements for measuring a particular investigated phenomenon. In turn, reliability is measured as to the internal consistency of the items and the stability in time and space, indicating aspects about coherence, accuracy, stability, equivalence and homogeneity²⁰20 Souza AC, Alexandre NMC, Guirardello EB. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saude. 2017; 26(3):649-659..

The identified instruments had different study scenarios involving primary care and explore aspects through dimensions such as communication and information, patient knowledge, care coordination, management systems, among others.

The CPCI⁹9 Flocke SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice. 1997; 45(1):64-74. instrument was developed to measure various components of primary care from the patients' perspective. Content validation was performed by an expert committee and a pilot testing with patients who visited the family doctor. Factorial analysis of their items resulted in four stable and internally consistent dimensions, namely: interpersonal communication, doctor's knowledge of the patient, care coordination, and bonding. Each of the CPCI scale scores was significantly associated with patient satisfaction by consulting the family doctor. Dimensions are associated with patient satisfaction. However, the items related to time and frequency of medical consultation did not have a strong association with the dimension of patient satisfaction. The internal consistency of the scale scores is good, and the applicability of the instrument is high, given the small number of items.

The PCAT-CE¹⁰10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003. consists of 26 items, subdivided into five domains. It was promising for PHC assessment by caregivers or guardians of children. PCAT-CE has been used in countries such as the USA, Spain and South Korea to assess essential and derived attributes of PHC¹⁰10 Cassady CE, Starfield B, Hurtado MP, et al. Measuring consumer experiences with primary care. Pediatrics. 2000; 105(4):998-1003..

The MHI – long version¹¹11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... consists of 25 items and considers home care as a clinical practice that sets new standards for PHC directed at child health. The study describes the development and validation of a tool to evaluate doctor's offices based on organizational capacity, chronic condition management, care coordination, communication, information management and quality improvement. In the sample of the investigated practices, the MHI was considered a consistent instrument, with acceptable reliability and validity for the child's PHC practices. However, the authors¹¹11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... recommend that, in order to evaluate the implementation of MHI, it is necessary to study its correlation with variables involving care processes and outcomes in large care networks.

A questionnaire-type instrument was used to assess attributes of the Patient-Centered Medical Home (PCMH)¹³13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9. model. The purpose of the instrument was to assess the prevalence of recommended structural capacities among primary care practices and to determine whether prevalence varied between practices of different quantity and quality dimensions and care networks, medical appointments, patient records and appointment reminders. It is aimed at patients using specific care technologies. The questionnaire can be applied to measure the effectiveness and structure of service delivery in large groups within integrated care. The capabilities investigated do not address all the potential attributes of the PCMH Model. The authors did not report psychometric evaluation of the instrument items.

The instrument that investigated only the infrastructure components of the PCMH model is a questionnaire developed from data from a large North American study on medical organizations (National Study of Physician Organizations 2006-2007) to assess the extent of implementation of care components in the domiciliary, allied to primary care and its association with the supply and adequacy of doctors' sizing¹⁴14 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258.. The study did not report psychometric assessment of the questionnaire.

The SNMHS¹⁵15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... consisted of 52 items, 16 cores and organized into 6 domains. The instrument demonstrated reliability and convergent validity to evaluate the adoption of home medical care. It aims to provide useful information to guide health systems and establish incentives, to allocate resources in the organization and meeting the demands of populations, especially low-income ones. The results obtained with the application of the SNMHS instrument can provide detailed description related to home care safety. However, the initial validation of the SNMHS does not allow generalizations¹⁵15 Birnberg JM, Drum ML, Huang ES, et al. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine [internet]. 2011 [acesso em 2019 nov 20]; 26(12):1418-1425. DOI: https://doi.org/10.1007/s11606-011-1767-9
https://doi.org/10.1007/s11606-011-1767-... .

The Copas¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^-1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9. was the only Brazilian instrument found in this review. It assess the coordination of Health Care Networks (RAS) through PHC. Although it was built and validated based on a checklist for assessing the degree of integration of the RAS, the Copas makes it possible to assess PHC's ability to coordinate networks by placing it at the center of a process of integrating the various points of attention¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.. The instrument has 78 items in 5 dimensions. Its elaboration and validation process involved two steps: semantic validation and pilot testing. The instrument was comprehensive, containing the dimensions of health care management coordination (population, primary health care, support systems, logistics systems, and management systems). The Copas is a valid and reliable instrument and can be used by researchers, managers and health professionals to audit and improve the coordination of health services. However, new applications are needed, in a larger sample, in order to attest to its validity¹⁷17 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9..

An unnamed instrument¹²12 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816. considered the scarcity of scientific evidence related to the structuring of palliative care networks in primary care in the Netherlands. Accordingly, the Dutch Ministry of Health has initiated a five-year program for palliative care, based on the founding and funding of Centers for the Development of Palliative Care. These centers were structured around important services such as university hospitals and cancer treatment centers. The construction of the instrument was part of a program to develop a regional network to integrate palliative care services into the health system. No psychometric tests of the instrument were reported.

Although the instruments identified differ according to the population and the scenario studied, there are characteristics that are common. The literature indicates a number of principles, such as adequate service delivery, geographic coverage, patient focus, organizational culture, performance evaluation, multiprofessional teams, financial management, governance, empowerment, and building practices for integrated system organization²2 Oelke ND, Suter E, Lima MADS, et al. Indicators and measurement tools for health system integration: a knowledge synthesis protocol. Syst Ver [internet]. 2015. [acesso em 2019 nov 12]; 4(99):1-8. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4518647/pdf/13643_2015_Article_90.pdf.
https://www.ncbi.nlm.nih.gov/pmc/article... ^,2121 Goodwin N. Understanding Integrated Care. Int J Integr Care. 2016; 16(4):6., which allies with the characteristics presented in the instruments identified in this study.

The integration of care presupposes prolonged contacts between professionals and the reference population, through various forms of bonding and follow-up, diversifying forms of approaches. In this context, the longitudinality of care is identified, which results from the coordination of various practices and technologies offered, in different spaces, in order to compose a coherent and effective action, without losing focus on the user's condition at all times²²22 World Health Organization. WHO global strategy on people-centred and integrated health services: interim report [internet]. Geneva: World Health Organization, 2015 [acesso em 2019 nov 11]. Disponível em: http://www.who.int/iris/handle/10665/155002.
http://www.who.int/iris/handle/10665/155... .

The measurement of integration also provides for a more precise definition of the role and scope of responsibility of health professionals and units, providing quality care according to the specificities of each user. The care integration formats are oriented towards the attainment of ever higher standards of effectiveness in the PHC environment, home care services, child health and palliative care. The focus on the patient and therapeutic plans, aligned with the needs of each population, allows the monitoring of the impact of continued treatment and the performance evaluation of those involved in the care integration process²³23 Aleluia IRS, Medina MG, Almeida PF, et al. Coordenação do cuidado na atenção primária à saúde: estudo avaliativo em município sede de macrorregião do nordeste brasileiro. Ciênc. Saúde Colet. [internet]. 2017 [acesso em 2019 nov 20]; 22(6):1845-56. Disponível em: https://www.scielosp.org/article/ssm/content/raw/?resource_ssm_path=/media/assets/csc/v22n6/1413-8123-csc-22-06-1845.pdf.
https://www.scielosp.org/article/ssm/con... .

Moreover, among the similarities of the identified instruments, the coordination attribute stands out, characterized as the articulation between health care services and actions, aimed at a common goal. Thus, conducting the assessment of care coordination allows measuring the quality of an integrated network, from PHC to the other levels of care, so that different practices are continuously perceived and experienced by the patient, appropriate to their health care needs and compatible with your personal expectations among the services³3 Almeida PF, Medina MG, Fausto MCR, et al. Coordenação do cuidado e Atenção Primária à Saúde no Sistema Único de Saúde. Saúde debate [internet]. 2018 [acesso em 2019 nov 12]; 42(esp1):244-260. Disponível em: http://www.scielo.br/pdf/sdeb/v42nspe1/0103-1104-sdeb-42-spe01-0244.pdf.
http://www.scielo.br/pdf/sdeb/v42nspe1/0... ^,2424 Vargas I, Mogollón-Pérez AS, De Paepe P, et al. Barriers to healthcare coordination in market-based and decentralized public health systems: a qualitative study in healthcare networks of Colombia and Brazil. Health Policy Plan [internet]. 2016 [acesso em 2019 nov 12]; 31(6):736-748. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/26874327/.
https://www.ncbi.nlm.nih.gov/pmc/article... .

Considering that the objective of the health systems structuring and management processes is based on the knowledge of the population profile, it is essential to master the information systems about the patient and his family, which was also identified in the instruments¹³13 Friedberg MW, Safran DG, Coltin KL, et al. Readiness for the patient centered medical home: Structural capabilities of Massachusetts Primary Care Practices. J Gen Intern Med. 2008; 24(2):162-9.^,1616 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390., either through an electronic medical record or an identification card. These strategies increase the health system's ability to plan effective actions and produce impacts on patients' health.

The analysis of interaction between different professionals is identified in the instruments¹¹11 Cooley WC, McAllister JW, Sherrieb K, et al. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambul Pediatr [internet]. 2003 [acesso em 2019 nov 20]; 3(4):173-180. Disponível em: https://doi.org/10.1367/1539-4409(2003)003<0173:TMHIDA>2.0.CO;2.
https://doi.org/10.1367/1539-4409(2003)0... ^,1212 Nikbakht-Van M, Pruyn JFA, Van der Rijt CCD. Function of local networks in palliative care: A Dutch view. J Palliat Med. 2005; 8(4):808-816.^,1414 Rittenhouse DR, Casalino LP, Gillies RR, et al. Measuring the medical home infrastructure in large medical groups Health Aff (Millwood). 2008; 27(5):1246-1258. and its common objective is to measure the clinical accountability of its members and their insertion in the structure and participation in integrated systems. The concept of clinical co-responsibility in the integration of health services is based on the articulation of the practices of managers and professionals directed to the demands of the population, with integrated care being the strategy that meets these needs.

Finally, an appropriate instrument to assess primary care networks in health systems is one that meets the proposed objectives in a scenario compatible with the researched reality, in order to develop knowledge that guides decision making and can be scientifically recognized.

In the Brazilian context, we highlight the Copas¹⁶16 Rodrigues LBB, Leite AC, Yamamura M, et al. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cad. Saúde Pública. 2014; 30(7):1384-1390.^,1717 Rodrigues LBB, Santos CB, Goyata LT, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice. 2015; 16(87):1-9., as it is a complete instrument, developed in Brazil, based on the guidelines of the Unified Health System (SUS) and originally built in the Portuguese language. Therefore, it can be a useful tool to support health workers and managers in the situational diagnosis of PHC potentialities and weaknesses and in the coordination of care networks.

Final considerations

The results of this study allowed us to identify eight instruments available in the literature that can support researchers, managers, health professionals and users interested in using tools to assess the structure of primary care network in health systems. The instruments generally addressed aspects related to longitudinality, interprofessional communication, care coordination, access to health services and quality of care.

The limitations of the study are related to the delimitation of the Portuguese and English languages in the eligibility criteria, which may have excluded studies considered important. However, this review presents important findings that may help achieve health services integration. Assessment scales are important tools for clinical practice and research in different areas of knowledge. Selecting instruments that provide valid and reliable measures increases the strength of results and reinforces decision making.

Continuous progress towards an integrated care system depends on the ability to contrast and compare the success of strategies used at different levels and in different health contexts. This success can be achieved through consolidated measurement approaches. Assessing the success of integration strategies consistently provides better health system design with better health outcomes for patients.

Acknowledgements

We thank Professor Nelly Donszelmann Oelke, from the University of British Columbia (UBC), Okanagan campus, Canada, and Professor Esther Suter from the University of Calgary, Canada for their support for this study. We thank the Canadian Institutes of Health Research (CIHR) for the financial support for the project 'Indicators and measurement instruments for health systems integration: a knowledge synthesis' (KRS 138203).

References

Publication Dates

History