ABSTRACT

OBJECTIVE

To describe the process of cross-cultural adaptation of the Patient-Doctor Relationship Questionnaire (PDRQ-9), as well as compare the agreement between two different types of application.

METHODS

This is a cross-sectional study with 133 adult users of a Primary Health Service in Porto Alegre, State of Rio Grande do Sul, Brazil. The PDRQ-9 was answered by the participants as a self-administered questionnaire and in an interview. The instrument was also validated by interview, using data from 628 participants of the Mais Médicos Program Evaluation Research, which is a cross-sectional study with a systematic sample of Primary Care Services in all regions of Brazil. We evaluated the semantic, conceptual, and item equivalence, as well as factor analysis and reliability.

RESULTS

All items presented factor loading > 0.5 in the different methods of application and populations in the factor analysis. We found Cronbach’s alpha of 0.94 in the self-administered method. We found Cronbach’s alpha of 0.95 and 0.94 in the two different samples in the interview application. The use of PDRQ-9 with an interview or self-administered was considered equivalent.

CONCLUSIONS

The cross-cultural adaptation of the PDRQ-9 in Brazil replicated the factorial structure found in the original study, with high internal consistency. The instrument can be used as a new dimension in the evaluation of the quality of health care in clinical research, in the evaluation of services and public health, in health management, and in professional training. Further studies can evaluate other properties of the instrument, as well as its behavior in different populations and contexts.

Physician-Patient Relations; Psychometrics; Translations; Interview; Surveys and Questionnaires; Validation Studies

INTRODUCTION

The doctor-patient relationship (DPR), in its historical context, depends on the medical situation and the social scene of each time¹1. Szasz TS, Knoff WF, Hollender MH. The doctor-patient relationship and its historical context. Am J Psychiatry. 1958;115(6):522-8. https://doi.org/10.1176/ajp.115.6.522
https://doi.org/10.1176/ajp.115.6.522... . Nonetheless, the perception of DPR as an important factor in the context of health care is a consolidated concept in multiple cultures²2. Kearley KE, Freeman GK, Heath A. An exploration of the value of the personal doctor-patient relationship in general practice. Br J Gen Pract. 2001 [cited 2018 Jan 14];51(470):712-8. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1314098/pdf/11593831.pdf
https://www.ncbi.nlm.nih.gov/pmc/article... . The DPR involves components of verbal transfer of information associated with socioemotional aspects³3. Roter DL, Hall JA. Studies of doctor-patient interaction. Annu Rev Public Health. 1989 [cited 2018 Jan 14];10:163-80. Available from: http://www.annualreviews.org/doi/pdf/10.1146/annurev.pu.10.050189.001115
http://www.annualreviews.org/doi/pdf/10.... . Nevertheless, there is no consensus regarding a universally accepted definition, because of the inherent complexity and subjectivity of the process. Operationally, DPR can be understood as a special type of human relationship that, either in terms of function or structure, is a component of care with the potential to affect health outcomes⁴4. Kaba R, Sooriakumaran P. The evolution of the doctor-patient relationship. Int J Surg. 2007;5(1):57-65. https://doi.org/10.1016/j.ijsu.2006.01.005
https://doi.org/10.1016/j.ijsu.2006.01.0... ^,55. Ridd M, Shaw A, Lewis G, Salisbury C. The patient-doctor relationship: a synthesis of the qualitative literature on patients’ perspectives. Br J Gen Pract. 2009;59(561):116-33. https://doi.org/10.3399/bjgp09X420248
https://doi.org/10.3399/bjgp09X420248... . A satisfactorily developed DPR is associated with better symptom control, such as: pain, disability, anxiety⁶6. Stewart M. Effective physician-patient communication and health outcomes: a review. CMAJ. 1995 [cited 2018 Jan 14];152(9):1423-33. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1337906/pdf/cmaj00069-0061.pdf
https://www.ncbi.nlm.nih.gov/pmc/article... , weight loss, and blood pressure control⁷7. Kelley JM, Kraft-Todd G, Schapira L, Kossowsky J, Riess H. The influence of the patient-clinician relationship on healthcare outcomes: a systematic review and meta-analysis of randomized controlled trials. PLoS One. 2014;9(4):e94207. https://doi.org/10.1371/journal.pone.0094207
https://doi.org/10.1371/journal.pone.009... . In addition, it improves adherence to treatment⁸8. Vermeire E, Hearnshaw H, Van Royen P, Denekens J. Patient adherence to treatment: three decades of research: a comprehensive review. J Clin Pharm Ther. 2001;26(5):331-42. https://doi.org/10.1046/j.1365-2710.2001.00363.x
https://doi.org/10.1046/j.1365-2710.2001... and increases satisfaction with care⁹9. Williams S, Weinman J, Dale J. Doctor-patient communication and patient satisfaction: a review. Fam Pract. 1998;15(5):480-92., which have a direct impact on the management of acute and chronic health problems⁶6. Stewart M. Effective physician-patient communication and health outcomes: a review. CMAJ. 1995 [cited 2018 Jan 14];152(9):1423-33. Disponível em: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1337906/pdf/cmaj00069-0061.pdf
https://www.ncbi.nlm.nih.gov/pmc/article... .

The DPR can be approached in different ways. It can be seen as the relationship of trust, therapeutic alliance, or empathy, developed between physician and patient¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... . It can also be treated as the ability of the physician to communicate and interact or the continuity of the care relationship⁵5. Ridd M, Shaw A, Lewis G, Salisbury C. The patient-doctor relationship: a synthesis of the qualitative literature on patients’ perspectives. Br J Gen Pract. 2009;59(561):116-33. https://doi.org/10.3399/bjgp09X420248
https://doi.org/10.3399/bjgp09X420248... ^,1111. Greenhalgh T, Heath I. Measuring quality in the therapeutic relationship. London: The Kings Fund; 2010.. Personal characteristics such as race, sex, socioeconomic status, and age, as well as the interpersonal and communication skills of the physician and their attire, are identified as factors with potential to affect the DPR¹²12. Ha JF, Hons M, Longnecker N. Doctor-patient communication: a review. Ochsner J. 2010 [cited 2018 Jan 14];10(1):38-43. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3096184/
https://www.ncbi.nlm.nih.gov/pmc/article... ^–1717. Mercer SW, Higgins M, Bikker AM, Fitzpatrick B, McConnachie A, Lloyd SM, et al. General practitioners’ empathy and health outcomes: a prospective observational study of consultations in areas of high and low deprivation. Ann Fam Med. 2016;14(2):117-24. https://doi.org/10.1370/afm.1910
https://doi.org/10.1370/afm.1910... .

In the context of Primary Health Care (PHC), the DPR is inserted within longitudinality, which is one of the essential attributes of PHC defined by Starfield¹⁸18. Starfield B. Atenção primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília (DF): UNESCO; Ministério da Saúde; 2002.. Interactions between professionals and patients contribute to the establishment of long-term relationships, which facilitate the effectiveness of PHC¹⁸18. Starfield B. Atenção primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília (DF): UNESCO; Ministério da Saúde; 2002.. The DPR is also a key component of the person-centered approach¹¹11. Greenhalgh T, Heath I. Measuring quality in the therapeutic relationship. London: The Kings Fund; 2010..

The DPR in the clinical setting is usually measured from the perception of patients¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... . The most frequently evaluated dimension refers to some type of alliance with descriptions such as: bond, goals, tasks, and collaboration. Other dimensions commonly evaluated are: trust, empathy, and communication skills¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... . Qualitative approaches are used as tools in the development of the conceptual structure of factors that define the doctor-patient relationship⁵5. Ridd M, Shaw A, Lewis G, Salisbury C. The patient-doctor relationship: a synthesis of the qualitative literature on patients’ perspectives. Br J Gen Pract. 2009;59(561):116-33. https://doi.org/10.3399/bjgp09X420248
https://doi.org/10.3399/bjgp09X420248... . Quantitative assessments using validated scales are the most common procedures to measure the processes of doctor-patient interaction based on their advantages in terms of external validity and comparability of results¹¹11. Greenhalgh T, Heath I. Measuring quality in the therapeutic relationship. London: The Kings Fund; 2010.. The readness of scales in relation to application and analysis of results also favors their use in clinical or population studies and in the evaluation of professionals and health services.

We found no instruments that evaluate DPR in Brazil adapted to the scenario of outpatient medical practice. In addition, the Brazilian population of illiterates or functional illiterates reaches 17.6% of the persons aged 15 years or more, and this value can reach 27.1% in the Northeast region¹⁹19. Instituto Brasileiro de Geografia e Estatística. Pesquisa Nacional por Amostra de Domicílios: síntese de indicadores 2014. 2.ed. Rio de Janeiro: IBGE; 2015.. Therefore, we need a resource that can include these persons. The Patient-Doctor Relationship Questionnaire (PDRQ-9)²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... is a questionnaire developed in the Netherlands in 2004. It has been translated and validated in the United States²¹21. Porcerelli JH, Murdoch W, Morris P, Fowler S. The Patient–Doctor Relationship Questionnaire (PDRQ-9) in primary care: a validity study. J Clin Psychol Med Settings. 2014;21(3):291-6. https://doi.org/10.1007/s10880-014-9407-2
https://doi.org/10.1007/s10880-014-9407-... , Germany²²22. Zenger M, Schaefert R, Feltz-Cornelis C, Brähler E, Häuser W. Validation of the Patient-Doctor-Relationship Questionnaire (PDRQ-9) in a representative cross-sectional German population survey. PLoS One. 2014;9(3):e91964. https://doi.org/10.1371/journal.pone.0091964
https://doi.org/10.1371/journal.pone.009... , Spain²³23. Martín-Fernández J, Cura-González MI, Gómez-Gascón T, Fernández-López E, Pajares-Carabajal G, Moreno-Jiménez B. Satisfacción del paciente con su médico de familia: un estudio con el Patient-Doctor Relationship Questionnaire (PDRQ-9). Aten Primaria. 2010;42(4):196-203. https://doi.org/10.1016/j.aprim.2009.09.026
https://doi.org/10.1016/j.aprim.2009.09.... , Turkey²⁴24. Mergen H, Van der Feltz-Cornelis CM, Karao lu N, Erdogmus B, Öngel K. Validity of the Turkish patient-doctor relationship questionnaire (PDRQ-Turkish) in comparison with the Europe instrument in a family medicine center. HealthMED. 2012;6(5):1763-70., and Bangladesh²⁵25. Arafat SMY. Psychometric validation of the Bangla Version of the Patient-Doctor Relationship Questionnaire (PDRQ-9). Psychiatry J. 2016;(2016):9385364. https://doi.org/10.1155/2016/9385364
https://doi.org/10.1155/2016/9385364... . It is considered adequate to the PHC scenario, because it is concise and easy to apply, and it has excellent reliability and internal consistency¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... . The objective of this study was to describe the cross-cultural adaptation process of the PDRQ-9 to the Brazilian context, as well as compare the agreement between two types of application.

METHODS

We performed a cross-cultural adaptation according to the recommendations of the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN Initiative)²⁶26. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist manual. Amsterdam: EMGO Institute for Health and Care Research; 2012., which is an international guideline for assessing the methodological quality of studies on the properties of health measurement instruments.

The PDRQ-9 is an instrument²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... that evaluates DPR from the perspective of patients, focusing on their perception on the willingness to help and empathy of the physician. It was developed from a questionnaire that evaluates therapeutic alliance in psychotherapy. During the validation process of the original instrument, some items were added or modified, and the specific items of the psychotherapy scenario were removed, which resulted in a nine-item scale.

Each item of the instrument is a statement about different attributes of the DPR (help, time, trust, understanding, dedication, agreement, availability, contentment, and accessibility), which evaluate the relational and satisfaction aspects. The instrument was developed to be self-administered, and the patient should answer how much each statement is appropriate on a five-point Likert scale. In a population, the score of each item is calculated by the arithmetic mean of the answers of that item, and a general score is calculated by the arithmetic mean of the answers of the nine items.

Two samples were used in the process to evaluate the psychometric properties of the PDRQ-9. The sample of the main validation study (MVS) aimed to evaluate the instrument both when self-administered and when applied in an interview. The MVS was a cross-sectional study with 133 users in a Primary Care Service (PCS) in Porto Alegre, State of Rio Grande do Sul, Brazil. We used convenience sampling, stratified by sex and two age groups (18 to 59 years and ≥ 60 years). The strata were performed using data from a large PCS in Porto Alegre. Data collection took place between September and December 2016. Users were approached after medical consultation by trained interviewers. They should have four or more years of education and at least two appointments with that physician. They answered the self-administered PDRQ-9, deposited their answers in a ballot box, and then answered the same instrument in an interview. The patient did not know that they would have to answer the instrument again in an interview when invited to fill the self-administered questionnaire. In order to assess the stability of the scale over time, participants received the instrument again by letter or e-mail after two weeks in order to answer it at home.

We calculated the sample size of the MVS to test the equivalence between two paired means, according to the Bland-Altman procedure²⁷27. Bland J, Altman D. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135-60., to evaluate the agreement of the PDRQ-9 that was self-administered and applied in an interview. We considered an overall instrument mean score of 4.1 and a standard deviation of 0.8²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... . As a reference for comparison between the methods of application, we used a Spanish study that applied the PDRQ-9 in an interview²³23. Martín-Fernández J, Cura-González MI, Gómez-Gascón T, Fernández-López E, Pajares-Carabajal G, Moreno-Jiménez B. Satisfacción del paciente con su médico de familia: un estudio con el Patient-Doctor Relationship Questionnaire (PDRQ-9). Aten Primaria. 2010;42(4):196-203. https://doi.org/10.1016/j.aprim.2009.09.026
https://doi.org/10.1016/j.aprim.2009.09.... . We stipulated an expected difference of 0.2, negligible difference of 0.3, correlation of 0.8, power of 0.8, and statistical significance of 0.05.

We also evaluated the instrument when applied in an interview using a sample of participants of the Mais Médicos Program Evaluation Research (PAPMM), which is a cross-sectional study with a systematic sample of Primary Care Services (PCS) throughout Brazil. The objective of this study was to evaluate the quality of the medical care offered to adult users of the Family Health Strategy (FHS) in Brazil. Cuban and Brazilian doctors of the Mais Médicos Program (PMM) were compared to Brazilian doctors who did not work with the PMM. In each PCS sampled, approximately twelve adult users (≥ 18 years) were approached, with at least two appointments with that physician by consecutive selection after appointment with a previously selected physician. These users answered several instruments to trained researchers, among them the PDRQ-9. Of the 6,200 users interviewed in the PAPMM, 10.0% of the participants were randomly selected for the evaluation of the properties of the PDRQ-9. This sub-sample was stratified by state, size of the city, number of FHS teams, and work category of the physician (part or not of the Mais Médicos Program). We did not include data of patients cared by Cuban doctors, since the purpose of the study was the cross-cultural adaptation to Brazil, including questions related to Brazilian Portuguese.

The instrument was selected by one of the authors (LW) after reviewing the literature on the subject. The face and content validity of the scale was evaluated based on national²⁸28. Caprara A, Rodrigues J. A relação assimétrica médico-paciente: repensando o vínculo terapêutico. Cienc Saude Coletiva. 2004;9(1):139-46. https://doi.org/10.1590/S1413-81232004000100014
https://doi.org/10.1590/S1413-8123200400... and international literature¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... related to the attributes of DPR. The instrument was discussed by a committee of experts (two epidemiologists with experience in cross-cultural adaptation studies and three family physicians, all with English proficiency) to evaluate the conceptual and item adequacy in the Brazilian context.

Two translations were made from English to Portuguese by two independent translators who were native English speakers. Back translation to English was performed by another pair of independent translators, who were Brazilians fluent in English. Four pre-tests were performed with ten questionnaires in adult users, in the same PCS of the MVS. The objective of the questionnaire was explained to the participants, who were asked if they considered the statements comprehensible, and relevant results were discussed with the research team after each pre-test. Doubts were discussed with the author of the original instrument (CMVF).

We used factor analysis extraction with principal axis factoring to evaluate the validity related to the construct. We selected the items with factor loading above 0.30²⁹29. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 4.ed. New York: Oxford University Press; 2008.. We evaluated the reliability of this instrument through internal consistency and stability over time. In order to evaluate the internal consistency of each component, we used the item-total correlation, considering as adequate the items with a value above 0.50, in addition to Cronbach’s alpha coefficient, considering an appropriate value if equal to or greater than 0.70²⁹29. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 4.ed. New York: Oxford University Press; 2008.. Time stability and agreement analysis between the self-administered and interview methods were performed using the Bland-Altman procedure²⁷27. Bland J, Altman D. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135-60., with Wilcoxon test, and intraclass correlation coefficient (ICC), which was considered appropriate if greater than 0.60²⁶26. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist manual. Amsterdam: EMGO Institute for Health and Care Research; 2012.. The analyses were performed using the SPSS software, version 18.

This research was approved by the Research Ethics Committee of the Hospital de Clínicas of Porto Alegre in 2015 (CAAE 48653615.6.0000.5327) and by the Ethics Committees of all cities participating in the PAPMM that requested such approval. The information collected was kept confidential and the names of the participants were not disclosed. The data were presented grouped, keeping the confidentiality of each individual. All interviewees received a clear explanation of the objectives of the study. The participants signed the informed consent.

RESULTS

The expert committee considered the instrument appropriate in relation to the face and content to be used in the Brazilian context. Translations and back translations were compared to each other and the original version, and the first version of the pre-test instrument was developed. The translation of the word “appropriate” into “concordo” (“agree”) in the answer options of the instrument (from 1 to 5, 1 being equivalent to “I do not agree” and 5 “I totally agree”) was suggested. This change was considered appropriate by the expert committee and approved by the author of the original instrument. In general, participants had a good understanding of the questionnaire. Different words and syntaxes were tested to improve understanding, keeping the original meaning of each item: item 6 – nature versus cause, symptoms versus medical symptoms; item 7 – speaking versus talking; item 8 – satisfied versus content; item 9 – have access versus easily accessible. At the end of the fourth pre-test, we reached the version to test the psychometric properties. There were no missing data in any of the questionnaires used in the MVS and PAPMM.

Table 1 shows the characterization of the participants of the two samples used in the evaluation of the PDRQ-9. The participants of the MVS were older, had higher education level, lower unemployment, and a lower proportion lived with a partner.

Seventeen physicians were responsible for the care of the participants of the MVS. The mean age of physicians in this sample was 32 years and 70.6% were women; 29.4% were specialized in family medicine. The mean time of medical practice was 4.7 years, and they worked in the PCS for 2.3 years, on average. They had a mean weekly workload of 54 hours (considering all jobs) and cared for approximately 34 patients per week in the PCS. In the PAPMM, 52 physicians were responsible for the care of the participants, of whom two refused to provide their data. The mean age of physicians in this sample was 39 years and 50.0% were women; 72.0% were specialized in family medicine. The mean time of medical practice was 12.2 years, and they worked in the PCS of the research for 3.6 years, on average. They had a mean weekly workload of 60 hours, taking care of approximately 126 patients per week in the PCS of the research.

Factor loading of the self-administered PDRQ-9 in the population of the MVS was > 0.30 for all items, and item-total correlation was > 0.50 (Table 2).

We obtained an overall score of 4.45 (SD = 0.7) using the self-administered PDRQ-9. In the reliability assessment, we found Cronbach’s alpha of 0.94. The variance explained by the factor extracted was 65.3%.

Factor loading of the PDRQ-9 applied in an interview in the populations of the MVS and PAPMM was > 0.30, and item-total correlation was > 0.50 for all items (Table 3).

When evaluating the reliability of the PDRQ-9 applied in an interview in the MVS, we found a general score of 4.43 (SD = 0.7), with Cronbach’s alpha of 0.95, and variance explained by the extracted factor of 70.2%. In PAPMM, the overall score obtained was 3.23 (SD = 0.8), with Cronbach’s alpha of 0.94 and explained variance of 65.6%.

Thirty-five participants of the MVS completed the retest questionnaire sent after two weeks. There were no differences related to sex, race, age, education level, number of appointments, or score of the instrument between respondents and non-respondents of the retest. We found an intraclass correlation coefficient (ICC) of 0.96 (95%CI 0.94–0.98) between the retest and the self-administered instrument. The Bland-Altman scatter plot used to evaluate the time stability of the PDRQ-9 suggested a homogeneous distribution, with greater agreement for extreme values. The upper limit of agreement can be considered slightly enlarged (Figure 1).

The ICC was 0.94 (95%CI 0.93–0.95) in the assessment agreement between the self-administered and interview methods. The Bland-Altman scatter plot presented a homogeneous distribution, difference of means very close to zero, and narrow limits of agreement (Figure 2). We obtained p = 0.315 with Wilcoxon test.

DISCUSSION

The cross-cultural adaptation of the PDRQ-9 replicated the one-dimensional structure observed in the original study²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... . From the results obtained, we could present the instrument to measure DPR considering the nine items, which showed appropriate performance for the validity and reliability measures evaluated (Box). Factor loading was high in all items and methods of application of the different samples, with a drop in the item related to access. This situation was also verified in the original validation study²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... . A possible explanation for this is that the semantic content of the term “access” carries meaning not only related to the availability of the physician, but also to the organization of the health service¹⁸18. Starfield B. Atenção primária: equilíbrio entre necessidades de saúde, serviços e tecnologia. Brasília (DF): UNESCO; Ministério da Saúde; 2002.. New studies with the instrument in services with easy and difficult access, controlling for this factor, may help in understanding the interference of accessibility related to the service in the evaluation of the DPR by users. Qualitative studies may help define a more appropriate sentence, in order to discriminate the availability of the professional.

The high internal consistency verified in this study, either by the self-administered or interview method in the different populations (α = 0.94–0.95), can also be observed in the other evaluations of this instrument, such as the Dutch (α = 0.94)²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... , Germany (α = 0.95)²²22. Zenger M, Schaefert R, Feltz-Cornelis C, Brähler E, Häuser W. Validation of the Patient-Doctor-Relationship Questionnaire (PDRQ-9) in a representative cross-sectional German population survey. PLoS One. 2014;9(3):e91964. https://doi.org/10.1371/journal.pone.0091964
https://doi.org/10.1371/journal.pone.009... , Spanish (α = 0.95)²³23. Martín-Fernández J, Cura-González MI, Gómez-Gascón T, Fernández-López E, Pajares-Carabajal G, Moreno-Jiménez B. Satisfacción del paciente con su médico de familia: un estudio con el Patient-Doctor Relationship Questionnaire (PDRQ-9). Aten Primaria. 2010;42(4):196-203. https://doi.org/10.1016/j.aprim.2009.09.026
https://doi.org/10.1016/j.aprim.2009.09.... , American (α = 0.96)²¹21. Porcerelli JH, Murdoch W, Morris P, Fowler S. The Patient–Doctor Relationship Questionnaire (PDRQ-9) in primary care: a validity study. J Clin Psychol Med Settings. 2014;21(3):291-6. https://doi.org/10.1007/s10880-014-9407-2
https://doi.org/10.1007/s10880-014-9407-... , and Turkey ones (α = 0.91)²⁴24. Mergen H, Van der Feltz-Cornelis CM, Karao lu N, Erdogmus B, Öngel K. Validity of the Turkish patient-doctor relationship questionnaire (PDRQ-Turkish) in comparison with the Europe instrument in a family medicine center. HealthMED. 2012;6(5):1763-70.. The item-total correlation reached values considered appropriate in all populations and methods of application, for all items of the instrument. Different properties of the instrument have been tested in international studies, such as: convergent²¹21. Porcerelli JH, Murdoch W, Morris P, Fowler S. The Patient–Doctor Relationship Questionnaire (PDRQ-9) in primary care: a validity study. J Clin Psychol Med Settings. 2014;21(3):291-6. https://doi.org/10.1007/s10880-014-9407-2
https://doi.org/10.1007/s10880-014-9407-... ^,2222. Zenger M, Schaefert R, Feltz-Cornelis C, Brähler E, Häuser W. Validation of the Patient-Doctor-Relationship Questionnaire (PDRQ-9) in a representative cross-sectional German population survey. PLoS One. 2014;9(3):e91964. https://doi.org/10.1371/journal.pone.0091964
https://doi.org/10.1371/journal.pone.009... , discriminant²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2...

21. Porcerelli JH, Murdoch W, Morris P, Fowler S. The Patient–Doctor Relationship Questionnaire (PDRQ-9) in primary care: a validity study. J Clin Psychol Med Settings. 2014;21(3):291-6. https://doi.org/10.1007/s10880-014-9407-2
https://doi.org/10.1007/s10880-014-9407-... ^-2222. Zenger M, Schaefert R, Feltz-Cornelis C, Brähler E, Häuser W. Validation of the Patient-Doctor-Relationship Questionnaire (PDRQ-9) in a representative cross-sectional German population survey. PLoS One. 2014;9(3):e91964. https://doi.org/10.1371/journal.pone.0091964
https://doi.org/10.1371/journal.pone.009... , and confirmatory factor analysis²²22. Zenger M, Schaefert R, Feltz-Cornelis C, Brähler E, Häuser W. Validation of the Patient-Doctor-Relationship Questionnaire (PDRQ-9) in a representative cross-sectional German population survey. PLoS One. 2014;9(3):e91964. https://doi.org/10.1371/journal.pone.0091964
https://doi.org/10.1371/journal.pone.009... ^,2424. Mergen H, Van der Feltz-Cornelis CM, Karao lu N, Erdogmus B, Öngel K. Validity of the Turkish patient-doctor relationship questionnaire (PDRQ-Turkish) in comparison with the Europe instrument in a family medicine center. HealthMED. 2012;6(5):1763-70.. As in the studies in other countries, the PDRQ-9 reached moderate or high scores in the evaluation of the DPR in Brazil. This finding is also verified in the use of different instruments that measure DPR¹⁰10. Eveleigh RM, Muskens E, Ravesteijn H, Dijk I, Rijswijk E, Lucassen P. An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol. 2012;65(1):10-5. https://doi.org/10.1016/j.jclinepi.2011.05.011
https://doi.org/10.1016/j.jclinepi.2011.... .

The application of the PDRQ-9 in the PAPMM allowed its cross-cultural adaptation, with a sample of participants from all regions of Brazil. These users were found in PHC services of the Brazilian Unified Health System, in their different types of organization and offer of care. In addition, we could include persons with great individual and social plurality. These factors add robustness to the presented results.

Although originally designed to be self-administered, the PDRQ-9 has already been validated in Spain for use through interviews²³23. Martín-Fernández J, Cura-González MI, Gómez-Gascón T, Fernández-López E, Pajares-Carabajal G, Moreno-Jiménez B. Satisfacción del paciente con su médico de familia: un estudio con el Patient-Doctor Relationship Questionnaire (PDRQ-9). Aten Primaria. 2010;42(4):196-203. https://doi.org/10.1016/j.aprim.2009.09.026
https://doi.org/10.1016/j.aprim.2009.09.... . However, it is the first time that the evaluation of the psychometric properties of the instrument is carried out in parallel for two different methods of application, which allowed us to verify the existence of differences between them. We found high correlation and the Bland-Altman procedure showed great agreement between the different types of application, which makes us consider that they are equivalent. The prospect of using PDRQ-9 in interviews allows the inclusion of illiterates and functional illiterates in later applications of this instrument.

To evaluate the stability of the scale over time, the response rate after two weeks was low (26.3%), which was also verified in the original PDRQ-9 validation study (33%)²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... . The answers of the participants presented excellent correlation. The bias found (0.18) was statistically significant but considered small. Greater agreement at extremes in relation to the center of the scatter plot suggests that persons who evaluate their physician with moderate scores present greater uncertainty in providing answers. The change in the answers of the participants after two weeks may be due to the effects of the recommendations or treatments prescribed over that period, as well as the fact that the instrument is answered outside the health service. A moderate correlation between test and retest was observed in the original study, the only one to perform an assessment of the stability over time, with Pearson coefficient of 0.61²⁰20. Van Der Feltz-Cornelis CM, Van Oppen P, Van Marwijk HWJ, De Beurs E, Van Dyck R. A Patient-Doctor Relationship Questionnaire (PDRQ-9) in primary care: development and psychometric evaluation. Gen Hosp Psychiatry. 2004;26(2):115-20. https://doi.org/10.1016/j.genhosppsych.2003.08.010
https://doi.org/10.1016/j.genhosppsych.2... .

This study presents limitations. We did not evaluate the time needed to answer the instrument. Therefore, we could not perform analyses related to learning bias or interference of factors such as education level. The participants of the MVS may have felt compelled to answer the instrument identically, as they had to answer the PDRQ-9 using two different methods in sequence, which may have underestimated the difference between the methods. The lack of knowledge of the participant on the fact that they would answer the instrument a second time minimizes this effect. On the other hand, the use of the ballot box reinforced that the goal in answering the instrument for the second time was not to remember what was already answered, but to provide a new authentic answer. The application of the instrument in the health service can lead to socially acceptable answers and overestimate the judgment of the persons towards their physicians. As in other studies, this was minimized by interviewers not tied to the service and the ensured anonymity of answers.

The cross-cultural adaptation of the PDRQ-9 to the Brazilian context allowed the availability of a concise and versatile instrument in the evaluation of the DPR, especially in the PHC scenario. It can be self-administered or applied in an interview. Further studies may evaluate other properties of the scale as well as their behavior in different population strata and specific contexts. The use of the PDRQ-9 will allow the inclusion of a new dimension of the quality of health care in clinical research, in the evaluation of services, in health management, in pay for performance, and in professional training.

Acknowledgements

To Alexandre Florêncio, Elisandrea Kemper, Gerardo Alfaro, and Renato Tasca, for their institutional support through the Pan American Health Organization and for their contribution to the Mais Médicos Program Evaluation Research from which data were used in this article.

REFERENCES

Publication Dates

History