ABSTRACT

Objectives.

To evaluate the level of satisfaction of healthcare workers and patients with the telehealth service of the Hospital III Regional Honorio Delgado (HRHD), as well as the maturity level of the telehealth service implementation.

Materials and methods.

Cross-sectional, observational study conducted from October to December 2021. The satisfaction of healthcare workers and patients was assessed with the Glaser et al. survey and the Telemedicine Satisfaction Questionnaire (TSQ), respectively. The level of service maturity was assessed using the Pan American Health Organization's instrument for measuring the maturity level of healthcare institutions implementing telemedicine service.

Results.

A total of 129 responses were obtained from healthcare workers. Non-physician professionals' satisfaction with the telehealth service was higher than that of physicians (72.5% vs. 18.3%). Of 377 patients, 77.6% stated they were satisfied with the service. Regarding the maturity level, the HRHD telemedicine service had 32% of items in null status, 40.8% in started, 25.2% in advanced, and 2% in ready conditions.

Conclusions.

Physician satisfaction was lower than that of other health professionals. Patients had a moderate-high satisfaction. The maturity level of telehealth implementation in HRHD was oriented towards a null or initiated level. Decision-makers need to consider user satisfaction for the telehealth implementation and the follow-up.

Keywords:
Telemedicine; Remote Consultation; COVID-19; Patient Satisfaction; Health Personnel

INTRODUCTION

The COVID-19 pandemic has challenged the face-to-face care capacity of healthcare systems, forcing them to redesign and/or implement other methods of patient care via telehealth ¹1. Hawrysz L, Gierszewska G, Bitkowska A. The Research on Patient Satisfaction with Remote Healthcare Prior to and during the COVID-19 Pandemic. Int J Environ Res Public Health. 2021;18(10). doi: 10.3390/ijerph18105338.
https://doi.org/10.3390/ijerph18105338.... . According to WHO, telehealth is the delivery of health services remotely using Information and Communication Technologies (ICT) for the diagnosis, treatment, and prevention of diseases ²2. Wootton R, Geissbuhler A, Jethwani K, Kovarik C, Person DA, Vladzymyrskyy A, et al. Long-running telemedicine networks delivering humanitarian services: experience, performance and scientific output. Bull World Health Organ. 2012;90(5):341-7D. doi: 10.2471/BLT.11.099143.
https://doi.org/10.2471/BLT.11.099143... . It has advantages such as better access, optimization of resources, minimization of costs, lower risk of contagion, among others ³3. Gajarawala SN, Pelkowski JN. Telehealth Benefits and Barriers. J Nurse Pract [Internet]. 2021;17(2):218-21. doi: 10.1016/j.nurpra.2020.09.013.
https://doi.org/10.1016/j.nurpra.2020.09... . On the other hand, there are concerns about regulatory gaps, ICT infrastructure, personnel training, digital divide, security, and privacy, among others, that constitute barriers to its implementation ⁴4. Garcia Saiso S, Marti MC, Malek Pascha V, Pacheco A, Luna D, Plazzotta F, et al. Barreras y facilitadores a la implementación de la telemedicina en las Américas. Rev Panam Salud Publica. 2021;45:e131. doi: 10.26633/RPSP.2021.131.
https://doi.org/10.26633/RPSP.2021.131... . The implementation and sustainability of these services depend to a large extent on the perception and satisfaction of patients and healthcare personnel (HCP), since they are the main source of information on whether medical care is provided correctly and whether it meets their expectations ⁵5. Dinesen B, Nonnecke B, Lindeman D, Toft E, Kidholm K, Jethwani K, et al. Personalized Telehealth in the Future: A Global Research Agenda. J Med Internet Res. 2016;18(3):e53. doi: 10.2196/jmir.5257.
https://doi.org/10.2196/jmir.5257... .

Patient satisfaction is influenced by several factors, such as service delivery (availability of a specialty, frequency of care, obtaining information, outpatient, or inpatient treatment), the doctor-patient relationship and technological factors (access to the system, absence of technical problems) ¹1. Hawrysz L, Gierszewska G, Bitkowska A. The Research on Patient Satisfaction with Remote Healthcare Prior to and during the COVID-19 Pandemic. Int J Environ Res Public Health. 2021;18(10). doi: 10.3390/ijerph18105338.
https://doi.org/10.3390/ijerph18105338.... . Previous studies found high patient satisfaction, ranging from 68% to 100% ⁶6. Alharbi KG, Aldosari MN, Alhassan AM, Alshallal KA, Altamimi AM, Altulaihi BA. Patient satisfaction with virtual clinic during Coronavirus disease (COVID-19) pandemic in primary healthcare, Riyadh, Saudi Arabia. J Family Community Med. 2021;28(1):48-54. doi: 10.4103/jfcm.JFCM_353_20.
https://doi.org/10.4103/jfcm.JFCM_353_20... ^,77. Ning AY, Cabrera CI, D'Anza B. Telemedicine in Otolaryngology: A Systematic Review of Image Quality, Diagnostic Concordance, and Patient and Provider Satisfaction. Ann Otol Rhinol Laryngol. 2021;130(2):195-204. doi: 10.1177/0003489420939590.
https://doi.org/10.1177/0003489420939590... . Few studies have evaluated the satisfaction of health personnel, (satisfaction reported between 64%-81%) ⁸8. Andrews E, Berghofer K, Long J, Prescott A, Caboral-Stevens M. Satisfaction with the use of telehealth during COVID-19: An integrative review. Int J Nurs Stud Adv. 2020; 2:100008. doi: 10.1016/j.ijnsa.2020.100008.
https://doi.org/10.1016/j.ijnsa.2020.100... . It has been reported that patient satisfaction with the telehealth service through telephone calls was higher than that of health personnel ⁹9. Park H-Y, Kwon Y-M, Jun H-R, Jung S-E, Kwon S-Y. Satisfaction Survey of Patients and Medical Staff for Telephone-Based Telemedicine During Hospital Closing Due to COVID-19 Transmission. Telemed J E Health. 2021;27(7):724-32. doi: 10.1089/tmj.2020.0369.
https://doi.org/10.1089/tmj.2020.0369... . Despite the development of telehealth initiatives during the COVID-19 pandemic, few studies in Latin America and the Caribbean (LAC) have evaluated patient and/or health personnel satisfaction ¹⁰10. Quispe-Juli CU, Moquillaza-Alcántara VH, Arapa-Apaza KL. Telesalud en Latinoamérica: una mirada a los estudios registrados en clinicaltrials.gov. Rev cuba inf cienc salud [Internet]. 2019 [citado 17 de marzo de 2022];30(4). Disponible en: http://scielo.sld.cu/scielo.php?script=sci_abstract&pid=S2307-21132019000400009.
http://scielo.sld.cu/scielo.php?script=s... ; there are no studies published in indexed Peruvian journals.

Few countries in LAC have well-established telehealth policies and regulations, therefore knowing about the satisfaction of patients and health personnel - as an element of feedback - would allow redirecting regulations in order to improve healthcare via telehealth ¹¹11. Liddy C, Afkham A, Drosinis P, Joschko J, Keely E. Impact of and Satisfaction with a New eConsult Service: A Mixed Methods Study of Primary Care Providers. J Am Board Fam Med. 2015;28(3):394-403. doi: 10.3122/jabfm.2015.03.140255.
https://doi.org/10.3122/jabfm.2015.03.14... . The aim of the present study was to evaluate the level of satisfaction of health personnel and patients who received care by the telehealth service at the Hospital Regional III Honorio Delgado (HRHD) in Arequipa, Peru. The secondary objective was to evaluate the level of maturity of telehealth implementation at the HRHD.

MATERIALS AND METHODS

Study design and location

This was a cross-sectional observational study, with a descriptive approach. It was conducted at the HRHD of Arequipa, which belongs to the National Telehealth Network. The telehealth service was quickly implemented in this hospital during August 2020 due to the COVID-19 pandemic. The HRHD uses the "Teleatiendo" platform to manage appointments, record care data and other related processes. The HRHD has been recognized twice as one of the healthcare institutions with the highest number of "Teleatiendo" appointments nationwide. It is important to point out that all the services are provided via telephone calls. The earliest record found on the platform dates back to May 2021 with 4951 visits, reaching a maximum of 10,714 in January 2022 (supplementary material, Annex 1).

Population and sample

The study population consisted of HRHD HCP who provided telehealth care during the period 2020-2021 and patients who received care by the HRHD telehealth service from October 15 to December 15, 2021. The participation of the entire HCP was sought. We used stratified random sampling of patients. To calculate the sample size, the total number of patients registered in the "Teleatiendo" platform during the months of August and September (20,828 patients) was taken as reference. The calculated sample size was 377 patients, with a confidence level of 95% and a percentage frequency of the event of interest of 50%. The strata considered were: telecounseling, telemonitoring and teleconsultation (modalities of care in "Teleatiendo") with a ratio of 28/5/1. The selection of patients was random, weekly, and proportional to the strata during the study time and was carried out until the minimum calculated sample size was reached.

We included the HRHD HCP that carried out telehealth appointments during 2020-2021 and the patients who received care by the HRHD telehealth service of the department of Arequipa who had at least one appointment registered in the "Teleatiendo" platform. HCP with less than six months of telehealth care experience were excluded; patients who denied having received care by the HRHD telehealth service were excluded.

Variables and instruments

Satisfaction of the HCP was assessed with the Glasser et al. survey ¹²12. Glaser M, Winchell T, Plant P, Wilbright W, Kaiser M, Butler MK, et al. Provider satisfaction and patient outcomes associated with a statewide prison telemedicine program in Louisiana. Telemed J E Health. 2010;16(4):472-9. doi: 10.1089/tmj.2009.0169.
https://doi.org/10.1089/tmj.2009.0169... , operationalized using a Likert scale. The answer options for the first two questions were: strongly agree, agree, neutral, disagree and strongly disagree; the options for the last three questions were: completely satisfied, satisfied, neutral, dissatisfied, completely dissatisfied. Other variables we considered were: sex, age, profession, time practicing the profession (years), time of telehealth experience (months), telehealth experience prior to the pandemic, frequency of telehealth care (daily, weekly, monthly), perception of competence in the use of telehealth technology (beginner, intermediate, advanced).

Patient satisfaction was assessed with the validated and widely used Telemedicine Satisfaction Questionnaire (TSQ) ¹³13. Yip MP, Chang AM, Chan J, MacKenzie AE. Development of the Telemedicine Satisfaction Questionnaire to evaluate patient satisfaction with telemedicine: a preliminary study. J Telemed Telecare. 2003;9(1):46-50. doi: 10.1258/135763303321159693.
https://doi.org/10.1258/1357633033211596... , and was operationalized by means of a Likert scale into strongly agree, agree, neutral, disagree and strongly disagree; the last question on overall satisfaction was grouped into two categories: satisfied (strongly agree and agree) and not satisfied (neutral, disagree and strongly disagree). We also collected information on the following sociodemographic variables: health insurance, place of origin (province of Arequipa, other provinces), Internet access, "Teleatiendo" modality (telecounseling, telemonitoring and teleconsultation), attending staff (physician or non-physician, which included nurse, obstetrician, psychologist), specialty of service-providing unit (medicine, surgery, pediatrics, gynecology and obstetrics, and immunizations) and the appointment motive. For the "appointment motive" variable, we reviewed and classified the appointments registered in "Teleatiendo" for each patient according to the main activity carried out during the appointment (counseling, follow-up, or consultation), considering previous appointments and indications. Additionally, at the end of the survey, the HCP and patients were asked a free question about their comments and suggestions about the platform and care.

We used the Pan American Health Organization (PAHO) tool to measure the level of maturity of health institutions for assessing the maturity level of HRHD's teleconsultation system, which was operationalized according to the level of progress in the implementation of telemedicine services as: null (no initiative), started (with progress, but far from what is necessary), advanced (good progress) and ready (functioning at full capacity). This instrument has six dimensions: 1) organizational preparation (bases that identify issues to be resolved before moving forward with telemedicine services), 2) processes (set of operations and functions to be considered), 3) digital environment (necessary technological infrastructure), 4) human resources (institutional capacity in the areas of health services and ICT), 5) regulatory aspects (standards and procedures for the provision of Telemedicine services), 6) specialized knowledge (additional knowledge to benefit effective implementation) ¹⁴14. Organización Panamericana de la Salud. Herramienta de medición del nivel de madurez de las instituciones de salud para implementar servicios de telemedicina [Internet]. 2020 [citado 17 de marzo de 2022]. Disponible en: https://www.paho.org/es/documentos/herramienta-medicion-nivel-madurez-instituciones-salud-para-implementar-servicios.
https://www.paho.org/es/documentos/herra... .

Procedures

Permission from HRHD was requested in order to conduct the study and access the database of the HCP and telehealth user patients during October to December 2021. The surveys were conducted via telephone calls by the researchers and nine previously trained collaborators. The language of the questions was standardized based on a pilot test in order to facilitate the application of the instrument; the terms were also adapted for better understanding.

After being notified about the study by the telehealth service, the HCP were surveyed outside of working hours; in case of no response, a message was left and they were called up to five times at different moments during the day. Patients were surveyed mostly during the morning and evening, in case there was no response, they were called up to two times. The purpose of the study was explained to each respondent in order to obtain verbal consent. To reduce recall bias, patients were surveyed up to two weeks after their care. Epidemiological data and those related to the telehealth appointment were complemented with data from the "Teleatiendo" platform, which were obtained by means of a collection form.

Information on the maturity level was collected during three field visits by two observers (FBC, ALAC), who collected information through observation, dialogue with health and administrative personnel, and verification of evidentiary elements in the telehealth service, according to the PAHO instrument. Questions that were not answered by the previously established techniques were addressed through an interview with the secretary and the head of the HRHD telehealth office. The researchers met and reached consensus on the final score for each indicator.

Statistical analysis

Data was stored and processed in a Google(r) spreadsheet as well as in a Microsoft Excel 2019(r) file. Data forms with incomplete data were eliminated. Measures of central tendency and dispersion (numerical variables), and absolute and relative frequencies (categorical variables) were calculated. The chi-square test, Fisher's exact test and Mann-Whitney U test were used as appropriate to compare the groups; a value of p<0.05 was considered statistically significant. Statistical analysis was carried out with the STATA 16.0 statistical program.

Ethical Aspects

Participants were informed about the purpose of the study, then we requested verbal consent to be surveyed and recorded; no incentives were provided. Data were anonymized. This study was guided by the principles of responsible conduct in research and scientific integrity, and was approved by the Institutional Research Ethics Committee of the Avendaño Clinic (code: 017-2021-CIEI), and the Ethics Committee of the HRHD by official letter N°-261-2021 GRA/GRS/GRS/GR-HRHD/DC-OCSI, for authorization. It was also registered in the PRISA platform of the Instituto Nacional de Salud with code EI00000002465.

RESULTS

We contacted 125 physicians and 173 nonphysician professionals, of whom 60 physicians and 69 nonphysician professionals agreed to participate and responded correctly (nonresponse rate of 52% and 60.1%, respectively). Of the non-medical professionals, 60 (87%) were nurses, 5 (7.2%) obstetricians and 4 (5.8%) psychologists. The proportion of women who were non-medical professionals was higher (100%) compared to the proportion of women who were physicians (58.3%). The average work experience was 24.5 years in physicians and 28.6 years in non-physicians. The proportion of physicians with previous telehealth experience was higher than that of nonphysician professionals (20% vs 1.5%); but the number of nonphysicians working with the telehealth system on a daily basis was higher (50% vs 89.9%) (Table 1).

A total of 1,912 patients were contacted; the non-response rate was 80.3%, but this did not alter the calculated sample size (n=377); 76.7% were women and the mean age was 33.8 and 35.5 years for women and men, respectively. Most of the population had high school education. Most had comprehensive health insurance (82.2%) and were from the province of Arequipa (86.7%). The telecounseling modality was the most used (83%). Digital illiteracy (referring to the level of unawareness of new technologies and the need for support in the use of technology by patients) was found in 46.2% of the participants (Table 2).

Satisfaction of health personnel

The proportion of satisfied and completely satisfied non-physician professionals was significantly higher than that of physicians; 69.6% of non-physician professionals reported being satisfied and completely satisfied with the outcome of the telehealth appointment compared to 38.3% of physicians. Likewise, the level of satisfaction with the "Teleatiendo" platform of non-physician professionals during their last appointment was higher than that of physicians (72.4% vs. 18.3%). The same was true for the perception of the level of satisfaction by their patients in non-physician and physician professionals (87% and 28.3% respectively) (Table 3). The summary of the HCP comments and suggestions can be found in the supplementary material, Annexes 2 and 3.

Patient satisfaction

Of the total participants, 77.7% stated that they strongly agreed or agreed that they were satisfied with the telehealth service. Seven of the thirteen evaluated criteria showed high levels of satisfaction, ranging from 79.8% ("I would use telemedicine services again") to 93.6% ("I could hear the health personnel clearly"). For the remaining six, satisfaction ranged from 60.2% ("I could see the HCP as if we were meeting in person") to 75% ("I did not need help using the system") (Figure 1).

Of the satisfied patients, 76.5% were women and 83% used the telecounseling modality. The pediatrics service showed the highest degree of satisfaction compared to other services (87%), followed by gynecology and obstetrics (79.1%). The appointment motive for 54.3% of satisfied patients was "follow-up." A similar level of satisfaction was found among patients attended by medical (76.3%) and non-medical (77.7%) staff. Of the appointment motives, "consultation" had the highest proportion of dissatisfied compared to satisfied (22.2% vs 14%) patients (Table 4). A summary of patient comments and suggestions can be found in the supplementary material, Appendix 4.

Maturity level of the telehealth system

Overall, 32% of the items were found to be at the null level, 40.8% at the initiated level, 25.2% at the advanced level, and 2% at the ready level. Of the six evaluated categories, the regulatory aspects (Standards and procedures for the provision of telemedicine services) and organizational readiness (Bases that identify issues to be resolved before moving forward with telemedicine services) were mainly found at the advanced level, while the category of specialized knowledge (additional knowledge to benefit effective implementation) was found mostly at the null level (Figure 2). The complete assessment can be found in the supplementary material, Annex 5.

DISCUSSION

The satisfaction level of the nonphysician HCP was higher than that of medical staff regarding clinical decision making via teleconsultation, with appointment outcome, with the "Teleatiendo" platform, and with the perceived satisfaction of their patients. In contrast, a systematic review reports that physicians have high levels of acceptability, feasibility, and compliance with the telehealth system and that their patients seemed very satisfied with telehealth care ⁸8. Andrews E, Berghofer K, Long J, Prescott A, Caboral-Stevens M. Satisfaction with the use of telehealth during COVID-19: An integrative review. Int J Nurs Stud Adv. 2020; 2:100008. doi: 10.1016/j.ijnsa.2020.100008.
https://doi.org/10.1016/j.ijnsa.2020.100... ; however, these studies were characterized by the use of video teleconferencing. The low satisfaction of the physicians in our study may be due to the fact that they need physical examination to achieve an adequate evaluation, which is not possible when consultations are made by telephone calls. In this sense, the higher satisfaction of the non-physician HCP would be explained by the nature of their work, which is centered on tele-guidance and telemonitoring modalities, in which the telephone call is adequate or sufficient. This situation could improve if video calls were implemented in the telehealth service, since at least observation (physical examination) would be available as a basis for establishing a better clinical judgment.

Overall patient satisfaction was lower compared to studies in Latin America, which reported higher satisfaction (96% and 92.2%) ¹⁵15. Le LB, Rahal HK, Viramontes MR, Meneses KG, Dong TS, Saab S. Patient Satisfaction and Healthcare Utilization Using Telemedicine in Liver Transplant Recipients. Dig Dis Sci. 2019;64(5):1150-7. doi: 10.1007/s10620-018-5397-5.
https://doi.org/10.1007/s10620-018-5397-...

16. García-Huidobro NF, Willson EM, Sepúlveda CV, Palma RS, Cabello EP. Evaluación de satisfacción en la implementación de un nuevo sistema de telemedicina en el Servicio de Otorrinolaringología del Complejo Asistencial Dr. Sótero del Río (CASR) durante la pandemia de COVID-19. Rev otorrinolaringol cir cabeza cuello [Internet]. 2020 [citado 17 de marzo de 2022];80(4):403-10. Disponible en: http://www.scielo.cl/scielo.php?script=sci_arttext&pid=S0718-48162020000400403&lng=en&nrm=iso&tlng=en.
http://www.scielo.cl/scielo.php?script=s... ^-1717. Cortés C J, Rodríguez S GM, Velandia P AM, Cajas S LJ, Barón RA, Cajas D. Satisfacción del servicio de telemedicina en pacientes con artritis reumatoide. Rev Colomb Reumatol [Internet]. 2021 [citado 17 de marzo de 2022]. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0121812321001584.
https://linkinghub.elsevier.com/retrieve... , as well as to studies from other continents ⁸8. Andrews E, Berghofer K, Long J, Prescott A, Caboral-Stevens M. Satisfaction with the use of telehealth during COVID-19: An integrative review. Int J Nurs Stud Adv. 2020; 2:100008. doi: 10.1016/j.ijnsa.2020.100008.
https://doi.org/10.1016/j.ijnsa.2020.100... ; this could be explained by being the only type of appointment available, differences in the health system and/or greater coverage of patients' health care expectations in other countries. The higher satisfaction level was found in patients attended by the pediatrics service, followed by gynecology and obstetrics. This could be due to the advantages of telehealth for these specialties, however, the desire for future telehealth appointments would be significantly affected by their digital experience, the perceived need for physical contact, time saved in travel and access to health providers ¹⁸18. Tozour JN, Bandremer S, Patberg E, Zavala J, Akerman M, Chavez M, et al. Application of telemedicine video visits in a maternal-fetal medicine practice at the epicenter of the COVID-19 pandemic. Am J Obstet Gynecol MFM. 2021;3(6):100469. doi: 10.1016/j.ajogmf.2021.100469.
https://doi.org/10.1016/j.ajogmf.2021.10... . There was a higher level of dissatisfaction among patients attended by the surgery service, which could be due to the lack of video-call appointments ¹⁹19. Buchalter DB, Moses MJ, Azad A, Kirby DJ, Huang S, Bosco JA III, et al. Patient and Surgeon Satisfaction with Telehealth During the COVID-19 Pandemic. Bull Hosp Jt Dis [Internet]. 2020 [citado 17 de marzo de 2022];78(4):227-35. Disponible en: https://www.ncbi.nlm.nih.gov/pubmed/33207143.
https://www.ncbi.nlm.nih.gov/pubmed/3320... .

The most used modality of "Teleatiendo" was telecounseling (83.0%), which is similar to what was reported by the Peruvian telehealth network ²⁰20. Má-Cárdenas LF, Tellez-Gutierrez C, Carrasco-Buitrón A, Inglis-Cornejo AC, Romero-Arzapalo M, López-Artica C, et al. Telemonitoreo y teleorientación desarrollados por el Ministerio de Salud del Perú en tiempos de pandemia por COVID 19. An Fac Med Lima [Internet]. 2021 [citado 17 de marzo de 2022];82(1). Disponible en: https://revistasinvestigacion.unmsm.edu.pe/index.php/anales/article/view/20783.
https://revistasinvestigacion.unmsm.edu.... . On the other hand, our results differ from what was reported in Spain, where the most used modality was telemonitoring (65.9%) ²¹21. Ruiz-Romero V, Martínez-Pillado M, Torres-Domínguez Y, Acón-Royo D, De Toro-Salas A, Cruz-Villalón F, et al. Evaluación de la satisfacción del paciente en la teleconsulta durante la pandemia por COVID-19. Rev Esp Salud Publica [Internet]. 2021 [citado 17 de marzo de 2022];95(1):e1-11. Disponible en: https://medes.com/publication/160178.
https://medes.com/publication/160178... , mainly for chronic patients, in whom telehealth seems to be more effective and compatible ²²22. Oikonomidi T, Ravaud P, Barger D, Tran V-T. Preferences for Alternative Care Modalities Among French Adults With Chronic Illness. JAMA Netw Open [Internet]. 2021 [citado 17 de marzo de 2022];4(12):e2141233-e2141233. Disponible en: https://jamanetwork.com/journals/jamanetworkopen/articlepdf/2787586/oikonomidi_2021_oi_211154_1640104706.09631.pdf.
https://jamanetwork.com/journals/jamanet... . We found that the "Teleatiendo" modality differs with the reported "consultation motive;" this may be due to the change of the appointment, from the time it is requested to the final service required by the patient and registered in the "Teleatiendo" system.

Satisfaction with the "follow-up" as a consultation motive (82.0%) was similar to that reported in Portugal and Spain, probably due to a higher frequency of appointments and a better relationship with the HCP ²¹21. Ruiz-Romero V, Martínez-Pillado M, Torres-Domínguez Y, Acón-Royo D, De Toro-Salas A, Cruz-Villalón F, et al. Evaluación de la satisfacción del paciente en la teleconsulta durante la pandemia por COVID-19. Rev Esp Salud Publica [Internet]. 2021 [citado 17 de marzo de 2022];95(1):e1-11. Disponible en: https://medes.com/publication/160178.
https://medes.com/publication/160178... ^,2323. Gomes-de Almeida S, Marabujo T, Carmo-Gonçalves M. Grado de satisfacción de los pacientes de la Unidad de Salud Familiar Vitrius con la teleconsulta durante la pandemia del COVID-19. Semergen. 2021;47(4):248-55. doi: 10.1016/j.semerg.2021.01.005.
https://doi.org/10.1016/j.semerg.2021.01... . Likewise, it seems that older adult patients show less interest in telehealth follow-up ²¹21. Ruiz-Romero V, Martínez-Pillado M, Torres-Domínguez Y, Acón-Royo D, De Toro-Salas A, Cruz-Villalón F, et al. Evaluación de la satisfacción del paciente en la teleconsulta durante la pandemia por COVID-19. Rev Esp Salud Publica [Internet]. 2021 [citado 17 de marzo de 2022];95(1):e1-11. Disponible en: https://medes.com/publication/160178.
https://medes.com/publication/160178... , so it is necessary to create strategies to increase the satisfaction of this population and improve care according to their needs. The level of dissatisfaction of patients with the first appointment (22.3%) and with previous appointments (22.1%) was high, in contrast to the level of dissatisfaction of less than 7% during the first appointment reported by a previous study ²³23. Gomes-de Almeida S, Marabujo T, Carmo-Gonçalves M. Grado de satisfacción de los pacientes de la Unidad de Salud Familiar Vitrius con la teleconsulta durante la pandemia del COVID-19. Semergen. 2021;47(4):248-55. doi: 10.1016/j.semerg.2021.01.005.
https://doi.org/10.1016/j.semerg.2021.01... , this would be due to the unmet expectations of patients regarding the need for an examiner at the first appointment. Previous studies suggest models that allow a first face-to-face appointment and subsequent telehealth care ²²22. Oikonomidi T, Ravaud P, Barger D, Tran V-T. Preferences for Alternative Care Modalities Among French Adults With Chronic Illness. JAMA Netw Open [Internet]. 2021 [citado 17 de marzo de 2022];4(12):e2141233-e2141233. Disponible en: https://jamanetwork.com/journals/jamanetworkopen/articlepdf/2787586/oikonomidi_2021_oi_211154_1640104706.09631.pdf.
https://jamanetwork.com/journals/jamanet... , a proposal that should be examined in the future.

Telehealth - and digital health - can overcome geographical boundaries and contribute to improve the quality of care, accelerating progress towards universal health coverage ²⁴24. Wilson D, Sheikh A, Görgens M, Ward K. Technology and Universal Health Coverage: Examining the role of digital health. J Glob Health 2021;11:16006.. But this will only be achieved by bridging the gaps between digital services, healthcare providers and patients. Some of the digital gaps are: digital illiteracy, limited access to broadband (high-speed) internet, affordability of devices (smartphones, tablets, and computers), and difficult recruitment of patients from rural areas ²⁵25. Rodriguez JA, Shachar C, Bates DW. Digital Inclusion as Health Care-Supporting Health Care Equity with Digital-Infrastructure Initiatives. N Engl J Med. 2022;386(12):1101-1103.. Some of these gaps were evident in this study. The number of patients requiring support from a family member for telehealth appointments (more than 28%) is higher than in other studies (18% in Spain and 20% in Korea) ⁹9. Park H-Y, Kwon Y-M, Jun H-R, Jung S-E, Kwon S-Y. Satisfaction Survey of Patients and Medical Staff for Telephone-Based Telemedicine During Hospital Closing Due to COVID-19 Transmission. Telemed J E Health. 2021;27(7):724-32. doi: 10.1089/tmj.2020.0369.
https://doi.org/10.1089/tmj.2020.0369... ^,2626. Leibar Tamayo A, Linares Espinós E, Ríos González E, Trelles Guzmán C, Álvarez-Maestro M, de Castro Guerín C, et al. Evaluación de la teleconsulta en el paciente urológico durante la pandemia COVID-19. Actas Urol Esp. 2020;44(9):617-22. doi: 10.1016/j.acuro.2020.06.002.
https://doi.org/10.1016/j.acuro.2020.06.... . There was also limited use of technology and the Internet, since only 1.9% of patients made appointments via the Internet and 54.7% of patients made appointments by telephone, which takes a long time to materialize due to waiting times. This differs from other international studies, where appointments were mainly scheduled through the Internet, which showed a higher level of satisfaction ²⁷27. Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open [Internet]. 2017 [citado 17 de marzo de 2022];7(8):e016242. Disponible en: https://bmjopen.bmj.com/content/7/8/e016242.abstract.
https://bmjopen.bmj.com/content/7/8/e016... .

Satisfaction with the telehealth service provides information on whether medical care is being provided correctly and whether it meets users' expectations. It is important for decision makers to consider patient and healthcare personnel satisfaction in the standardization of action plans for telehealth implementation, improvement, and follow-up ²⁸28. Lee ES, Lee PSS, Chew EAL, Muthulingam G, Koh HL, Tan SY, et al. Video Consultations for Older Adults With Multimorbidity During the COVID-19 Pandemic: Protocol for an Exploratory Qualitative Study. JMIR Res Protoc [Internet]. 2020 [citado 17 de marzo de 2022];9(10):e22679. Disponible en: https://www.researchprotocols.org/2020/10/e22679.
https://www.researchprotocols.org/2020/1... .

There is currently no standard methodology for assessing the maturity status of a telehealth system. The Telehealth Readiness Assessment Tool (TRA) ²⁹29. Marylan Health Care Commission. Telehealth Readiness Assessment [Internet]. [citado 17 de marzo de 2022]. Disponible en: http://mhcctelehealthtool.herokuapp.com/.
http://mhcctelehealthtool.herokuapp.com/... assesses domains similar to those considered in the PAHO maturity level measurement tool, but the digital environment and regulatory operations are not included.

The items regarding regulatory aspects and organizational readiness were found to be in an advanced or ready status, indicating that the telehealth service implementation had started partially and safely ¹⁴14. Organización Panamericana de la Salud. Herramienta de medición del nivel de madurez de las instituciones de salud para implementar servicios de telemedicina [Internet]. 2020 [citado 17 de marzo de 2022]. Disponible en: https://www.paho.org/es/documentos/herramienta-medicion-nivel-madurez-instituciones-salud-para-implementar-servicios.
https://www.paho.org/es/documentos/herra... . On the other hand, the items "specialized knowledge," "human resources," "digital environment" and "processes", were in a null or initiated status, which reflects the need to plan focused actions, explained in part by the hasty implementation of digital applications in user care due to COVID-19, and the lack of standardized regulations and guidelines in the field ⁴4. Garcia Saiso S, Marti MC, Malek Pascha V, Pacheco A, Luna D, Plazzotta F, et al. Barreras y facilitadores a la implementación de la telemedicina en las Américas. Rev Panam Salud Publica. 2021;45:e131. doi: 10.26633/RPSP.2021.131.
https://doi.org/10.26633/RPSP.2021.131... ^,3030. Quispe-Juli CU. Consideraciones éticas para la práctica de la telemedicina en el Perú: desafíos en los tiempos de COVID-19. Rev Cuba Inf Cienc Salud. 2021;32(2):e1676.. International experts mention that there are factors associated with success that need to be considered, which are: the development of technical frameworks for action based on international standards, trained health workers and digitally literate health users ⁴4. Garcia Saiso S, Marti MC, Malek Pascha V, Pacheco A, Luna D, Plazzotta F, et al. Barreras y facilitadores a la implementación de la telemedicina en las Américas. Rev Panam Salud Publica. 2021;45:e131. doi: 10.26633/RPSP.2021.131.
https://doi.org/10.26633/RPSP.2021.131... , the latter two are scarce in the HRHD telehealth system.

The present study is the first to evaluate user satisfaction and the maturity level of a telehealth service implemented in a hospital in Peru, unlike other Latin American studies that studied only one service or specialty.

The main limitation for this study was the fact that the Glasser et al. instrument has not been validated; however, it was chosen because it has been used in previous studies to establish similar comparisons, and it was one of the instruments that showed the best performance compared to other instruments used in previous research, which had questions aimed at patients and not health personnel. The instruments used were designed for consultations by video call, but in the HRHD the consultations were by telephone, so some questions were adapted without substantially changing the purpose of the questions. In addition, there was a high non-response rate during sampling. Only one hospital was included, so the external reproducibility of this study is low; however, it provides a realistic approximation of what would be happening in other centers of the Peruvian National Telehealth Network.

In conclusion, the degree of satisfaction of non-medical health personnel was moderately high, in contrast to the low satisfaction of medical personnel. Patients showed a moderately high degree of satisfaction with telehealth, although barriers such as digital illiteracy and technological limitations are still obstacles to telehealth in Peru. The maturity level of telehealth implementation in HRHD is more oriented towards the initiated level, so incremental improvements will be necessary. Future research should study telehealth services in other contexts at the national level. In this regard, we recommend studies with designs that delve deeper into the research of satisfaction such as those on associated factors as well as qualitative studies. Further post-pandemic studies will be necessary to assess the evolution of patient and HCP satisfaction, as well as the status of the implementation or maturity of the telehealth system.

References

Publication Dates

History