ORIGINAL RESEARCH INVESTIGACIÓN ORIGINAL
Outsourcing versus in-house maintenance of medical devices: a longitudinal, empirical study
Mantenimiento de los dispositivos médicos, interno o mediante contratación externa: un estudio longitudinal y empírico
Antonio Miguel-Cruz; Adriana Rios-Rincón; Gregory L. Haugan
Escuela de Medicina y Ciencias de la Salud, Universidad del Rosario, Bogotá, Colombia. Send correspondence to: Antonio Miguel Cruz, email: email@example.com
OBJECTIVE: To determine what factors have a significant influence on the performance of medical device maintenance outsourcing, and to determine how the performance of external governance structures differs depending on whether a hospital is private or public.
METHODS: This was a longitudinal study of 590 maintenance transactions at 20 hospitals in Bogotá, Colombia, involving 764 medical devices and 72 maintenance service providers. Maintenance performance data (i.e., turn-around time in hours; TAT) for the service providers (either in-house or outsourced) were primarily collected over a 20-month period, from December 2009August 2011, by means of a monitoring procedure; then, a hazards model was run.
RESULTS: The availability of specific repair parts, in-stock, in the city in which the medical devices were located, had a positive impact on the performance of both internal and external governance structures. Online service also had a positive impact on both, with a stronger positive impact on the performance of internal governance than on that of external governance. For transactions governed by external structures, better performance was seen in private hospitals than in public ones. In public health institutions, internal governance showed better performance than external governance. Both internal and external governance structures showed better performance in private healthcare institutions than in public ones.
CONCLUSIONS: In public health institutions, internal governance shows better performance than external governance; this suggests that healthcare managers should reconsider the trend to eliminate in-house maintenance service staff in public healthcare institutions.
Keywords: Equipment failure; contract services; quality control; outsourced services; preventive maintenance; Colombia.
OBJETIVO: Establecer los factores que influyen significativamente en el desempeño del mantenimiento de los dispositivos médicos mediante contratación externa, y determinar cómo difiere el desempeño de las estructuras externas de gobernanza según un hospital sea privado o público.
MÉTODOS: Se realizó un estudio longitudinal de 590 transacciones de mantenimiento en 20 hospitales de Bogotá (Colombia), que incluyeron 764 dispositivos médicos y 72 proveedores de servicio de mantenimiento. Por medio de un procedimiento de vigilancia, se recopilaron principalmente datos de desempeño del mantenimiento (es decir, el plazo de entrega en horas) por parte de los proveedores del servicio (ya fuera este interno o externalizado) durante un período de 20 meses, desde diciembre del 2009 a agosto del 2011; a continuación, se aplicó un modelo de riesgos.
RESULTADOS: La disponibilidad de piezas de repuesto específicas en existencia en la misma ciudad en que se ubicaban los dispositivos médicos tuvo una repercusión positiva sobre el desempeño de ambas estructuras de gobernanza, la interna y la externa. El servicio en línea también tuvo una repercusión positiva en el desempeño de ambas estructuras; pero esta repercusión fue más intensa en el desempeño de la gobernanza interna que en el de la externa. En cuanto a las transacciones regidas por estructuras externas, se observó un mejor desempeño en los hospitales privados que en los públicos. En las instituciones de salud pública, la gobernanza interna mostró un mejor desempeño que la externa. Ambas estructuras de gobernanza mostraron un mejor desempeño en las instituciones de atención de salud privadas que en las públicas.
CONCLUSIONES: En las instituciones de salud pública, la gobernanza interna muestra un mejor desempeño que la externa; ello indica que los gerentes de atención de salud deben reconsiderar la tendencia a eliminar al personal de los servicios de mantenimiento interno de las instituciones públicas de atención de salud.
Palabras clave: Falla de equipo; servicios contratados; control de calidad; servicios externos; mantenimiento preventivo; Colombia.
Medical device maintenance increasingly demands larger sums from hospital budgets, is often outsourced, and its quality is pivotal to overall healthcare delivery. In 1996, service contracts generated approximately US$ 10 billion in revenues (1); by 2015, the global medical device outsourcing market is projected to reach US$ 42.6 billion (2), indicating continued growth (2). Yet extreme inefficiencies are generated by the anti-competitive nature of this market, both in terms of cost and quality, suggesting that although the industry is growing, maintenance service quality is not keeping pace with rising costs and sales volumes (3).
In a remarkable mapping review of the literature on maintenance outsourcing across a variety of industries, Miguel and Rios (4) found particular deficiencies (i.e., gaps) in the few studies on medical device maintenance outsourcing. Their study identified a cluster of papers that apply mathematical models to maintenance outsourcing problems, noting that while these models were proposed for specific industries, none were applied specifically to medical devices. Furthermore, weaknesses were identified in several papers that made critical assumptions that would fail to hold up in real-world applications, such as assuming that equipment does not become more likely to fail as it ages. In a second cluster of papers, identified as longitudinal-empirical studies of maintenance outsourcing problems, only five papers were found that were related to the performance measurement of medical device maintenance outsourcing (4). However, these papers did not mention any management theory to justify their findings, and discussion about the managerial implications of the findings is nonexistent, making it difficult to apply results in a meaningful way in terms of the make or buy decision paradigm. Additionally, no empirical proposal whose research was grounded in management or strategic management theory dealt in detail with the issues related to maintenance outsourcing, nor did any specifically deal with the outsourcing of medical device maintenance (5).
A study utilizing the theoretical approach, Transaction Cost Theory (TCT) (6, 7), was warranted. According to TCT, asset specificity, uncertainty, and frequency are the three main constructs along which transactions differ, with the governance structure that would prove most efficient being impacted (7, 8). More integrated governance structures should show performance advantages in transactions with high degrees of specific asset investments, in complex transactions where service provider performance is difficult to measure due to the interrelation of services, transactions with greater uncertainty (e.g., uncertainties in demand, technological changes, or supplier behavior), and transactions with high frequency (810). According to Williamson, asset specificity is represented as the most important transaction variable (7); as a result, it has been the most scrutinized and empirically tested of these variables in studies spanning several fields, including business and non-business areas (e.g., law and public policy, health economics and policy, agricultural economics policy) (8). Williamson defines asset specificity as "the degree to which the assets used to conduct an activity can be redeployed to alternative uses and by alternative users without sacrifice of productive value," (11) and notes that transactions involving highly specific assets are particularly ripe for opportunistic behavior on the part of either agent or principal. For example, if investments are made in non-substitutable, highly-specific assets by agents who are unable to easily find these elsewhere, there may be incentives for them to engage in opportunistic behavior with the power dynamics of the exchange relationship shifted in their favor.
Therefore, in an attempt to fill the gaps identified by Miguel and Rios (4), the goals of this study were to (a) determine which factors have a significant influence on the performance measurement of medical device maintenance outsourcing and (b) investigate how the performance of external governance structures differs depending on whether a hospital is private or public. The novelty of this approach lies both in its theoretical contribution and its examination of previously unexplored relationships between maintenance performance and governance selection; moreover, the model includes several control variables had been ignored by previous studies.
MATERIALS AND METHODS
This was a longitudinal study in which a primary data sample was used. Data were gathered from a primary data information source on maintenance transactions from 20 hospitals in Bogotá D.C., Colombia, from December 2009 August 2011, resulting in a total sample of 590 observations, each representing a unique maintenance transaction. The authors determined that this sample size was sufficient, using as parameters an effect size of 0.2 and a statistical power of 0.9 (P < 0.05) (12). Due to the scarcity of previous empirical and longitudinal studies on maintenance performance, a low effect size was chosen in order to be conservative. The maintenance transactions were completed by 62 external maintenance service organizations and 10 in-house clinical engineering departments. By measuring the turn-around time (in hours; TAT) for each maintenance transaction according to governance structure, it was possible to measure the performance of both internal and external governance structures.
The 590 maintenance transactions (i.e., preventive or repair work orders) in the sample were characterized according to governance structure, the basic data of the equipment being serviced, the type of healthcare institution (HospType), and the TAT or "performance." To do so, a study was first conducted characterizing the 20 hospitals' inventories to identify equipment features, including the following: obsolescence level (Obsolesc), complexity level (TComplex), equipment acquisition cost over maintenance cost (COSR), acquisition date, and the maintenance service provider in charge of the equipment, either internal or external.
Once the equipment maintenance service provider and the governance structure type (GovStr) was identified, a survey was conducted via face-to-face interviews with the managers of the maintenance service firms and each hospital's clinical engineering department. The survey recorded only the main features and services offered by both internal and external maintenance providers: company name; contract service start and end dates; experience and qualifications of the company staff, in years and by degrees obtained (TechTLevel); contract duration, in years; whether the contract was guaranteed; whether it included replacements parts; total quantity of equipment covered; number of annual visits stipulated by the contract; total number of the company's engineers and technicians; number of engineers and technicians working on the contract; distance (km) from the service provider to the hospital; the company's years of experience in the industry (CompExp); whether online maintenance services were also offered (ServLine); whether replacement stocks existed in the locality in which maintenance services were being provided (RepParCity); equipment types covered by the maintenance contract; and lastly, whether training was being provided to users and operators. Finally, the primary data on hospital equipment maintenance incidents and the performance of maintenance service organizations (both internal and external) were collected for a 20-month period from December 2009 August 2011 by means of a monitoring procedure. The variables, variable types (i.e., independent, dependent, or control), descriptions, and codifications are listed in Table 1.
Descriptive statistical analysis for all the variables was conducted. The data showed an abnormal distribution for both the dependent and independent variables. Therefore, both a Peto log rank and log rank tests on the Kaplan-Meier estimator of the independent variable groups and TAT, followed by a hazards model, were carried out. Some insight was first given by the Peto log rank and log rank tests as to whether the independent and control variable categories showed an impact on TAT. After running this series of tests separately for each covariate and TAT, objective research was conducted by building five hazards models, allowing the overall influence of the independent and control variables on maintenance performance to be quantified. The inclusion and exclusion of the variables in the hazards models was conducted first by checking for multi-collinearity with a correlation matrix between covariates (Table 2); and second, by building the hazards models according to the 'stepwise' method described by Hosmer (13). Finally, the adequacy of the model was tested.
The descriptive statistics and correlation matrix presented in Table 2 are based on the 590 maintenance transactions obtained during the monitoring process explained above. Note that the correlation coefficient between cost of maintenance service over acquisition cost ratio (COSR) and TAT is near zero (r = +0.03) (see details in Table 2), indicating that TAT and COSR are fully independent; therefore, COSR could be used as dependent variable measuring financial performance in future research. Available upon request from the corresponding author (AMC) is an appendix containing descriptive statistics for all covariates, including the standard deviation (SD), standard error (SE), mean, and median TAT associated with each covariable category calculated by the Kaplan-Meier estimator, with their Log Rank and Peto Tests. Both the cumulative survival functions and log-log survival curves showed no intersection, confirming the appropriateness of the hazard models (13).
In Table 3, Models I, II, and III present the results of the tests that examined whether an online service, the availability of spare parts in the city in which the equipment was located, and maintenance tasks conducted in private healthcare institutions improve maintenance performance in transactions governed by both internal and external structures. To test the effect of these variables on maintenance performance, adjustments were made using a hierarchical model, presented in Models I, II, and III. Note that the β1 and β2 coefficients in Model III increased compared to Model II after the introduction of TechTLevel and CompExp control variables, indicating that as expected, the technician's level of training and the company's experience have effects on maintenance performance.
In Table 4, Models IV and V present the results of the tests that examined whether or not providing online services has a stronger positive performance effect on transactions under internal governance structures than those under external governance; the performance of external governance structures is higher in transactions conducted in private hospitals than in public hospitals; and finally, in public healthcare institutions, the performance in transactions of internal governance structures will be higher than for external governance structures. Again, to test the effect of these variables on maintenance performance, adjustments were made using hierarchical model presented in Model IV and V, i.e., interactions variables (ServLine) x (Gov Str) and (HospType) x (Gov Str); and (TComplex) x (Gov Str), (Obsolesc) x (Gov Str), (COSR) x (Gov Str), (CompExp) x (Gov Str), and (TechTLevel) x (Gov Str). Notice that no statistically significant results for the effects of equipment obsolescence on TAT were obtained, indicating that for this data sample, the age of equipment had no effect on the performance of the maintenance service providers.
An excellent empirical solution to the problem investigated in this study is provided in Models I V, since the correlation coefficient (Rp,e) and the determination coefficient (R2p,e) were high, correctly classifying 95% and 46% in all of the observations in Models III and IV, respectively, with highly statistically significant P-values, providing support for each of the tests (see Table 5 for more details). An interpretation of the effects of asset specificity on the performance of the maintenance transactions by means of β coefficients and hazard ratios (HR) are summarized in Table 5, and in the results based on Tables 3 and 4.
The results show that the availability of in-city spare parts has a positive impact on the performance of both internal and external governance structures. While this may seem like an obvious relationship with clear implications, the reality is often more complicated. First, third-party maintenance providers often lack the ability to invest and stock these particular assets due to their high cost and the additional cost of storage. As a consequence, parts are ordered on an on-demand basis from an external supplier, such as the original equipment manufacturer (OEM), resulting in longer equipment downtime. Second, if the OEM does not have a formalized policy for supporting other maintenance companies, they may view other companies as competitors to their own equipment maintenance business and delay or block the sale of specific spare parts. Therefore, when selecting a governance structure for equipment maintenance, hospital managers should consider whether or not an external service provider has in-city stocks of spare parts; and contracts should include a clause addressing this issue. If external service providers do not possess in-city stocks of specific parts, and where negotiating clauses dealing with in-country spare parts fail, maintenance performance can be improved by choosing internal governance and by the hospital itself stocking spare parts. While this option may seem unfeasible because of the wide variety of spare parts and the high cost, some scholars have demonstrated choosing internal governance and keeping spare parts stocked is more efficient (14).
The present study found that online diagnostic tools had a stronger positive effect on the performance of internal governance than it did on external governance. Part of this must be due to the fact that in-house maintenance departments are located on-site, and are therefore, able to respond quickly to problems as they arise. Additionally, the vast majority of contracts with external service providers that include online diagnostic services are between healthcare institutions and the OEM. Because the OEM frequently refuses other service providers access to online diagnostic tools, they face less competition, and as a result may face less performance pressure. Surprisingly, the findings that the performance of internal governance is higher than that of external governance in cases of high asset specificity goes against one of the most common assumptions in the medical device maintenance field. Through a focus group of clinical engineers and biomedical technicians, Blumberg (1) found that many "believed that managed care had caused, and that it would cause, many hospitals to eliminate their in-house service staffs." As shown by Cruz and colleagues (15), this may be especially true in developing countries. This represents a growing trend in the healthcare industry, as maintenance services are increasingly outsourced by hospitals. However, the results of this research give strong statistical support for the finding that in situations with high levels of physical asset specificity, better performance is shown by internal governance structures. This suggests that healthcare managers should reconsider the trend to eliminate in-house maintenance service staff in healthcare institutions.
The issue of online diagnostic tools, however, presents a more complicated problem for healthcare managers. In some cases in the study, where an in-house clinical engineering department had access to online diagnostic tools, the results showed that internal governance performed better than external structures. Yet, because a monopoly is frequently maintained by the OEM over such tools in order to retain market power for its own equipment maintenance business, it is often nearly impossible for hospitals to gain access to online diagnostics while using internal governance for maintenance tasks. While it is an important finding that online diagnostic services have a stronger positive impact on internal governance performance than on external governance, the problem of access to these tools is not likely to be resolved soon.
Furthermore, the results obtained in this research lend support to the assertion that hospital type influences the performance of the selected governance structure in maintenance transactions. The findings in this research show that: (a) for transactions conducted under external governance structures, performance is higher in private hospitals than in public ones; (b) internal governance structures show performance advantages over external governance structures for public hospitals; and (c) regardless of the selection of the governance structure, maintenance performance is higher in transactions conducted in private healthcare institutions than in public ones. There may be various explanations for these results. First, from a theoretical point of view the finding that external maintenance service providers have lower performance levels in public healthcare institutions corroborates the findings of Coles and Hesterly (910), which showed that public institutions are subject to more lenient efficiency standards because the government subsidies they receive allow them to operate even if unprofitable. Therefore, they may have different incentives (i.e., political) than private organizations operating in the same market. This could also be due to a low propensity to control and monitor the maintenance performance of service providers contracted by the public sector, which is a common scenario in developing countries, such as the one in which the research was conducted. Second, the authors of the present study verified that (a) the time it takes public hospitals to pay service providers can be extremely long (e.g., in some cases up to 90 days), owing in part to internal inefficiency and a lack of operating funds to cover maintenance activities; (b) as a result, some external service providers demand advance payment of between 50%75% of the contract total, which in turn creates an environment ripe for opportunistic behavior; and (c) after reviewing the maintenance contracts between hospitals and external providers, it was observed that many contracts were incomplete, lacking safeguards or penalties in cases where the service provider failed to honor the terms of the contract.
In the context of medical device maintenance outsourcing, the authors of this paper see five specific improvement opportunities for future studies. First, new variables that affect the performance of maintenance service providers should be included in future studies. For example, the type of maintenance tasks (i.e., corrective versus preventive); the type and features of contractual relationships (i.e., contract duration, whether the contract is guaranteed, the total quantity of equipment included in the contract, and whether replacements parts are included in the contract); and the capacity of the firm to deliver the services (e.g., the number of engineers and technicians working on the contract and the total number of contracts managed by the company). Second, other types of maintenance performance transactions should be considered, such as Market (Classical Contracting), Trilateral Governance (Neoclassical Contracting), Bilateral or Unified Governance Structures (11). Third, future research might focus on which capabilities and characteristics of medical device maintenance providers affect the vertical integration or "make or buy" decisions made by the managers of healthcare institutions. More specifically, according to TCT, how asset specificity, uncertainty, and transaction frequency are affected by the decision-making processes as healthcare managers decide whether or not to outsource a maintenance service and which external provider to choose. Fourth, and most importantly, more research is needed to examine how the performance of maintenance service providers affects the quality or performance of medical services in terms of input quality (staffing or equipment), process quality (length of stay of patients, numbers of tests and procedures performed), and output quality (patient mortality/morbidity). Finally, the finding that COSR is independent of TAT presents an opportunity to complement this study by investigating the effects of asset specificity, and the impact of uncertainty and transaction frequency on financial performance, all of which are measured by COSR.
In conclusion, the most important findings of this study are: first, the external governance structures show lower performance levels in public healthcare institutions, and suggest public hospitals should use internal governance where possible; second, two of the most important selection criteria for choosing a maintenance service provider are the ability to solve problems online via remote diagnostic tools and the availability of spare parts in the same city where the equipment is located; and third, the online diagnostic tools have stronger positive performance implications for internal governance structures than for external ones.
Acknowledgements. The authors would like to thank Colciencias (Bogotá, Colombia) for financing this study through Grant Announcement 459/08. Thanks to Sandra Usaquen Perilla and Nidia Nelly Vanegas Pabón for their assistance with data collection. Finally, thanks to Milciades Ibañez Pinilla for his advice on the statistical model selection.
Conflict of interests. None.
1. Blumberg DF. New strategic directions in acquiring and outsourcing high-tech services by hospitals and implications for clinical engineering organizations and ISO. In: Dyro JF. Clinical engineering handbook. San Diego (United States): Elsevier Academic Press; 2004. Pp 13746.
2. Global Industry Analysts, Inc. Medical devices outsourcing : a global strategic business report. 2010. Available from: www.strategyr.com/Medical_Device_Outsourcing_Market_Report.asp Accessed 8 March 2012.
3. Smithson P, Dickey D. Outsourcing clinical engineering service. In: Dyro JF. Clinical engineering handbook. San Diego (United States): Elsevier Academic Press; 2004. Pp 1357.
4. Miguel CA, Rios AR. Medical device maintenance outsourcing: Have operation management research and management theories forgotten the medical engineering community? A mapping review. Eur J Oper Res. 2012; 221(1):18697.
5. Macher J, Richman BD. Transaction cost economics: an assessment of empirical research in the social sciences. Bus & Polit. 2008;19(1):163.
6. Karimi A, Rivard S, Wu S, Goyette S. An assessment of the use of transaction cost theory in information technology outsourcing. J Strategic Inf Syst . 2011;20(2):12538.
7. Williamson OE. The transaction cost of economics: the governance of contractual relations. J Law & Econ. 1979; 22(2):23361.
8. Williamson OE. The economics of organization: the transaction costs approach. AM J Sociol. 1981; 87(3):53977.
9. Coles JW, Hesterly WS. The impact of firm-specific assets and the interaction of uncertainty: an examination of make-or-buy decisions in public and private hospitals. J Econ Behav & Organ. 1998; 36(3):383409.
10. Coles JW, Hesterly WS. Transaction costs, quality, and economies of scale: examining contracting choices in the hospital industry. J Corp Finan. 1998;(4):32145.
11. Williamson OE. Strategizing, economizing and economic organization. Strategic Manage J. 1991;12, (Winter):7594
12. Portney LG, Watkins MP. Foundations of clinical research: application to practice. New Jersey: Prentice-Hall, Inc; 2000.
13. Hosmer WH, Lemeshow S, May S. Applied survival analysis regression modelling of time-to-event data. Series in Probability and Statistics. 2nd ed. New Jersey: John Wiley and Sons; 2008.
14. Miguel-Cruz A, Haugan GL, Rincon AMR. The effects of asset specificity on maintenance financial performance: an empirical application of Transaction Cost Theory to the medical device maintenance field. Eur J Oper Res. 2014 [In press] .
15. Cruz AM, Perilla SP, Pabon NN. Clustering techniques: measuring the performance of contract service providers. IEEE Eng Med Biol. 2010;29(2):11629.
Manuscript received on 15 August 2013. Revised verison accepted for publication on 6 March 2014.