ABSTRACT
OBJECTIVE
To conduct a cost-effectiveness analysis of alternatives for rehabilitation treatment of mandibular edentulism in the context of the Brazilian Unified Health System (implant-supported total dental prosthesis versus conventional total dental prosthesis).
METHODS
A Markov model was developed to capture long-term clinical and economic outcomes. The model’s population was comprised of a hypothetical cohort of 1,000,000 patients, aged 55 years, with total mandibular edentulism and without medical contraindications for performing surgical procedures. The adopted analysis perspective was that of the Brazilian Unified Health System. Based on the proposed model, we calculated cost – in BRL, and effectiveness – measured by quality-adjusted prosthesis year (QAPY). The time horizon of the analysis was 20 years.
RESULTS
Considering a 5% discount in costs and effects, the incremental cost-effectiveness ratio of implant-supported total dental prostheses compared to conventional total dental prosthesis (BRL 464.22/QAPY) was lower than the willingness to pay threshold adopted in the model (BRL 3,050.00/QAPY).
CONCLUSIONS
The results of this economic analysis showed that the rehabilitation of mandibular edentulous patients by implant-supported total prosthesis is very cost-effective when compared to conventional complete prosthesis, considering the cost-effectiveness limits employed.
Jaw, Edentulous, rehabilitation; Dental Prosthesis, economics; Cost-Effectiveness Evaluation; Unified Health System
INTRODUCTION
Untreated edentulism is a serious public health problem, affecting approximately 276 million people worldwide. It is the main cause of disability due to oral conditions, as estimated by disability-adjusted life years (DALY)11. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566... . Edentulism is defined as an oral health condition stemming from the failure or lack of timely application of all preventive possibilities22. Elani HW, Harper S, Thomson WM, Espinoza IL, Mejia GC, Jamieson LM, et al. Social inequalities in tooth loss: a multinational comparison. Community Dent Oral Epidemiol. 2017;45(3):266-74. https://doi.org/10.1111/cdoe.12285
https://doi.org/10.1111/cdoe.12285... .
Despite the advances achieved by Brazil’s National Oral Health Policy33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Nacional de Saúde. Diretrizes da política nacional de saúde bucal. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/publicacoes/geral/diretrizes_da_politica_nacional_de_saude_bucal.pdf
http://189.28.128.100/dab/docs/publicaco... , the prevalence of this condition remains high. The National Health Survey conducted in 2013 showed that a total of 16 million Brazilians had total tooth loss44. Ministério da Saúde (BR); Instituto Brasileiro de Geografia e Estatística, Coordenação de Indicadores Sociais. Pesquisa Nacional de Saúde: 2013. Rio de Janeiro: IBGE; 2013 [cited 2018 Apr 1]. Available from: https://www.pns.icict.fiocruz.br/
https://www.pns.icict.fiocruz.br/... . Mandibular edentulism affects an even higher number of people: 31.23% adults, and 67.29% older adults over 60 years old. The reality is no different in the state of São Paulo. Although it is the richest in the country, its older adults have a high average of extracted teeth (25.87%); often requiring mandibular rehabilitation treatment (37.27%)55. Pereira AC, Frias AC, Vieira V. Pesquisa estadual de saúde bucal: relatório final. Águas de São Pedro: Livronovo; 2016 [cited 2018 Apr 1]. Available from: https://w2.fop.unicamp.br/sbsp2015/down/ebook_relatorio_SBSP_2015.pdf
https://w2.fop.unicamp.br/sbsp2015/down/... . Such information is highly relevant due to pointing out the importance of public policies for the treatment of oral diseases.
Patients with extensive dental loss who do not undergo prosthetic rehabilitation have their quality of life reduced66. Saintrain MVL, Souza EHA. Impact of tooth loss on the quality of life. Gerodontology. 2012;29(2):e632-6. https://doi.org/10.1111/j.1741-2358.2011.00535.x
https://doi.org/10.1111/j.1741-2358.2011... . This is mainly due to the effects of difficulties with chewing and eating77. Haikal DS, Batista de Paula AM, Martins AMEBL, Moreira AN, Ferreira EF. Autopercepção da saúde bucal e impacto na qualidade de vida do idoso: uma abordagem quanti-qualitativa. Cienc Saude Coletiva. 2011;16(7):3317-29. https://doi.org/10.1590/S1413-81232011000800031
https://doi.org/10.1590/S1413-8123201100... over their well-being, appearance and social life22. Elani HW, Harper S, Thomson WM, Espinoza IL, Mejia GC, Jamieson LM, et al. Social inequalities in tooth loss: a multinational comparison. Community Dent Oral Epidemiol. 2017;45(3):266-74. https://doi.org/10.1111/cdoe.12285
https://doi.org/10.1111/cdoe.12285... ,66. Saintrain MVL, Souza EHA. Impact of tooth loss on the quality of life. Gerodontology. 2012;29(2):e632-6. https://doi.org/10.1111/j.1741-2358.2011.00535.x
https://doi.org/10.1111/j.1741-2358.2011... . In this context, oral rehabilitation by prostheses can have a positive effect, as it adequately restores masticatory function and aesthetics, contributing to improvements in social interaction and quality of life88. Ali Z, Baker SR, Shahrbaf S, Martin N, Vettore MV. Oral health-related quality of life after prosthodontic treatment for patients with partial edentulism: a systematic review and meta-analysis. J Prosthet Dent. 2019;121(1):59-63.e3. https://doi.org/10.1016/j.prosdent.2018.03.003
https://doi.org/10.1016/j.prosdent.2018.... .
When it comes to the rehabilitation of patients with complete edentulism, rehabilitation with implant-supported total prosthesis (ISTP) offers greater quality of life benefits than conventional total prosthesis (CTP)99. Sivaramakrishnan G, Sridharan K. Comparison of implant supported mandibular overdentures and conventional dentures on quality of life: a systematic review and meta-analysis of randomized controlled studies. Aust Dent J. 2016;61(4):482-8. https://doi.org/10.1111/adj.12416
https://doi.org/10.1111/adj.12416... . However, although conventional total prostheses are generally less functional and have limited comfort, aesthetics, and occlusal stability, their use remains a viable and very frequent treatment option in dental clinics, especially for budget-restricted social strata1010. Xie Q, Ding T, Yang G. Rehabilitation of oral function with removable dentures: still an option? J Oral Rehabil. 2015;42(3):234-42. https://doi.org/10.1111/joor.12246
https://doi.org/10.1111/joor.12246... .
The federal government finances two oral rehabilitation alternatives for edentulous patients: CTP1111. Ministério da Saúde (BR). Portaria No 74 de 20 de Janeiro de 2004. Reajusta os valores dos incentivos financeiros às Ações de Saúde Bucal no âmbito do Programa Saúde da Família, inclui procedimento de moldagem para prótese e dá outras providências. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt0074_20_01_2004.html
http://bvsms.saude.gov.br/bvs/saudelegis... and ISTP1212. Ministério da Saúde (BR), Secretaria de Atenção à Saúde. Portaria No 718, de 20 de Dezembro de 2010. Brasília, DF; 2010 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/sas/2010/prt0718_20_12_2010.htm
http://bvsms.saude.gov.br/bvs/saudelegis... . However, dental specialty centers in Brazil are yet to effectively adhere to the provision of implant rehabilitation. Data from the first cycle of the Program for the Improvement of Access and Quality (PMAQ-CEO), held in 2014, show that only 1.8% of Brazil’s dental specialty centers have professionals working in the area of implantology. This demonstrates that, existing regulations for financing dental implants notwithstanding, additional measures need to be adopted in order to boost the supply of implant prostheses. Recently, the Ministry of Health (MS) stipulated that specialty centers that still need to implement the service should now put it into effect after a technical and budgetary analysis1313. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Geral de Saúde Bucal. Nota Técnica Nº 13/2018-CGSB/DAB/SAS/MS (SEI nº 25000.040588/2018-01). Informe acerca da Portaria nº 3.011, de 10 de novembro de 2017. Brasília, DF; 2018 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/portaldab/notas_tecnicas/NOTA_TECNICA_PORTARIA_3011_26_02_2017.pdf
http://189.28.128.100/dab/docs/portaldab... . The latter denotes the ministerial concern with financial resource allocation.
The high cost of oral health care services is recognized worldwide, and is especially problematic where public assistance programs at different levels of care are concerned1414. Tan SHX, Vernazza CR, Nair R. Critical review of willingness to pay for clinical oral health interventions. J Dent. 2017;64:1-12. https://doi.org/10.1016/j.jdent.2017.06.010
https://doi.org/10.1016/j.jdent.2017.06.... ,1515. Wall T, Vujicic M. U.S. Dental Spending Up in 2015. Health Policy Institute Research Brief. [cited 2018 Apr 1]. Available from: https://www.ada.org/~/media/ADA/Science%20and%20Research/HPI/Files/HPIBrief_1216_2.pdf?la=en
https://www.ada.org/~/media/ADA/Science%... . It is estimated that, in 2015, the global spending on dental treatments reached the sum of USD 356.80 billion, not to mention USD 187.61 billion in productivity losses caused by oral problems1616. Righolt AJ, Jevdjevic M, Marcenes W, Listl S. Global, regional, and country-level economic impacts of dental diseases in 2015. J Dent Res. 2018;97(5):501-7. https://doi.org/10.1177/0022034517750572
https://doi.org/10.1177/0022034517750572... . Considering how limited financial resources are, it is important for public health systems to use them as effectively as possible. In this sense, economic evaluation studies can help ensure efficiency, especially when indicating ways to prioritize assistance in the use the available resources1414. Tan SHX, Vernazza CR, Nair R. Critical review of willingness to pay for clinical oral health interventions. J Dent. 2017;64:1-12. https://doi.org/10.1016/j.jdent.2017.06.010
https://doi.org/10.1016/j.jdent.2017.06.... . However, no cost-effectiveness studies comparing these two implant technologies from the perspective of the Brazilian Unified Health System (SUS) were found.
Considering the relevance of the subject of edentulism in the public health sphere, as well as its high prevalence in the Brazilian population, this study evaluates the cost-effectiveness of ISTP versus CTP in rehabilitation of mandibular edentulism, specifically in the context of older adults serviced by the SUS.
METHODS
Research Question
What is the incremental cost-effectiveness ratio of implant-supported total prosthesis instead of conventional total prosthesis for mandibular edentulous rehabilitation, considering a time horizon of 20 years and the Ministry of Health’s perspective?
Study Design
A complete economic evaluation of cost-effectiveness based on mathematical modeling and built in accordance with the Economic Evaluation Guidelines of the Brazilian Network for Health Technology Assessment (Rebrats)1717. Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Ciência e Tecnologia. Diretrizes metodológicas: diretriz de avaliação econômica. 2.ed. Brasília, DF; 2014 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_metodologicas_diretriz_avaliacao_economica.pdf
http://bvsms.saude.gov.br/bvs/publicacoe... .
Perspective
This analysis adopted the perspective of the Ministry of Health, responsible for managing the SUS at a federal level.
Target Population
The model’s population was comprised of a hypothetical cohort of 1,000,000 patients, aged 55 years, with total mandibular edentulism and without medical contraindications for performing surgical procedures.
Interventions
The intervention of interest was the ISTP prosthetic rehabilitation treatment of mandibular edentulous older adults. This rehabilitation can employ different techniques, but in our model only the mandibular two-implant supported overdenture was considered, since the scientific evidence points to it as the minimum treatment indicated1818. Feine JS, Carlsson GE, Awad MA, Chehade A, Duncan WJ, Gizani A, et al. The McGill consensus statement on overdentures. Mandibular two-implant overdentures as first choice standard of care for edentulous patients. Gerodontology. 2002;19(1):3-4. https://doi.org/10.1111/j.1741-2358.2002.00003.x
https://doi.org/10.1111/j.1741-2358.2002... for the rehabilitation of edentulous mandibles.
CTP was chosen as a comparator since it is the most widespread rehabilitation technique in the SUS, and continues to be routinely used in dental practice, due to its low cost1010. Xie Q, Ding T, Yang G. Rehabilitation of oral function with removable dentures: still an option? J Oral Rehabil. 2015;42(3):234-42. https://doi.org/10.1111/joor.12246
https://doi.org/10.1111/joor.12246... .
The number of consultations required and the sequential procedures of each intervention were modelled according to the traditional protocol of techniques. Primary Care Book nº 172121. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Saúde Bucal. Brasília, DF; 2008 [cited 2018 Apr 1]. (Série A. Normas e Manuais Técnicos) (Cadernos de Atenção Básica; 17). Available from: http://bvsms.saude.gov.br/bvs/publicacoes/saude_bucal.pdf
http://bvsms.saude.gov.br/bvs/publicacoe... , which deals with issues concerning the referral of primary care SUS patients to secondary care, was also employed as a reference. These issues were considered because, although know-how on implementation of prostheses is not mandatory in specialty centers, municipalities usually have partnerships with these centers, and use them to absorb excess demand, hiring specialists who work according to production quotas agreed upon by both parties.
Discount Rate and Time Horizon
An annual discount rate of 5% for both costs and effectiveness was applied, following Rebrats guidelines1717. Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Ciência e Tecnologia. Diretrizes metodológicas: diretriz de avaliação econômica. 2.ed. Brasília, DF; 2014 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_metodologicas_diretriz_avaliacao_economica.pdf
http://bvsms.saude.gov.br/bvs/publicacoe... . Considering the Brazilian average life expectancy2222. Instituto Brasileiro de Geografia e Estatística (BR). Tábuas Completas de Mortalidade. Rio de Janeiro: IBGE; 2017 [cited 2017 Dec 3]. Available from: http://dx.doi.org/ https://www.ibge.gov.br/estatisticas-novoportal/sociais/populacao/9126-tabuas-completas-de-mortalidade.html
http://dx.doi.org/... of 75.8 years, and the durability of the assessed technologies, the time horizon of the analysis was defined as 20 years.
Model Structure
We developed a Markov model to capture the long-term clinical and economic results of implant-supported total prostheses as compared to conventional total prostheses (Figure 1). The model consists of four mutually exclusive health states: rehabilitated without complications (state A), rehabilitated with reparable damages (state B), treatment failure (state C), and non-treatment-related death (state D). Non-treatment-related death was included in the model due to the advanced age of the hypothetical cohort patients.
Model structure. Rehabilitation can employ conventional prosthesis or implant-supported total prosthesis.
The model predicts that patients may have transitioned between health states or remained in the same state at the end of the annual cycle. These transitions take place according to preassigned probabilities. Patients in state C are able to remain in that state or transition to death. Arrows indicate paths. The Markov model for each treatment was performed independently.
Input Model Parameters
Effectiveness measure
There are still few cost-effectiveness evaluations of dental interventions. It is worth pointing out that, compared to medical interventions, dentistry interventions impact effectiveness in a different way. To cite an example, dentistry interventions generally have no direct impact on mortality. Thus, the quality-adjusted life year (QALY), commonly used in medical studies’ cost-utility analyses, does not have sufficient specificity to evaluate dentistry interventions.
The quality-adjusted prosthetic year (QAPY) is a measure derived from the QALY. Its values range from 0 (absent tooth) to 1 (prosthesis in perfect condition after one year)2323. Fyffe HE, Kay EJ. Assessment of dental health state utilities. Community Dent Oral Epidemiol. 1992;20(5):269-73. https://doi.org/10.1111/j.1600-0528.1992.tb01697.x
https://doi.org/10.1111/j.1600-0528.1992... . Since it provides a more adequate representation of the clinical results of the treatments evaluated here, we chose QAPY as the measure of outcome to be used in estimating effectiveness.
The QAPY values defined in this study were obtained from the calculation proposed by Chun et al.2424. Chun JS, Har A, Lim HP, Lim HJ. The analysis of cost-effectiveness of implant and conventional fixed dental prosthesis. J Adv Prosthodont. 2016;8(1):53-61. https://doi.org/0.4047/jap.2016.8.1.53
https://doi.org/0.4047/jap.2016.8.1.53... , which considers patients’ degree of satisfaction according to aesthetics, function and phonation. Satisfaction values were obtained from a study by Farias-Neto et al.2525. Farias Neto A, Pereira BMF, Xitara RL, Germano AR, Ribeiro JAM, Mestriner Junior W, et al. The influence of mandibular implant-retained overdentures in masticatory efficiency. Gerodontology. 2012;29(2):e650-5. https://doi.org/.1111/j.1741-2358.2011.00539.x
https://doi.org/.1111/j.1741-2358.2011.0... , who investigated satisfaction in relation to both treatments in a sample of Brazilian patients. The study used the same subdivisions (dissatisfied, satisfied, and very satisfied) to rate aesthetic, functional and phonation criteria, so we were able to input its results into the formula by Chun et al.2424. Chun JS, Har A, Lim HP, Lim HJ. The analysis of cost-effectiveness of implant and conventional fixed dental prosthesis. J Adv Prosthodont. 2016;8(1):53-61. https://doi.org/0.4047/jap.2016.8.1.53
https://doi.org/0.4047/jap.2016.8.1.53... A sensitivity analysis was performed in order to investigate variation. QAPY values were 0.79 for patients who received CTP, 0.94 for patients who received ISTP, and zero for fully edentulous patients.
Costs
For the calculation of costs, the following parameters were used:
Only direct federal government costs were included, since the cost-effectiveness analysis adopted the perspective of the Ministry of Health.
Cost data were collected based on the top-down or macro-cost approach, and obtained from the SUS system known as the Sistema de Gerenciamento da Tabela de Procedimentos, Medicamentos e OPMa (SIGTAP – Management System for the Table of Procedures, Medications and OPM)2626. Ministério da Saúde (BR). Sistema de Gerenciamento da Tabela de Procedimentos, Medicamentos e OPM do SUS (SIGTAP). Brasília, DF; 2018 [cited 2018 Mar 3]. Available from: http://sigtap.datasus.gov.br/tabela-unificada/app/sec/ inicio.jsp
http://sigtap.datasus.gov.br/tabela-unif... .
Cost data for each modeled state are shown in Table 2 and expressed in BRL (year of 2018). CTP had an initial cost of BRL 196.83, compared to BRL 1,050.40 for two-implant ISTP.
Probabilities
Probabilities of transition between the model’s four different states are shown in Table 3.
Main Assumptions of the Model
The objective of this analysis was to estimate the differences in costs and effectiveness of the two treatments, calculating their incremental cost-effectiveness ratios (ICER). To this end, the following assumptions were made:
Repeat treatment in case of therapy failure was not considered, because of the substantial uncertainty regarding its efficacy and adverse events.
Durability of the implant was set at 20 years (time horizon). Replacement time for both conventional and implant-supported prosthesis was assumed to be five years, considering textbook recommendations and the normal wear of the acrylic resin. This protocol is widely used in the SUS.
The total QAPY value was assigned to state A, for both treatments. For state B, a 25% decrease in QAPY was applied, and for state C, a 50% decrease. This approach was tested in the sensitivity analysis.
There was no established value to be used as reference for the threshold willingness to pay value of the evaluated treatments. Thus, we used the per-QALY value recommended by the World Health Organization (WHO)1919. Thomason JM, Feine J, Exley C, Moynihan P, Müller F, Naert I, et al. Mandibular two implant-supported overdentures as the first-choice standard of care for edentulous patients - The York Consensus Statement. Br Dent J. 2009;207(4):185-6. https://doi.org/10.1038/sj.bdj.2009.728
https://doi.org/10.1038/sj.bdj.2009.728... . According to the WHO, a country’s per QALY spending should be between one and three times the value of its per capita gross domestic product (BRL 30,407.00 in Brazil). Thus, for a technology to be considered cost-effective, its cost may range from BRL 30,407.00 to BRL 91,221.00 per QALY. However, we infer that a QAPY should cost only a fraction of a QALY. Therefore, we assumed that it would be acceptable to pay up to 10% of the per capita GDP (BRL 3,050.00) per QAPY.
Experts Panel
A panel of experts was organized to provide feedback on the parameters used in the model, so possible disagreements concerning incorporation of data and parametric assumptions could be identified. The panel was also tasked with assessing the quality of the available data. Questions were sent by e-mail to dental surgery and dental prosthesis researchers of different Brazilian universities.
These were open questions asking for information on the success rate of the treatments, clinical phases and abandonment rates, among others. As researchers, they were also suggested to send results of studies possibly able to contribute to the construction of the model. From the responses of five researchers, the model’s data and assumptions were confirmed.
Model for Probabilistic Sensitivity Analysis
A Monte Carlo simulation with 1,000,000 iterations was performed in order to carry out probabilistic sensitivity analysis. Cost-effectiveness acceptability curves (CEACs) were presented as a decision-making approach, summarizing information on cost-effectiveness uncertainty. Analyzes were performed in Microsoft Excel, using Visual Basic for Applications.
RESULTS
Table 2 presents the costs of the treatments, including incremental cost (cost difference between the technology under analysis and the technology with lowest cost), effectiveness, incremental effectiveness and cost-effectiveness ratio (CER). The CER of each treatment is calculated by dividing its cost by its effectiveness. The ICER is calculated by dividing ISTP’s incremental cost by its incremental effectiveness; the result can then be compared to the reference strategy’s (CTP).
Compared to CTP, deterministic analysis showed that ISTP had an ICER of BRL 464.22 per QAPY. This is much lower than the threshold of 10% of GDP per capita (BRL 3,050.00) per QAPY assumed in the model, indicating that ISTP is a very cost-effective technology. The impact of uncertainty (in the adopted threshold and model parameters) over the results was evaluated in the sensitivity analysis.
Probabilistic sensitivity analysis
Results of the Monte Carlo simulations are shown in Figure 2. Each circle represents a single simulation result, and shows the incremental effects and costs of ISTP in comparison to CTP.
Incremental cost-effectiveness (implant-supported total prosthesis versus conventional total prosthesis).
This analysis showed that rehabilitation treatment with ISTP offers an increase of effectiveness for the patient (as measured in QAPY), accompanied by an incremental cost for the health system, considering the specified time horizon.
Cost-Effectiveness Acceptability Curve (CEAC)
CEAC results show that, over a time horizon of 20 years, the probability of ISTP being cost-effective is 54.15% for the BRL 250.00 threshold, 82.92% for the BRL 450.00 threshold, and 97.0% for the BRL 750.00 threshold (Figure 3). That is, the greater the willingness to invest in the technology, the more likely it is to be cost-effective. For the BRL 3,050.00 per QAPY willingness to pay threshold adopted in the model, ISTP had a 100% probability of being cost-effective.
Acceptability curves of cost-effectiveness according to the applied time horizon (20 years).
DISCUSSION
The results of this economic analysis showed that ISTP was cost-effective compared to CTP, considering the employed cost-effectiveness limits: that is, at a low incremental cost, the ISTP provides more effectiveness than CTP. This is in agreement with the differences in quality of life, adaptation, quality of mastication, and speech observed in other studies comparing the two rehabilitation techniques99. Sivaramakrishnan G, Sridharan K. Comparison of implant supported mandibular overdentures and conventional dentures on quality of life: a systematic review and meta-analysis of randomized controlled studies. Aust Dent J. 2016;61(4):482-8. https://doi.org/10.1111/adj.12416
https://doi.org/10.1111/adj.12416... ,2929. Geckili O, Bilhan H, Mumcu E, Dayan C, Yabul A, Tuncer N. Comparison of patient satisfaction, quality of life, and bite force between elderly edentulous patients wearing mandibular two implant-supported overdentures and conventional complete dentures after 4 years. Spec Care Dent. 2012;32(4):136-41. https://doi.org/10.1111/j.1754-4505.2012.00258.x
https://doi.org/10.1111/j.1754-4505.2012... .
Brazil has a human rights-based national oral health policy known as Brasil Sorridente33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Nacional de Saúde. Diretrizes da política nacional de saúde bucal. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/publicacoes/geral/diretrizes_da_politica_nacional_de_saude_bucal.pdf
http://189.28.128.100/dab/docs/publicaco... , which determines public actions for the promotion of oral health, as well as measures of prevention and recovery. In Australia, for example, public dental services (low-cost or fully subsidized) are only provided for people under the age of 18 and adults with health cards (issued by the Australian government to low-income earners and other selected groups). Chile also has a limited provision of public oral health services: in addition to basic outpatient emergency care, the country’s public health insurance is restricted to primary services for pregnant women, children up to six years of age, and adults over 60 years old3131. Gallego F, Larroulet C, Palomer L, Repetto A, Verdugo D. Socioeconomic inequalities in self-perceived oral health among adults in Chile. Int J Equity Health. 2017;16(1):23. https://doi.org/10.1186/s12939-017-0519-9
https://doi.org/10.1186/s12939-017-0519-... .
Brasil Sorridente proposes as one of its lines of action the expansion and qualification of specialized care, especially by establishing dental specialty centers and regional labs for dental prostheses33. Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Nacional de Saúde. Diretrizes da política nacional de saúde bucal. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/publicacoes/geral/diretrizes_da_politica_nacional_de_saude_bucal.pdf
http://189.28.128.100/dab/docs/publicaco... . There is also a provision for the oral rehabilitation of completely edentulous patients1111. Ministério da Saúde (BR). Portaria No 74 de 20 de Janeiro de 2004. Reajusta os valores dos incentivos financeiros às Ações de Saúde Bucal no âmbito do Programa Saúde da Família, inclui procedimento de moldagem para prótese e dá outras providências. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt0074_20_01_2004.html
http://bvsms.saude.gov.br/bvs/saudelegis... ,1212. Ministério da Saúde (BR), Secretaria de Atenção à Saúde. Portaria No 718, de 20 de Dezembro de 2010. Brasília, DF; 2010 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/sas/2010/prt0718_20_12_2010.htm
http://bvsms.saude.gov.br/bvs/saudelegis... . This reinforces the need for economic studies to be carried out in order to guide the rational and equitable allocation of available financial resources, maximizing the assisted population’s health gains.
The results of our evaluation should be interpreted in the light of certain limitations. It was challenging to accurately estimate rehabilitation costs for ISTP versus CTP. Our calculation estimate was based on the SIGTAP table2626. Ministério da Saúde (BR). Sistema de Gerenciamento da Tabela de Procedimentos, Medicamentos e OPM do SUS (SIGTAP). Brasília, DF; 2018 [cited 2018 Mar 3]. Available from: http://sigtap.datasus.gov.br/tabela-unificada/app/sec/ inicio.jsp
http://sigtap.datasus.gov.br/tabela-unif... . Even though it is the SUS reference for health procedure prices, the table is not a good representation of oral health’s current reality. According to it, for example, consultations in primary care or even some secondary care procedures are unpaid. This limitation notwithstanding, the SIGTAP table was the only available source for the specific values the federal government passes on to the municipalities that perform the procedures evaluated here. It is also worth pointing out that, by adopting the Ministry of Health’s perspective, we did not take into consideration the expense municipalities have to front in order to offer the technology to its users. However, since the municipality’s perspective is also very relevant, we have already started a micro-accounting study to estimate precisely how much municipalities would have to spend, in an attempt to estimate whether Ministry of Health support is sufficient and, if otherwise, how much would be required to pay for the procedure’s inputs.
The QAPY values for total edentulous patients were calculated according to the proposal by Chun et al.2222. Instituto Brasileiro de Geografia e Estatística (BR). Tábuas Completas de Mortalidade. Rio de Janeiro: IBGE; 2017 [cited 2017 Dec 3]. Available from: http://dx.doi.org/ https://www.ibge.gov.br/estatisticas-novoportal/sociais/populacao/9126-tabuas-completas-de-mortalidade.html
http://dx.doi.org/... The absence of studies estimating the QAPY of the completely edentulous population that has been rehabilitated by the evaluated technologies points to this study’s novelty as well as the lack of more in-depth dentistry research in the area of economic evaluations. However, it also suggests that the results presented here must be evaluated critically. Due to the multiple uncertainties regarding the parameters adopted in the model and in order to reduce them when presenting the results to the decision maker, we performed a probabilistic sensitivity analysis with one million iterations. Thus, we emphasize the need for studies that more solidly support full economic evaluations.
The lack of evidence in the literature leads us to another question: we were unable to find any reference for the per-QAPY willingness to pay threshold used in this study. As previously explained, this limitation was dealt with by assuming that it was reasonable to pay up to 10% of the national per capita GDP, according to a rationale based on the WHO-recommended per-QALY value. The determination of a willingness to pay threshold for a given technology is not simple and entails a number of issues, including the importance that the population attaches to the treatment in question, and whether the payment is sourced privately or from public health investment1414. Tan SHX, Vernazza CR, Nair R. Critical review of willingness to pay for clinical oral health interventions. J Dent. 2017;64:1-12. https://doi.org/10.1016/j.jdent.2017.06.010
https://doi.org/10.1016/j.jdent.2017.06.... . Although there is no research in Brazil evaluating the population’s willingness to pay for oral rehabilitation, a Canadian study showed that, under the hypothesis of becoming completely edentulous, individuals would be willing to pay a significant amount to receive total prostheses supported by two implants3232. Srivastava A, Feine JS, Esfandiari S. Are people who still have their natural teeth willing to pay for mandibular two-implant overdentures? J Investig Clin Dent. 2014;5(2):117-24. https://doi.org/10.1111/jicd.12057
https://doi.org/10.1111/jicd.12057... . The Canadian study corroborates the rationale adopted here.
We emphasize that Brazil’s National Oral Health Survey (SB Brazil 2020) is currently in the planning stage. It would be appropriate for the issues discussed here to be contemplated by this national research. This would strongly contribute to a better planning of future health actions. SB Brazil 2020 may also provide important data for accurately calculating QAPY in mandibular edentulous people rehabilitated via ISTP or CTP.
The findings of this economic analysis cannot be generalized to all edentulous patients, since only mandibular edentulous patients were considered. However, they can be used to guide decision making when it comes to fulfilling the needs of those who require oral rehabilitation in the SUS. It is also important to point out that these results cannot be generalized to other countries, although the model itself can be reproduced in other scenarios.
During the development of this study, we observed a large amount of reports in the literature regarding the mandible’s difficulty of adaptation to CTP1919. Thomason JM, Feine J, Exley C, Moynihan P, Müller F, Naert I, et al. Mandibular two implant-supported overdentures as the first-choice standard of care for edentulous patients - The York Consensus Statement. Br Dent J. 2009;207(4):185-6. https://doi.org/10.1038/sj.bdj.2009.728
https://doi.org/10.1038/sj.bdj.2009.728... ,2020. Das KP, Jahangiri L, Katz RV. The first-choice standard of care for an edentulous mandible: a Delphi method survey of academic prosthodontists in the United States. J Am Dent Assoc. 2012;143(8):881-9. https://doi.org/10.14219/jada.archive.2012.0292
https://doi.org/10.14219/jada.archive.20... ,2222. Instituto Brasileiro de Geografia e Estatística (BR). Tábuas Completas de Mortalidade. Rio de Janeiro: IBGE; 2017 [cited 2017 Dec 3]. Available from: http://dx.doi.org/ https://www.ibge.gov.br/estatisticas-novoportal/sociais/populacao/9126-tabuas-completas-de-mortalidade.html
http://dx.doi.org/... ,3333. Maia LS, Kornis GEM. A reorganização da atenção à saúde bucal frente aos incentivos federais: a experiência fluminense. Rev APS. 2010 [cited 2018 Mar 3];13(1):84-95. Available from: http://ojs2.ufjf.emnuvens.com.br/aps/article/view/14366
http://ojs2.ufjf.emnuvens.com.br/aps/art... ,3434. Lee JY, Kim HY, Shin SW, Bryant SR. Number of implants for mandibular implant overdentures: a systematic review. J Adv Prosthodont. 2012;4(4):204-9. https://doi.org/10.4047/jap.2012.4.4.204
https://doi.org/10.4047/jap.2012.4.4.204... . However, we did not find reports on the rate of abandonment of these prostheses or even the rate of failure of the implants in the SUS. Thus, we do not have concrete estimates on how many patients have received the treatment and ended up not using the conventional total prosthesis, or have undergone surgery and ended up having the implant biologically rejected. From the perspective of the SUS as a financer, both cases could be construed as a waste of resources.
The panel of experts informed us that, on average, 50% of patients abandon the lower CTP. If this information had been provided directly by the SUS, we would have been able to estimate how much is being spent to offer a technology that ends up being abandoned by the patient. These data would possibly show that the cost-effectiveness of ISTP is even better than anticipated, since costs with patients’ non-adaptation to CTP would also have been factored in. As there are already dental specialty centers in Brazil that offer the implant service for those who do not adapt to the conventional treatment, we intend to further pursue this line of research and carry out a primary study to obtain the data necessary to fulfill this gap.
The issue of implant technology cost-effectiveness is crucial for Brazilian dentistry researchers. When the technologies are compared in randomized clinical trials, the results are presented in an ideal context, failing to represent the reality of the various specialty centers in the country. Thus, the gathering of data on the effectiveness of these technologies, including the longitudinal monitoring of the performed treatments, would go a long way in overcoming the limitations encountered in this study’s development. We would also add that, although the experience of the Brasil Sorridente program can be considered unique, a look at this policy and its impacts on the population can serve as a reference to other countries when it comes to universal health systems’ defense of access to oral health.
We reinforce the importance of cost-effectiveness studies adopting the perspective of the SUS, especially when considering the budgetary challenges anticipated after the approval of Constitutional Amendment 95/20163535. Brasil. Emenda Constitucional no 95, de 15 de Dezembro de 2016. Altera o Ato das Disposições Constitucionais Transitórias, para instituir o Novo Regime Fiscal, e dá outras providências. Brasília, DF; 2016 [cited 2018 Apr 1]. Available from: http://www.planalto.gov.br/ccivil_03/constituicao/emendas/emc/emc95.htm
http://www.planalto.gov.br/ccivil_03/con... , establishing the country’s new fiscal regime. Based on the results found here, we conclude that the ISTP technique supported by two implants was a cost-effective means for the rehabilitation of completely mandibular edentulous patients in the SUS, as compared to CTP.
REFERENCES
- 1Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
» https://doi.org/10.1177/0022034517693566 - 2Elani HW, Harper S, Thomson WM, Espinoza IL, Mejia GC, Jamieson LM, et al. Social inequalities in tooth loss: a multinational comparison. Community Dent Oral Epidemiol. 2017;45(3):266-74. https://doi.org/10.1111/cdoe.12285
» https://doi.org/10.1111/cdoe.12285 - 3Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Nacional de Saúde. Diretrizes da política nacional de saúde bucal. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/publicacoes/geral/diretrizes_da_politica_nacional_de_saude_bucal.pdf
» http://189.28.128.100/dab/docs/publicacoes/geral/diretrizes_da_politica_nacional_de_saude_bucal.pdf - 4Ministério da Saúde (BR); Instituto Brasileiro de Geografia e Estatística, Coordenação de Indicadores Sociais. Pesquisa Nacional de Saúde: 2013. Rio de Janeiro: IBGE; 2013 [cited 2018 Apr 1]. Available from: https://www.pns.icict.fiocruz.br/
» https://www.pns.icict.fiocruz.br/ - 5Pereira AC, Frias AC, Vieira V. Pesquisa estadual de saúde bucal: relatório final. Águas de São Pedro: Livronovo; 2016 [cited 2018 Apr 1]. Available from: https://w2.fop.unicamp.br/sbsp2015/down/ebook_relatorio_SBSP_2015.pdf
» https://w2.fop.unicamp.br/sbsp2015/down/ebook_relatorio_SBSP_2015.pdf - 6Saintrain MVL, Souza EHA. Impact of tooth loss on the quality of life. Gerodontology. 2012;29(2):e632-6. https://doi.org/10.1111/j.1741-2358.2011.00535.x
» https://doi.org/10.1111/j.1741-2358.2011.00535.x - 7Haikal DS, Batista de Paula AM, Martins AMEBL, Moreira AN, Ferreira EF. Autopercepção da saúde bucal e impacto na qualidade de vida do idoso: uma abordagem quanti-qualitativa. Cienc Saude Coletiva. 2011;16(7):3317-29. https://doi.org/10.1590/S1413-81232011000800031
» https://doi.org/10.1590/S1413-81232011000800031 - 8Ali Z, Baker SR, Shahrbaf S, Martin N, Vettore MV. Oral health-related quality of life after prosthodontic treatment for patients with partial edentulism: a systematic review and meta-analysis. J Prosthet Dent. 2019;121(1):59-63.e3. https://doi.org/10.1016/j.prosdent.2018.03.003
» https://doi.org/10.1016/j.prosdent.2018.03.003 - 9Sivaramakrishnan G, Sridharan K. Comparison of implant supported mandibular overdentures and conventional dentures on quality of life: a systematic review and meta-analysis of randomized controlled studies. Aust Dent J. 2016;61(4):482-8. https://doi.org/10.1111/adj.12416
» https://doi.org/10.1111/adj.12416 - 10Xie Q, Ding T, Yang G. Rehabilitation of oral function with removable dentures: still an option? J Oral Rehabil. 2015;42(3):234-42. https://doi.org/10.1111/joor.12246
» https://doi.org/10.1111/joor.12246 - 11Ministério da Saúde (BR). Portaria No 74 de 20 de Janeiro de 2004. Reajusta os valores dos incentivos financeiros às Ações de Saúde Bucal no âmbito do Programa Saúde da Família, inclui procedimento de moldagem para prótese e dá outras providências. Brasília, DF; 2004 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt0074_20_01_2004.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt0074_20_01_2004.html - 12Ministério da Saúde (BR), Secretaria de Atenção à Saúde. Portaria No 718, de 20 de Dezembro de 2010. Brasília, DF; 2010 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/sas/2010/prt0718_20_12_2010.htm
» http://bvsms.saude.gov.br/bvs/saudelegis/sas/2010/prt0718_20_12_2010.htm - 13Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica, Coordenação Geral de Saúde Bucal. Nota Técnica Nº 13/2018-CGSB/DAB/SAS/MS (SEI nº 25000.040588/2018-01). Informe acerca da Portaria nº 3.011, de 10 de novembro de 2017. Brasília, DF; 2018 [cited 2018 Apr 1]. Available from: http://189.28.128.100/dab/docs/portaldab/notas_tecnicas/NOTA_TECNICA_PORTARIA_3011_26_02_2017.pdf
» http://189.28.128.100/dab/docs/portaldab/notas_tecnicas/NOTA_TECNICA_PORTARIA_3011_26_02_2017.pdf - 14Tan SHX, Vernazza CR, Nair R. Critical review of willingness to pay for clinical oral health interventions. J Dent. 2017;64:1-12. https://doi.org/10.1016/j.jdent.2017.06.010
» https://doi.org/10.1016/j.jdent.2017.06.010 - 15Wall T, Vujicic M. U.S. Dental Spending Up in 2015. Health Policy Institute Research Brief. [cited 2018 Apr 1]. Available from: https://www.ada.org/~/media/ADA/Science%20and%20Research/HPI/Files/HPIBrief_1216_2.pdf?la=en
» https://www.ada.org/~/media/ADA/Science%20and%20Research/HPI/Files/HPIBrief_1216_2.pdf?la=en - 16Righolt AJ, Jevdjevic M, Marcenes W, Listl S. Global, regional, and country-level economic impacts of dental diseases in 2015. J Dent Res. 2018;97(5):501-7. https://doi.org/10.1177/0022034517750572
» https://doi.org/10.1177/0022034517750572 - 17Ministério da Saúde (BR), Secretaria de Ciência, Tecnologia e Insumos Estratégicos, Departamento de Ciência e Tecnologia. Diretrizes metodológicas: diretriz de avaliação econômica. 2.ed. Brasília, DF; 2014 [cited 2018 Apr 1]. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_metodologicas_diretriz_avaliacao_economica.pdf
» http://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_metodologicas_diretriz_avaliacao_economica.pdf - 18Feine JS, Carlsson GE, Awad MA, Chehade A, Duncan WJ, Gizani A, et al. The McGill consensus statement on overdentures. Mandibular two-implant overdentures as first choice standard of care for edentulous patients. Gerodontology. 2002;19(1):3-4. https://doi.org/10.1111/j.1741-2358.2002.00003.x
» https://doi.org/10.1111/j.1741-2358.2002.00003.x - 19Thomason JM, Feine J, Exley C, Moynihan P, Müller F, Naert I, et al. Mandibular two implant-supported overdentures as the first-choice standard of care for edentulous patients - The York Consensus Statement. Br Dent J. 2009;207(4):185-6. https://doi.org/10.1038/sj.bdj.2009.728
» https://doi.org/10.1038/sj.bdj.2009.728 - 20Das KP, Jahangiri L, Katz RV. The first-choice standard of care for an edentulous mandible: a Delphi method survey of academic prosthodontists in the United States. J Am Dent Assoc. 2012;143(8):881-9. https://doi.org/10.14219/jada.archive.2012.0292
» https://doi.org/10.14219/jada.archive.2012.0292 - 21Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Básica. Saúde Bucal. Brasília, DF; 2008 [cited 2018 Apr 1]. (Série A. Normas e Manuais Técnicos) (Cadernos de Atenção Básica; 17). Available from: http://bvsms.saude.gov.br/bvs/publicacoes/saude_bucal.pdf
» http://bvsms.saude.gov.br/bvs/publicacoes/saude_bucal.pdf - 22Instituto Brasileiro de Geografia e Estatística (BR). Tábuas Completas de Mortalidade. Rio de Janeiro: IBGE; 2017 [cited 2017 Dec 3]. Available from: http://dx.doi.org/ https://www.ibge.gov.br/estatisticas-novoportal/sociais/populacao/9126-tabuas-completas-de-mortalidade.html
» http://dx.doi.org/» https://www.ibge.gov.br/estatisticas-novoportal/sociais/populacao/9126-tabuas-completas-de-mortalidade.html - 23Fyffe HE, Kay EJ. Assessment of dental health state utilities. Community Dent Oral Epidemiol. 1992;20(5):269-73. https://doi.org/10.1111/j.1600-0528.1992.tb01697.x
» https://doi.org/10.1111/j.1600-0528.1992.tb01697.x - 24Chun JS, Har A, Lim HP, Lim HJ. The analysis of cost-effectiveness of implant and conventional fixed dental prosthesis. J Adv Prosthodont. 2016;8(1):53-61. https://doi.org/0.4047/jap.2016.8.1.53
» https://doi.org/0.4047/jap.2016.8.1.53 - 25Farias Neto A, Pereira BMF, Xitara RL, Germano AR, Ribeiro JAM, Mestriner Junior W, et al. The influence of mandibular implant-retained overdentures in masticatory efficiency. Gerodontology. 2012;29(2):e650-5. https://doi.org/.1111/j.1741-2358.2011.00539.x
» https://doi.org/.1111/j.1741-2358.2011.00539.x - 26Ministério da Saúde (BR). Sistema de Gerenciamento da Tabela de Procedimentos, Medicamentos e OPM do SUS (SIGTAP). Brasília, DF; 2018 [cited 2018 Mar 3]. Available from: http://sigtap.datasus.gov.br/tabela-unificada/app/sec/ inicio.jsp
» http://sigtap.datasus.gov.br/tabela-unificada/app/sec/ inicio.jsp - 27Bilhan H, Erdogan O, Ergin S, Celik M, Ates G, Geckili O. Complication rates and patient satisfaction with removable dentures. J Adv Prosthodont. 2012;4(2):109-15. https://doi.org/10.4047/jap.2012.4.2.109
» https://doi.org/10.4047/jap.2012.4.2.109 - 28Visser A, Geertman ME, Meijer HJA, Raghoebar GM, Kwakman JM, Creugers NHJ, et al. Five years of aftercare of implant-retained mandibular overdentures and conventional dentures. J Oral Rehabil. 2002;29(2):113-20. https://doi.org/10.1046/j.1365-2842.2002.00834.x
» https://doi.org/10.1046/j.1365-2842.2002.00834.x - 29Geckili O, Bilhan H, Mumcu E, Dayan C, Yabul A, Tuncer N. Comparison of patient satisfaction, quality of life, and bite force between elderly edentulous patients wearing mandibular two implant-supported overdentures and conventional complete dentures after 4 years. Spec Care Dent. 2012;32(4):136-41. https://doi.org/10.1111/j.1754-4505.2012.00258.x
» https://doi.org/10.1111/j.1754-4505.2012.00258.x - 30Barnett T, Hoang H, Stuart J, Crocombe L. The relationship of primary care providers to dental practitioners in rural and remote Australia. BMC Health Serv Res. 2017;17(1):515. https://doi.org/10.1186/s12913-017-2473-z
» https://doi.org/10.1186/s12913-017-2473-z - 31Gallego F, Larroulet C, Palomer L, Repetto A, Verdugo D. Socioeconomic inequalities in self-perceived oral health among adults in Chile. Int J Equity Health. 2017;16(1):23. https://doi.org/10.1186/s12939-017-0519-9
» https://doi.org/10.1186/s12939-017-0519-9 - 32Srivastava A, Feine JS, Esfandiari S. Are people who still have their natural teeth willing to pay for mandibular two-implant overdentures? J Investig Clin Dent. 2014;5(2):117-24. https://doi.org/10.1111/jicd.12057
» https://doi.org/10.1111/jicd.12057 - 33Maia LS, Kornis GEM. A reorganização da atenção à saúde bucal frente aos incentivos federais: a experiência fluminense. Rev APS. 2010 [cited 2018 Mar 3];13(1):84-95. Available from: http://ojs2.ufjf.emnuvens.com.br/aps/article/view/14366
» http://ojs2.ufjf.emnuvens.com.br/aps/article/view/14366 - 34Lee JY, Kim HY, Shin SW, Bryant SR. Number of implants for mandibular implant overdentures: a systematic review. J Adv Prosthodont. 2012;4(4):204-9. https://doi.org/10.4047/jap.2012.4.4.204
» https://doi.org/10.4047/jap.2012.4.4.204 - 35Brasil. Emenda Constitucional no 95, de 15 de Dezembro de 2016. Altera o Ato das Disposições Constitucionais Transitórias, para instituir o Novo Regime Fiscal, e dá outras providências. Brasília, DF; 2016 [cited 2018 Apr 1]. Available from: http://www.planalto.gov.br/ccivil_03/constituicao/emendas/emc/emc95.htm
» http://www.planalto.gov.br/ccivil_03/constituicao/emendas/emc/emc95.htm
- aOrthesis, Prosthesis and Materials
- Funding: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Capes – PhD grant); Programa de Apoio ao Desenvolvimento Institucional do SUS (Proadi-SUS – funding of MBA course in Economics and Evaluation of Health Technologies).
Publication Dates
- Publication in this collection
19 Aug 2019 - Date of issue
2019
History
- Received
11 July 2018 - Accepted
5 Nov 2018