ABSTRACT
OBJETIVE
To evaluate the effect of ribociclib versus endocrine therapy on productivity losses due to advanced breast cancer.
METHODS
Productivity data from the MONALEESA-7 trial, obtained from the results of the application of the Work Productivity and Activity Impairment (WPAI) questionnaire on progression-free survival state (43-month follow-up), were extrapolated to the 10,936 Brazilian prevalent cases of premenopausal women with hormone receptor positive/human epidermal growth factor receptor 2 negative (HR+/HER2-) breast cancer. Productivity loss was determined by quantifying the economic costs of workforce dropout over time in both treatment arms and by discounting the economic costs of absenteeism and presenteeism from workforce retention. A human capital approach was used.
RESULTS
Net productivity gains in the ribociclib arm were estimated at USD 4,285,525.00, representing 316,609 added work hours over 43 months and a mean of 2,009 added work weeks per year.
CONCLUSIONS
The phase III MONALEESA-7 trial productivity results applied to the Brazilian premenopausal prevalent cases of hormone receptor positive/human epidermal growth factor receptor 2 negative (HR+/HER2-) breast cancer showed that treatment with ribociclib + endocrine therapy improves workforce participation compared with endocrine therapy alone in premenopausal women with hormone receptor positive/human epidermal growth factor receptor 2 negative (HR+/HER2-) metastatic breast cancer, with potential economic gains for the Brazilian society.
DESCRIPTORS
Women; Premenopause; Breast Neoplasms, therapy; Absenteeism; Workforce, economics
INTRODUCTION
Breast cancer is the most common type of malignancy in women, accounting for 24.5% of all women11 Ferlay J, Ervik M, Lam F, Colombet M, Mery L, Piñeros M, et al. Global Cancer Observatory: cancer today. Lyon (FR): International Agency for Research on Cancer; 2020 [cited 2021 Dec 13]. Available from: https://gco.iarc.fr/today
https://gco.iarc.fr/today... . Its diagnosis is histological and typically described by the presence or absence of particular molecular receptors. Approximately 70% of breast cancers express estrogen receptor alpha (ER-α) or progesterone receptor (PR) and are referred to as hormone receptor positive (HR+)22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... . Between 10% and 20% overexpress or amplify human epidermal growth factor receptor 2 (HER2) and are referred to as HER2 positive (HER2+)22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... . Those that do not express ER-α, PR, or HER2+ are referred to as triple-negative22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... . Roughly 70% to 75% of all breast cancers are both HR+ and HER2 negative (HER2-). They are the most common type of cancer and often referred to as HR+/HER2-22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... .
Although breast cancer mortality has declined in high-income countries in the past 20 to 30 years33 DeSantis CE, Bray F, Ferlay J, Lortet-Tieulent J, Anderson BO, Jemal A. International variation in female breast cancer incidence and mortality rates. Cancer Epidemiol Biomarkers Prev. 2015;24(10):1495-506. https://doi.org/10.1158/1055-9965.EPI-15-0535
https://doi.org/10.1158/1055-9965.EPI-15... , it remains the worldwide leading cause of cancer death among women. Breast cancers become increasingly life-threatening as they progress to metastasis. Despite innovative therapies, about 30% of women with breast cancer will develop metastasis44 O’Shaughnessy J. Extending survival with chemotherapy in metastatic breast cancer. Oncologist. 2005;10 Suppl 3:20-9. https://doi.org/10.1634/theoncologist.10-90003-20
https://doi.org/10.1634/theoncologist.10... . Five-year survival in patients with early disease ranges from 94% to 99%22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... , but patients with metastasis tend to have a median survival as low as one year22 Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
https://doi.org/10.1001/jama.2018.19323... . Breast cancer has a worse prognosis among premenopausal women. Tumors tend to be more aggressive and invasive and are associated with higher recurrence and mortality55 Axelrod D, Smith J, Kornreich D, Grinstead E, Singh B, Cangiarella J, et al. Breast cancer in young women. J Am Coll Surg. 2008;206(6):1193-203. https://doi.org/10.1016/j.jamcollsurg.2007.12.026
https://doi.org/10.1016/j.jamcollsurg.20... . A study showed that premenopausal women with breast cancer, aged ≤ 40 years, had a 40% higher mortality risk than older women66 Partridge AH, Hughes ME, Warner ET, Ottesen RA, Wong YN, Edge SB, et al. Subtype-dependent relationship between young age at diagnosis and breast cancer survival. J Clin Oncol. 2016;34(27):3308-14. https://doi.org/10.1200/JCO.2015.65.8013
https://doi.org/10.1200/JCO.2015.65.8013... , and women aged ≤ 40 years with HR+/HER2- breast cancer had a two-fold higher mortality risk than older women with the same type of disease66 Partridge AH, Hughes ME, Warner ET, Ottesen RA, Wong YN, Edge SB, et al. Subtype-dependent relationship between young age at diagnosis and breast cancer survival. J Clin Oncol. 2016;34(27):3308-14. https://doi.org/10.1200/JCO.2015.65.8013
https://doi.org/10.1200/JCO.2015.65.8013... .
Productivity Burden
Women with breast cancer experience pain, fatigue, and mental health deterioration that decrease quality of life and reduce work-related productivity and participation in the workforce77 Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
https://doi.org/10.1097/JOM.000000000000... . Besides productivity losses due to premature mortality, breast cancer contributes to significant direct and indirect costs to society. Reyes et al.88 Reyes C, Engel-Nitz NM, DaCosta Byfield S, Ravelo A, Ogale S, Bancroft T, et al. Cost of disease progression in patients with metastatic breast, lung, and colorectal cancer. Oncologist. 2019;24(9):1209-18. https://doi.org/10.1634/theoncologist.2018-0018
https://doi.org/10.1634/theoncologist.20... estimated the mean annual costs of health care services for nonmetastatic and metastatic breast cancer to be USD $78,560 (SD = USD $95,874) and USD $183,337 (SD = USD $151,412), respectively, in the 2014 exchange rate88 Reyes C, Engel-Nitz NM, DaCosta Byfield S, Ravelo A, Ogale S, Bancroft T, et al. Cost of disease progression in patients with metastatic breast, lung, and colorectal cancer. Oncologist. 2019;24(9):1209-18. https://doi.org/10.1634/theoncologist.2018-0018
https://doi.org/10.1634/theoncologist.20... . Women with breast cancer are also more likely to lose their jobs77 Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
https://doi.org/10.1097/JOM.000000000000... , increasing the economic burden of treatment costs placed on society. Metastatic breast cancer places a larger burden on society than nonmetastatic disease. Yin et al.77 Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
https://doi.org/10.1097/JOM.000000000000... observed that women with metastasis had more missed work hours (101 versus 84 hours; p < 0.001) per person-quarter, were 35% less likely to be employed than women with localized disease, and, when employed, caused a mean work productivity loss of USD $30,666 per year, which is USD $6,500 more than the cost associated with lost work time of women with local or locally advanced disease77 Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
https://doi.org/10.1097/JOM.000000000000... .
Health-related Quality of Life
Besides economic losses, young women with metastatic breast cancer experience a significant decrease in health-related quality of life due to reproductive health challenges55 Axelrod D, Smith J, Kornreich D, Grinstead E, Singh B, Cangiarella J, et al. Breast cancer in young women. J Am Coll Surg. 2008;206(6):1193-203. https://doi.org/10.1016/j.jamcollsurg.2007.12.026
https://doi.org/10.1016/j.jamcollsurg.20... . With systemic treatment, many women express concerns about fertility and experience a sudden onset of menopause caused by ovarian suppression55 Axelrod D, Smith J, Kornreich D, Grinstead E, Singh B, Cangiarella J, et al. Breast cancer in young women. J Am Coll Surg. 2008;206(6):1193-203. https://doi.org/10.1016/j.jamcollsurg.2007.12.026
https://doi.org/10.1016/j.jamcollsurg.20... . They show concerns about body image and sexuality, and those who plan to have children fear how pregnancy might affect their risk of recurrence99 Dunn J, Steginga SK. Young women's experience of breast cancer: defining young and identifying concerns. Psychooncology. 2000;9(2):137-46. https://doi.org/10.1002/(sici)1099-1611(200003/04)9:2<137::aid-pon442>3.0.co;2-0
https://doi.org/10.1002/(sici)1099-1611(... . Because younger premenopausal women are likely to be in the workforce, their clinical condition or treatment can interrupt their careers and have a lasting negative effect on household income. These concerns about sexual and reproductive health, career and work, job insecurity and the uncertainty of disease recurrence indicate lower health-related quality of life and greater financial burden among younger women compared with older postmenopausal women with the same disease1010 Mor V, Malin M, Allen S. Age differences in the psychosocial problems encountered by breast cancer patients. J Natl Cancer Inst Monogr. 1994;16):191-7..
Metastatic Breast Cancer in Brazil
Incidence of breast cancer is increasing in Brazil. A 74% increase in prevalence of metastasis was noted between 2008–20181111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... . The prevalence of metastatic breast cancer is 41 per 100,000 women, with a median overall survival (OS) after metastasis diagnosis of approximately 26.2 months1111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... . Affected women have a mean five-year survival rate of 9%1111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... . Besides mortality effects, the indirect costs of breast cancer in Brazil are substantial. Pearce et al.1212 Pearce A, Sharp L, Hanly P, Barchuk A, Bray F, Cancela MC, et al. Productivity losses due to premature mortality from cancer in Brazil, Russia, India, China, and South Africa (BRICS): a population-based comparison. Cancer Epidemiol. 2018;53:27-34. https://doi.org/10.1016/j.canep.2017.12.013
https://doi.org/10.1016/j.canep.2017.12.... estimated annual productivity losses of US$350 million, in the 2012 exchange rate, from breast cancer mortality, which is the second highest economic effect among all invasive forms of cancer1212 Pearce A, Sharp L, Hanly P, Barchuk A, Bray F, Cancela MC, et al. Productivity losses due to premature mortality from cancer in Brazil, Russia, India, China, and South Africa (BRICS): a population-based comparison. Cancer Epidemiol. 2018;53:27-34. https://doi.org/10.1016/j.canep.2017.12.013
https://doi.org/10.1016/j.canep.2017.12.... . Alexandre et al.1313 Alexandre RF, Santana CF, Squiassi HB. Social and economic impact of patients with metastatic breast cancer in Brazil. Value Health. 2018;21 Suppl 1:S26. https://doi.org/10.1016/j.jval.2018.04.161
https://doi.org/10.1016/j.jval.2018.04.1... estimated annual productivity losses due to absenteeism among Brazilian women with metastatic breast cancer to be BRL 23.2 million. Losses from premature mortality were estimated to be BRL 1.37 billion and worth 15 productivity years1313 Alexandre RF, Santana CF, Squiassi HB. Social and economic impact of patients with metastatic breast cancer in Brazil. Value Health. 2018;21 Suppl 1:S26. https://doi.org/10.1016/j.jval.2018.04.161
https://doi.org/10.1016/j.jval.2018.04.1... .
Treatment of Metastatic Breast Cancer with Ribociclib
Current clinical guidelines recommend using a CDK4/6 inhibitor combined with endocrine therapy as first-line treatment for metastatic breast cancer1111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... . CDK4/6 inhibitors treat cancer by targeting cyclin-dependent kinases 4 and 6 (CDK4 and CDK6) to trigger cell arrest and halt cell cycle progression. They are essential to treat metastatic breast cancer due to their ability to improve progression-free survival (PFS) and OS in women with metastatic breast cancer, and due to their low levels of toxicity1414 Kwapisz D. Cyclin-dependent kinase 4/6 inhibitors in breast cancer: palbociclib, ribociclib, and abemaciclib. Breast Cancer Res Treat. 2017;166(1):41-54. https://doi.org/10.1007/s10549-017-4385-3
https://doi.org/10.1007/s10549-017-4385-... .
Ribociclib is an orally available CDK4/6 inhibitor that received regulatory approval from the U.S. Food and Drug Administration (FDA) for the treatment of HR+/HER2- advanced or metastatic breast cancer in postmenopausal women in August 2016. In 2018, this therapy was expanded to treat premenopausal women with metastatic breast cancer (combined with tamoxifen or an aromatase inhibitor). In Brazil, ribociclib was approved for all its indications by the Agência Nacional de Vigilância Sanitária (ANVISA – National Health Surveillance Agency) in July 2018. Ribociclib showed a significant effect on PFS and OS1414 Kwapisz D. Cyclin-dependent kinase 4/6 inhibitors in breast cancer: palbociclib, ribociclib, and abemaciclib. Breast Cancer Res Treat. 2017;166(1):41-54. https://doi.org/10.1007/s10549-017-4385-3
https://doi.org/10.1007/s10549-017-4385-... . Patients receiving ribociclib combined with fulvestrant showed longer PFS than those receiving fulvestrant alone (median, 20.5 versus 12.8 months; hazard ratio, 0.59; 95% confidence interval, 0.48 to 0.73; p < 0.001)1515 Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Phase III randomized study of ribociclib and fulvestrant in hormone receptor-positive, human epidermal growth factor receptor 2-negative advanced breast cancer: MONALEESA-3. J Clin Oncol. 2018;36(24):2465-72. https://doi.org/10.1200/JCO.2018.78.9909
https://doi.org/10.1200/JCO.2018.78.9909... , and 28% lower mortality risk1616 Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Overall survival with ribociclib plus fulvestrant in advanced breast cancer. N Engl J Med. 2020;382(6):514-24. https://doi.org/10.1056/NEJMoa1911149
https://doi.org/10.1056/NEJMoa1911149... . We observed a 29% mortality reduction in the ribociclib arm (p = 0.00973)1717 Im SA, Lu YS, Bardia A, Harbeck N, Colleoni M, Franke F, et al. Overall survival with ribociclib plus endocrine therapy in breast cancer. N Engl J Med. 2019;381(4):307-16. https://doi.org/10.1056/NEJMoa1903765
https://doi.org/10.1056/NEJMoa1903765... in the MONALEESA-7 trial with premenopausal and perimenopausal women. A total of 70.2% of the patients randomized to ribociclib + endocrine therapy were alive at 42 months compared with 46.0% of the patients alive in the endocrine therapy alone group1818 Tripathy D, Im SA, Colleoni M, Franke F, Bardia A, Harbeck N, et al. Ribociclib plus endocrine therapy for premenopausal women with hormone-receptor-positive, advanced breast cancer (MONALEESA-7): a randomised phase 3 trial. Lancet Oncol. 2018;19(7):904-15. https://doi.org/10.1016/S1470-2045(18)30292-4
https://doi.org/10.1016/S1470-2045(18)30... .
Considering its efficacy, the inaccessibility to ribociclib in Brazil will lead to higher mortality and impaired quality of life in patients with metastatic breast cancer. Reinert et al.1919 Reinert T, Pellegrini R, Barrios CH. Lack of access to CDK4/6 inhibitors for premenopausal patients with metastatic breast cancer in Brazil: estimation of the number of premature deaths. Ecancermedicalscience. 2020;14:1081. https://doi.org/10.3332/ecancer.2020.1081
https://doi.org/10.3332/ecancer.2020.108... estimated that administering ribociclib combined with endocrine therapy to one-year incident cases of HR+/HER2- metastatic breast cancer in Brazil would prevent 538 deaths over six years, compared with endocrine therapy alone. Our study complements Reinert et al.1919 Reinert T, Pellegrini R, Barrios CH. Lack of access to CDK4/6 inhibitors for premenopausal patients with metastatic breast cancer in Brazil: estimation of the number of premature deaths. Ecancermedicalscience. 2020;14:1081. https://doi.org/10.3332/ecancer.2020.1081
https://doi.org/10.3332/ecancer.2020.108... by estimating productivity gains that would benefit the Brazilian society due to access to ribociclib.
METHODS
The study was exempted from the research ethics committee approval due to the secondary nature of the data used for analysis. We did not have access to any information allowing the identification of patients, only to the results of the questionnaires.
We extrapolated productivity data from the MONALEESA-7 trial to a 2020 prevalent HR+/HER2- metastatic breast cancer cohort in Brazil and estimated productivity gains that would benefit premenopausal women receiving ribociclib as first-line therapy for HR+/HER2- metastatic breast cancer. Productivity losses were defined as the result of permanent workforce dropout minus productivity losses due to absenteeism and presenteeism. These estimates were obtained from the results of the application of the Work Productivity and Activity Impairment (WPAI) questionnaire, as recommended by the second panel on cost-effectiveness in health and medicine2020 Neumann PJ, Ganiats TG, Russell LB, Sanders GD, Siegel JE, editors. Cost-effectiveness in health and medicine. 2. ed. New York: Oxford University Press; 2016.. Our analysis was based on the summarized individual patient data of MONALEESA-7 trial and was limited to the progression-free period, i.e., for as long as patients continued to receive ribociclib or placebo.
MONALEESA-7 Trial
MONALEESA-7 was an international, randomized, double-blind, placebo-controlled, phase III trial that compared ribociclib with placebo, combined with tamoxifen or a nonsteroidal aromatase inhibitor (NSAI) and goserelin, as first-line therapy in premenopausal patients with HR+/HER2- advanced breast cancer1818 Tripathy D, Im SA, Colleoni M, Franke F, Bardia A, Harbeck N, et al. Ribociclib plus endocrine therapy for premenopausal women with hormone-receptor-positive, advanced breast cancer (MONALEESA-7): a randomised phase 3 trial. Lancet Oncol. 2018;19(7):904-15. https://doi.org/10.1016/S1470-2045(18)30292-4
https://doi.org/10.1016/S1470-2045(18)30... . The primary objective was to assess PFS in both comparator arms and the secondary was OS. The trial examined work productivity and activity impairment as secondary objectives. Table 1 shows the clinical and demographic characteristics of study participants.
Participants
The study population included premenopausal or perimenopausal women aged 18-59 years diagnosed with HR+/HER2- advanced breast cancer who had not received prior hormone therapy and had adequate bone marrow and organ function. Women with inflammatory breast disease, central nervous system metastases, HIV, or other severe chronic conditions were excluded from the study.
Treatment
Patients were randomly assigned in a 1:1 ratio to one of the following treatment arms: ribociclib arm – patients received ribociclib + tamoxifen or an NSAI (letrozole or anastrozole) + goserelin; placebo arm – patients received placebo + tamoxifen or an NSAI (letrozole or anastrozole) + goserelin. According to the study protocol, participants continued to receive the study medicines until disease progression (or death).
The Work Productivity and Activity Impairment (WPAI) Questionnaire
The WPAI questionnaire is a validated patient-reported outcome instrument used to measure the following productivity components: workforce participation, absenteeism, presenteeism, and impairment in daily life activities2121 Reilly MC, Zbrozek AS, Dukes EM. The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics. 1993;4(5):353-65. https://doi.org/10.2165/00019053-199304050-00006
https://doi.org/10.2165/00019053-1993040... . Details of questionnaire items and scoring systems have been covered elsewhere2121 Reilly MC, Zbrozek AS, Dukes EM. The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics. 1993;4(5):353-65. https://doi.org/10.2165/00019053-199304050-00006
https://doi.org/10.2165/00019053-1993040... . In this study, the WPAI questionnaire was administered at treatment initiation/screening and bi-monthly to participants who remained progression free.
Productivity Estimation
Productivity loss was estimated by quantifying the economic costs of workforce dropout over time in both treatment arms and by discounting the economic costs of absenteeism and presenteeism from workforce retention. A human capital approach was used to estimate productivity losses. This approach assumes that productivity contributions to society lost due to illness or death are irreplaceable2020 Neumann PJ, Ganiats TG, Russell LB, Sanders GD, Siegel JE, editors. Cost-effectiveness in health and medicine. 2. ed. New York: Oxford University Press; 2016.. Therefore, productivity loss is estimated as the cost of an individual's work when they are out of the workforce, regardless of replacement by substitute workers. The human capital approach is recommended for productivity estimation by the second panel on cost-effectiveness in health and medicine2020 Neumann PJ, Ganiats TG, Russell LB, Sanders GD, Siegel JE, editors. Cost-effectiveness in health and medicine. 2. ed. New York: Oxford University Press; 2016..
Because the WPAI questionnaire was administered to participants at baseline and bi-monthly thereafter, it was possible to track workforce participation during the treatment period. Workforce dropout over time was defined as the percentage reduction of formally employed participants at baseline. Absenteeism was defined as the percentage of time formally employed participants spent away from work due to illness. Presenteeism was defined as the percentage of time formally employed participants spent away from work tasks while at work due to illness2020 Neumann PJ, Ganiats TG, Russell LB, Sanders GD, Siegel JE, editors. Cost-effectiveness in health and medicine. 2. ed. New York: Oxford University Press; 2016.. Absenteeism, presenteeism and workforce dropout figures from the MONALEESA-7 trial were subsequently extrapolated to a premenopausal population-based1111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... cohort of the prevalence of women with HR+/HER2- metastatic breast cancer in Brazil in 2020, representing 39% of breast cancer prevalent cases in Brazil (n = 10,936)1919 Reinert T, Pellegrini R, Barrios CH. Lack of access to CDK4/6 inhibitors for premenopausal patients with metastatic breast cancer in Brazil: estimation of the number of premature deaths. Ecancermedicalscience. 2020;14:1081. https://doi.org/10.3332/ecancer.2020.1081
https://doi.org/10.3332/ecancer.2020.108... . All costs were estimated in Brazilian reals and converted to 2020 U.S. dollars at the prevailing exchange rate of USD $1 = BRL 5.3, obtained from the Brazilian Central Bank website calculator2222 Banco Central do Brasil. Conversor de moedas. Brasília, DF: BCB; 2020[cited 2021 Apr 16]. Available from: https://www.bcb.gov.br/conversao23.
https://www.bcb.gov.br/conversao23... .
Statistical Analysis
The annual costs of workforce dropout over time in both treatment arms were estimated by multiplying a worker's payment in Brazil by the extrapolated number of patients who would leave the workforce over time. The 44-hour work per week established in Brazil and a mean daily wage rate of USD $13.54 were applied. The mean daily wage rate was estimated based on the results from the first quarter of 2020 reported by the National Household Sample Survey2323 Instituto Brasileiro de Geografia e Estatística. Sistema de Recuperação Automática (SIDRA). Rio de Janeiro (BR): IBGE; 2020 [cited 2021 Apr 16]. Available from: https://sidra.ibge.gov.br/pesquisa/pnadcm/tabelas
https://sidra.ibge.gov.br/pesquisa/pnadc... . The monetary value of productivity losses due to absenteeism was determined by multiplying the number of missed workdays in each month by the mean daily wage rate in Brazil and by the extrapolated number of formally employed patients in each treatment arm. Presenteeism was estimated by discounting the economic value of workdays from the proportion of time of each workday spent not working at the workplace due to illness.
RESULTS
At baseline in the MONALEESA-7 trial, 35.7% and 40.4% of women in the ribociclib and placebo arms, respectively, reported being formally employed. We applied the 38.1% mean of this sample to estimate the proportion of women with HR+/HER2- metastatic breast cancer in Brazil who participated in the workforce. By the end of the study (median of 43 months), 12.8% and 6.0% of participants in the respective treatment arms remained progression free. Figure 1 shows workforce dropout over time in the MONALEESA-7 trial.
Extrapolation to a Brazilian Prevalence Cohort
We applied the rate of workforce dropout obtained in the MONALEESA-7 trial to a Brazilian population-based cohort of 10,936 premenopausal women with HR+/HER2- metastatic breast cancer1111 Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
https://doi.org/10.1200/JGO.19.00404... ,1919 Reinert T, Pellegrini R, Barrios CH. Lack of access to CDK4/6 inhibitors for premenopausal patients with metastatic breast cancer in Brazil: estimation of the number of premature deaths. Ecancermedicalscience. 2020;14:1081. https://doi.org/10.3332/ecancer.2020.1081
https://doi.org/10.3332/ecancer.2020.108... . Table 2 shows the results over the treatment period in both comparator arms. Productivity losses due to workforce dropout over the 43-month treatment period were estimated at USD $111,443,068.85 for women treated with ribociclib + endocrine therapy and $124,822,445.64 for those treated with placebo + endocrine therapy, which results in productivity gains of USD $13,379,376.79 in favor of treatment with add-on ribociclib. However, productivity losses due to absenteeism and presenteeism were higher in the ribociclib arm. Estimated costs for absenteeism were USD $12,423,315.29 in the ribociclib arm and USD $7,133,598.11 in the placebo arm, and USD $11,295,708.67 and USD $7,491,574.06, respectively, for presenteeism. In total, net productivity gains of USD $4,285,525.00 were achieved in the ribociclib arm, and this would result in 316,609 added work hours over 43 months – a mean of 2,009 added work weeks per year (Table 3).
Breakdown of productivity losses in U.S. dollarsa by treatment arm extrapolated to a Brazilian population-based cohort of 10,936 women with HR+/HER2- metastatic breast cancer.
Breakdown of net productivity gains in U.S. dollarsa in the ribociclib arm extrapolated to a Brazilian population-based cohort of 10,936 women with HR+/HER2- metastatic breast cancer.
DISCUSSION
This study assessed productivity gains from treating premenopausal women with HR+/HER2- metastatic breast cancer in Brazil with ribociclib. The results showed that women treated with ribociclib remained in the workforce at a higher rate than women treated with endocrine therapy alone, and this could lead to productivity gains of USD $13,379,376.79 over 43 months. Productivity losses associated with metastatic breast cancer in younger women must be measured, and previous studies report the negative effect of breast cancer on productivity77 Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
https://doi.org/10.1097/JOM.000000000000... ,88 Reyes C, Engel-Nitz NM, DaCosta Byfield S, Ravelo A, Ogale S, Bancroft T, et al. Cost of disease progression in patients with metastatic breast, lung, and colorectal cancer. Oncologist. 2019;24(9):1209-18. https://doi.org/10.1634/theoncologist.2018-0018
https://doi.org/10.1634/theoncologist.20... ,1212 Pearce A, Sharp L, Hanly P, Barchuk A, Bray F, Cancela MC, et al. Productivity losses due to premature mortality from cancer in Brazil, Russia, India, China, and South Africa (BRICS): a population-based comparison. Cancer Epidemiol. 2018;53:27-34. https://doi.org/10.1016/j.canep.2017.12.013
https://doi.org/10.1016/j.canep.2017.12.... ,1313 Alexandre RF, Santana CF, Squiassi HB. Social and economic impact of patients with metastatic breast cancer in Brazil. Value Health. 2018;21 Suppl 1:S26. https://doi.org/10.1016/j.jval.2018.04.161
https://doi.org/10.1016/j.jval.2018.04.1... . Productivity losses from metastatic breast cancer place a significant economic burden on patients and on society in general. Women with advanced breast cancer cause a mean of USD $6,166 (SD, USD $9,194) in short-term disability costs per year, compared with only USD $558 (SD, USD $2,487) for healthy controls2424 Wan Y, Gao X, Mehta S, Wang Z, Faria C, Schwartzberg L. Indirect costs associated with metastatic breast cancer. J Med Econ. 2013;16(10):1169-78. https://doi.org/10.3111/13696998.2013.826228
https://doi.org/10.3111/13696998.2013.82... . Short-term disability costs are 47% higher in women with metastatic breast cancer than in those with early breast disease2424 Wan Y, Gao X, Mehta S, Wang Z, Faria C, Schwartzberg L. Indirect costs associated with metastatic breast cancer. J Med Econ. 2013;16(10):1169-78. https://doi.org/10.3111/13696998.2013.826228
https://doi.org/10.3111/13696998.2013.82... . In the United States, total productivity loss from missed home and work productivity was estimated at U$313 million per year, in the 2015 exchange rate, in a population-based cohort of women aged 18-64 years, while productivity loss from years of potential life lost was USD $5.7 billion2525 Ekwueme DU, Trogdon JG, Khavjou OA, Guy GP Jr. Productivity costs associated with breast cancer among survivors aged 18-44 years. Am J Prev Med. 2016;50(2):286-94. https://doi.org/10.1016/j.amepre.2015.10.006
https://doi.org/10.1016/j.amepre.2015.10... . A recent study estimating social costs due to work productivity loss, with ribociclib + endocrine therapy among premenopausal women with HR+/HER2- advanced breast cancer, has also been conducted from the Brazilian perspective. In that study, the same data of MONALEESA-7 trial were used but extrapolated to women at the retirement age of 62 years. Thus, the study showed that ribociclib + endocrine therapy would potentially yield BRL 71.61 million less social costs than endocrine therapy alone2626 Curteis T, Chandiwana D, Pathak P, Lanoue B, Buehler A, Pencheva R, et al. Analysis of societal costs due to work productivity loss and activity impairment from the Monaleesa-7 trial of ribociclib + endocrine therapy (ET) in premenopausal women with HR+/HER2– advanced breast cancer (ABC) in Brazil. Value Health. 2021;24 Suppl 1:S27. https://doi.org/10.1016/j.jval.2021.04.137
https://doi.org/10.1016/j.jval.2021.04.1... .
Results from this study complement existing evidence on the suitability and importance of ribociclib as an add-on treatment. Treatment with ribociclib can benefit premenopausal women, as well as all women with HR+/HER2- advanced breast cancer and in first and second lines of treatment. In studies of postmenopausal women, MONALEESA-22727 Hortobagyi GN, Stemmer SM, Burris HA, Yap YS, Sonke GS, Paluch-Shimon S, et al. Updated results from MONALEESA-2, a phase III trial of first-line ribociclib plus letrozole versus placebo plus letrozole in hormone receptor-positive, HER2-negative advanced breast cancer. Ann Oncol. 2018;29(7):1541-7. https://doi.org/10.1093/annonc/mdy155
https://doi.org/10.1093/annonc/mdy155... and MONALEESA-31515 Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Phase III randomized study of ribociclib and fulvestrant in hormone receptor-positive, human epidermal growth factor receptor 2-negative advanced breast cancer: MONALEESA-3. J Clin Oncol. 2018;36(24):2465-72. https://doi.org/10.1200/JCO.2018.78.9909
https://doi.org/10.1200/JCO.2018.78.9909... ,1616 Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Overall survival with ribociclib plus fulvestrant in advanced breast cancer. N Engl J Med. 2020;382(6):514-24. https://doi.org/10.1056/NEJMoa1911149
https://doi.org/10.1056/NEJMoa1911149... , the addition of ribociclib to endocrine therapy promoted significant gains in PFS and OS, with maintenance of health-related quality of life. Moreover, in premenopausal women, the MONALEESA-7 trial showed that ribociclib + an aromatase inhibitor benefitted patients’ quality of life, decreasing the time to deterioration of quality of life and pain by > 10%2828 Harbeck N, Franke F, Villanueva-Vazquez R, Lu YS, Tripathy D, Chow L, et al. Health-related quality of life in premenopausal women with hormone-receptor-positive, HER2-negative advanced breast cancer treated with ribociclib plus endocrine therapy: results from a phase III randomized clinical trial (MONALEESA-7). Ther Adv Med Oncol. 2020;12:1758835920943065. https://doi.org/10.1177/1758835920943065
https://doi.org/10.1177/1758835920943065... . These findings indicate that treatment with ribociclib may substantially improve social value and emphasize the need for new, innovative medicines to improve the quality of life of women with HR+/HER2- advanced breast cancer, as well as to prolong OS. Therefore, ribociclib reaches 100% of the objectives of a palliative treatment by prolonging patients’ life, improved quality of life, and postponing the need for chemotherapy. This clinical differentiation of ribociclib compared to other CDK4/6 inhibitors was recognized by the European Society for Medical Oncology (ESMO), in which ribociclib was the only CDK4/6 inhibitor that reached a maximum score of 5/5 on the clinical benefit magnitude scale in its latest guideline update2929 Cardoso F, Paluch-Shimon S, Senkus E, Curigliano G, Aapro MS, Andre F, et al. 5th ESO-ESMO international consensus guidelines for advanced breast cancer (ABC 5). Ann Oncol. 2020;31(12):1623-49. https://doi.org/10.1016/j.annonc.2020.09.010
https://doi.org/10.1016/j.annonc.2020.09... .
The estimates from this study are considered conservative. Our estimates were limited to the progression-free period aligned with the primary objective of the MONALESSA-7 trial1818 Tripathy D, Im SA, Colleoni M, Franke F, Bardia A, Harbeck N, et al. Ribociclib plus endocrine therapy for premenopausal women with hormone-receptor-positive, advanced breast cancer (MONALEESA-7): a randomised phase 3 trial. Lancet Oncol. 2018;19(7):904-15. https://doi.org/10.1016/S1470-2045(18)30292-4
https://doi.org/10.1016/S1470-2045(18)30... ,2828 Harbeck N, Franke F, Villanueva-Vazquez R, Lu YS, Tripathy D, Chow L, et al. Health-related quality of life in premenopausal women with hormone-receptor-positive, HER2-negative advanced breast cancer treated with ribociclib plus endocrine therapy: results from a phase III randomized clinical trial (MONALEESA-7). Ther Adv Med Oncol. 2020;12:1758835920943065. https://doi.org/10.1177/1758835920943065
https://doi.org/10.1177/1758835920943065... . Since ribociclib significantly prolongs OS compared to endocrine therapy alone, our study ignores productivity gains that would benefit from years of potential life lost and net productivity gains that would benefit in the post-progression period. By focusing only on the progression-free period, our study adopts a national payer and social perspective to answer how much the Brazilian society would benefit from treatment with ribociclib. It also addresses questions on whether clinical end points, such as PFS, are meaningful to patients’ experiences and daily functioning. Studies further exploring the association between clinical end points and quality of life in women treated with ribociclib are underway.
To our knowledge, the MONALEESA-7 trial is the first to monitor patients’ employment status and work functioning prospectively for an extended period. The WPAI questionnaire was administered monthly for 43 months, and we observed high completion rates in the trial: 99% at baseline and 98% at the end of treatment. This shows the acceptability of the WPAI questionnaire by patients and support the arguments by Basch3030 Basch E. High compliance rates with patient-reported outcomes in oncology trials submitted to the US Food and Drug Administration. J Natl Cancer Inst. 2019;111(5):437-9. https://doi.org/10.1093/jnci/djy183
https://doi.org/10.1093/jnci/djy183... that patients with metastatic cancer are willing to provide patient-reported outcome information during clinical trials3030 Basch E. High compliance rates with patient-reported outcomes in oncology trials submitted to the US Food and Drug Administration. J Natl Cancer Inst. 2019;111(5):437-9. https://doi.org/10.1093/jnci/djy183
https://doi.org/10.1093/jnci/djy183... .
CONCLUSION
The phase III MONALEESA-7 trial productivity results applied to the Brazilian premenopausal prevalent cases showed that treatment with ribociclib + endocrine therapy improves workforce participation compared with endocrine therapy alone in premenopausal women with HR+/HER2- metastatic breast cancer. Besides significantly prolonging the life of premenopausal patients with advanced breast cancer, improving their quality of life, workforce retention due to ribociclib yields economic productivity gains to society, thus supporting its use combined with endocrine therapy for premenopausal women with HR+/HER2- metastatic breast disease.
REFERENCES
- 1Ferlay J, Ervik M, Lam F, Colombet M, Mery L, Piñeros M, et al. Global Cancer Observatory: cancer today. Lyon (FR): International Agency for Research on Cancer; 2020 [cited 2021 Dec 13]. Available from: https://gco.iarc.fr/today
» https://gco.iarc.fr/today - 2Waks AG, Winer EP. Breast cancer treatment: a review. JAMA. 2019;321(3):288-300. https://doi.org/10.1001/jama.2018.19323
» https://doi.org/10.1001/jama.2018.19323 - 3DeSantis CE, Bray F, Ferlay J, Lortet-Tieulent J, Anderson BO, Jemal A. International variation in female breast cancer incidence and mortality rates. Cancer Epidemiol Biomarkers Prev. 2015;24(10):1495-506. https://doi.org/10.1158/1055-9965.EPI-15-0535
» https://doi.org/10.1158/1055-9965.EPI-15-0535 - 4O’Shaughnessy J. Extending survival with chemotherapy in metastatic breast cancer. Oncologist. 2005;10 Suppl 3:20-9. https://doi.org/10.1634/theoncologist.10-90003-20
» https://doi.org/10.1634/theoncologist.10-90003-20 - 5Axelrod D, Smith J, Kornreich D, Grinstead E, Singh B, Cangiarella J, et al. Breast cancer in young women. J Am Coll Surg. 2008;206(6):1193-203. https://doi.org/10.1016/j.jamcollsurg.2007.12.026
» https://doi.org/10.1016/j.jamcollsurg.2007.12.026 - 6Partridge AH, Hughes ME, Warner ET, Ottesen RA, Wong YN, Edge SB, et al. Subtype-dependent relationship between young age at diagnosis and breast cancer survival. J Clin Oncol. 2016;34(27):3308-14. https://doi.org/10.1200/JCO.2015.65.8013
» https://doi.org/10.1200/JCO.2015.65.8013 - 7Yin W, Horblyuk R, Perkins JJ, Sison S, Smith G, Snider JT, et al. Association between breast cancer disease progression and workplace productivity in the United States. J Occup Environ Med. 2017;59(2):198-204. https://doi.org/10.1097/JOM.0000000000000936
» https://doi.org/10.1097/JOM.0000000000000936 - 8Reyes C, Engel-Nitz NM, DaCosta Byfield S, Ravelo A, Ogale S, Bancroft T, et al. Cost of disease progression in patients with metastatic breast, lung, and colorectal cancer. Oncologist. 2019;24(9):1209-18. https://doi.org/10.1634/theoncologist.2018-0018
» https://doi.org/10.1634/theoncologist.2018-0018 - 9Dunn J, Steginga SK. Young women's experience of breast cancer: defining young and identifying concerns. Psychooncology. 2000;9(2):137-46. https://doi.org/10.1002/(sici)1099-1611(200003/04)9:2<137::aid-pon442>3.0.co;2-0
» https://doi.org/10.1002/(sici)1099-1611(200003/04)9:2<137::aid-pon442>3.0.co;2-0 - 10Mor V, Malin M, Allen S. Age differences in the psychosocial problems encountered by breast cancer patients. J Natl Cancer Inst Monogr. 1994;16):191-7.
- 11Reinert T, Pellegrini R, Rol R, Werutsky G, Barrios CH. Estimation of the number of Brazilian women living with metastatic breast cancer. JCO Glob Oncol. 2020;6:307-12. https://doi.org/10.1200/JGO.19.00404
» https://doi.org/10.1200/JGO.19.00404 - 12Pearce A, Sharp L, Hanly P, Barchuk A, Bray F, Cancela MC, et al. Productivity losses due to premature mortality from cancer in Brazil, Russia, India, China, and South Africa (BRICS): a population-based comparison. Cancer Epidemiol. 2018;53:27-34. https://doi.org/10.1016/j.canep.2017.12.013
» https://doi.org/10.1016/j.canep.2017.12.013 - 13Alexandre RF, Santana CF, Squiassi HB. Social and economic impact of patients with metastatic breast cancer in Brazil. Value Health. 2018;21 Suppl 1:S26. https://doi.org/10.1016/j.jval.2018.04.161
» https://doi.org/10.1016/j.jval.2018.04.161 - 14Kwapisz D. Cyclin-dependent kinase 4/6 inhibitors in breast cancer: palbociclib, ribociclib, and abemaciclib. Breast Cancer Res Treat. 2017;166(1):41-54. https://doi.org/10.1007/s10549-017-4385-3
» https://doi.org/10.1007/s10549-017-4385-3 - 15Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Phase III randomized study of ribociclib and fulvestrant in hormone receptor-positive, human epidermal growth factor receptor 2-negative advanced breast cancer: MONALEESA-3. J Clin Oncol. 2018;36(24):2465-72. https://doi.org/10.1200/JCO.2018.78.9909
» https://doi.org/10.1200/JCO.2018.78.9909 - 16Slamon DJ, Neven P, Chia S, Fasching PA, De Laurentiis M, Im SA, et al. Overall survival with ribociclib plus fulvestrant in advanced breast cancer. N Engl J Med. 2020;382(6):514-24. https://doi.org/10.1056/NEJMoa1911149
» https://doi.org/10.1056/NEJMoa1911149 - 17Im SA, Lu YS, Bardia A, Harbeck N, Colleoni M, Franke F, et al. Overall survival with ribociclib plus endocrine therapy in breast cancer. N Engl J Med. 2019;381(4):307-16. https://doi.org/10.1056/NEJMoa1903765
» https://doi.org/10.1056/NEJMoa1903765 - 18Tripathy D, Im SA, Colleoni M, Franke F, Bardia A, Harbeck N, et al. Ribociclib plus endocrine therapy for premenopausal women with hormone-receptor-positive, advanced breast cancer (MONALEESA-7): a randomised phase 3 trial. Lancet Oncol. 2018;19(7):904-15. https://doi.org/10.1016/S1470-2045(18)30292-4
» https://doi.org/10.1016/S1470-2045(18)30292-4 - 19Reinert T, Pellegrini R, Barrios CH. Lack of access to CDK4/6 inhibitors for premenopausal patients with metastatic breast cancer in Brazil: estimation of the number of premature deaths. Ecancermedicalscience. 2020;14:1081. https://doi.org/10.3332/ecancer.2020.1081
» https://doi.org/10.3332/ecancer.2020.1081 - 20Neumann PJ, Ganiats TG, Russell LB, Sanders GD, Siegel JE, editors. Cost-effectiveness in health and medicine. 2. ed. New York: Oxford University Press; 2016.
- 21Reilly MC, Zbrozek AS, Dukes EM. The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics. 1993;4(5):353-65. https://doi.org/10.2165/00019053-199304050-00006
» https://doi.org/10.2165/00019053-199304050-00006 - 22Banco Central do Brasil. Conversor de moedas. Brasília, DF: BCB; 2020[cited 2021 Apr 16]. Available from: https://www.bcb.gov.br/conversao23
» https://www.bcb.gov.br/conversao23 - 23Instituto Brasileiro de Geografia e Estatística. Sistema de Recuperação Automática (SIDRA). Rio de Janeiro (BR): IBGE; 2020 [cited 2021 Apr 16]. Available from: https://sidra.ibge.gov.br/pesquisa/pnadcm/tabelas
» https://sidra.ibge.gov.br/pesquisa/pnadcm/tabelas - 24Wan Y, Gao X, Mehta S, Wang Z, Faria C, Schwartzberg L. Indirect costs associated with metastatic breast cancer. J Med Econ. 2013;16(10):1169-78. https://doi.org/10.3111/13696998.2013.826228
» https://doi.org/10.3111/13696998.2013.826228 - 25Ekwueme DU, Trogdon JG, Khavjou OA, Guy GP Jr. Productivity costs associated with breast cancer among survivors aged 18-44 years. Am J Prev Med. 2016;50(2):286-94. https://doi.org/10.1016/j.amepre.2015.10.006
» https://doi.org/10.1016/j.amepre.2015.10.006 - 26Curteis T, Chandiwana D, Pathak P, Lanoue B, Buehler A, Pencheva R, et al. Analysis of societal costs due to work productivity loss and activity impairment from the Monaleesa-7 trial of ribociclib + endocrine therapy (ET) in premenopausal women with HR+/HER2– advanced breast cancer (ABC) in Brazil. Value Health. 2021;24 Suppl 1:S27. https://doi.org/10.1016/j.jval.2021.04.137
» https://doi.org/10.1016/j.jval.2021.04.137 - 27Hortobagyi GN, Stemmer SM, Burris HA, Yap YS, Sonke GS, Paluch-Shimon S, et al. Updated results from MONALEESA-2, a phase III trial of first-line ribociclib plus letrozole versus placebo plus letrozole in hormone receptor-positive, HER2-negative advanced breast cancer. Ann Oncol. 2018;29(7):1541-7. https://doi.org/10.1093/annonc/mdy155
» https://doi.org/10.1093/annonc/mdy155 - 28Harbeck N, Franke F, Villanueva-Vazquez R, Lu YS, Tripathy D, Chow L, et al. Health-related quality of life in premenopausal women with hormone-receptor-positive, HER2-negative advanced breast cancer treated with ribociclib plus endocrine therapy: results from a phase III randomized clinical trial (MONALEESA-7). Ther Adv Med Oncol. 2020;12:1758835920943065. https://doi.org/10.1177/1758835920943065
» https://doi.org/10.1177/1758835920943065 - 29Cardoso F, Paluch-Shimon S, Senkus E, Curigliano G, Aapro MS, Andre F, et al. 5th ESO-ESMO international consensus guidelines for advanced breast cancer (ABC 5). Ann Oncol. 2020;31(12):1623-49. https://doi.org/10.1016/j.annonc.2020.09.010
» https://doi.org/10.1016/j.annonc.2020.09.010 - 30Basch E. High compliance rates with patient-reported outcomes in oncology trials submitted to the US Food and Drug Administration. J Natl Cancer Inst. 2019;111(5):437-9. https://doi.org/10.1093/jnci/djy183
» https://doi.org/10.1093/jnci/djy183
Publication Dates
- Publication in this collection
09 Dec 2022 - Date of issue
2022
History
- Received
23 Aug 2021 - Accepted
04 Feb 2022