Hostname: page-component-745bb68f8f-s22k5 Total loading time: 0 Render date: 2025-02-11T13:08:09.080Z Has data issue: false hasContentIssue false

Transferability of a EUnetHTA relative effectiveness assessment to low- and middle-income countries setting

Published online by Cambridge University Press:  28 April 2022

T. I. Armina Padmasawitri*
Affiliation:
Department of Pharmacology and Clinical Pharmacy, School of Pharmacy, Institut Teknologi Bandung, Bandung, Indonesia
Ahmad Fuady
Affiliation:
Department of Community Medicine, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia Department of Public Health, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
*
*Author for correspondence: T. I. Armina Padmasawitri, E-mail: armina@itb.ac.id
Rights & Permissions [Opens in a new window]

Abstract

In 2020, European Network for Health Technology Assessment (EUnetHTA) published a relative effectiveness analysis (REA) of Pretomanid in combination with Bedaquiline and Linezolid for the treatment of extensively drug-resistant (XDR) or treatment-intolerant or nonresponsive multidrug-resistant (MDR) tuberculosis (TB) (REA PTJA14). This REA may have a significant value for low- and middle-income countries (LMICs) outside Europe, particularly those with a high burden of drug-resistant TB. This commentary focuses on whether the REA PTJA14 can be transferred and to what extent a REA can be translated to LMICs context outside Europe. We found that the assessments on the clinical effectiveness and risks of bias reported in REA PTJA14 are useful for LMICs outside Europe. The highly standardized management of TB will support the applicability of the REA to LMICs outside of Europe. Transferring this REA can reduce workload and efficiently use limited resources to conduct health technology assessment (HTA). However, the transfer should consider several critical issues, including variations in health system delivery and clinical practice and setting-specific constraints. In the TB context, the differences in the current standard treatment for XDR or nonresponsive MDR TB, resources availability for drug-resistant TB management, and how healthcare is delivered in the countries can complicate the applicability of the REA PTJA14. Given that LMICs have limitations in doing HTA, it is now critical to develop standard guidelines for transferring REA or other HTA results from high-income countries or other LMICs to maximize the benefits of the REA for LMICs outside Europe.

Type
Article Commentary
Copyright
© The Author(s), 2022. Published by Cambridge University Press

Health technology assessment (HTA) is a multidisciplinary process to determine the value of a health technology, which aims to inform decision making (Reference O’Rourke, Oortwijn and Schuller1). HTA has been increasingly applied in low- and middle-income countries (LMICs) in the last few years. It plays an important role in determining the approval and coverage of health technologies by considering various dimensions of value for a health technology, including clinical efficacy, safety, and economic implication (Reference O’Rourke, Oortwijn and Schuller1). Through this process, HTA can support governments in implementing an equitable and efficient health system to achieve universal health coverage (UHC) (Reference O’Rourke, Oortwijn and Schuller1Reference Babigumira, Jenny, Bartlein, Stergachis and Garrison3). The HTA implementation in LMICs varies at different rates. Countries like Thailand and Malaysia have fully implemented and institutionalized HTA, while others may have only applied it informally (Reference Tantivess, Chalkidou, Tritasavit and Teerawattananon2Reference Oortwijn, Broos, Vondeling and Banta5). However, LMICs face common challenges in applying HTA, mainly due to the limited local capacity and financial resources to conduct HTA (Reference Tantivess, Chalkidou, Tritasavit and Teerawattananon2Reference Bijlmakers, Mueller, Kahveci, Chen and van der Wilt6).

Transferring HTA, that is, applying (wholly or partially) the analyses and results of HTA from one jurisdiction to another, particularly for the value dimension of clinical effectiveness and economic implication, may help overcome the challenges (Reference Barnsley, Marsden, Towse and Henshall7;Reference Goeree, He and O’Reilly8). The transfer will avoid duplication of effort. It also allows LMICs to concentrate their limited resources on locally relevant activities that add value to the HTA. However, HTA can be context-specific since it is highly influenced by the health system and the culture and social–political characteristics of the country (Reference Barnsley, Marsden, Towse and Henshall7Reference Németh, Goettsch and Kristensen9). Hence, transferring HTA results is not straightforward.

The HTA transfer model that can be applied to LMICs is a core model developed by EUnetHTA, a collaborative network for HTA across Europe (Reference Kristensen, Lampe and Wild10). The core model includes a relative effectiveness assessment (REA) conducted through a joint assessment by at least four different EUnetHTA member countries (Reference Kristensen, Lampe and Wild10). A joint assessment is possible since REA is considered transferable across borders and does not affect the value dimensions for a health technology perceived as context-specific, such as the economic or societal dimensions (Reference Kleijnen, Toenders and de Groot11). The assessment can help reduce workload and allow several European middle-income countries to transfer the results into their contexts (Reference Németh, Goettsch and Kristensen9). However, the transfer is still challenging for other lower-income European countries, given their poorer health status, limited health resources, and different healthcare pathways, leading to different healthcare priorities (Reference Németh, Goettsch and Kristensen9Reference Kisser, Knieriemen and Fasan13). In a broader sense, the REA also contains ethics and legal perspective that may not be transferrable (14). Despite these challenges of transferring REA within European countries, the REAs produced by EUnetHTA are valuable and easily accessible. Therefore, the results can reach wider audiences not only within European countries but also to other LMICs outside Europe.

In 2020, EUnetHTA published a REA of Pretomanid in combination with Bedaquiline and Linezolid (BpaL) for the treatment of extensively drug-resistant (XDR) or treatment-intolerant or nonresponsive multidrug-resistant (MDR) Tuberculosis (TB) (REA PTJA14) (https://eunethta.eu/wpcontent/uploads/2020/08/PTJA14-Final-Assessment-Report-v1.0.pdf) (15). Drug-resistant TB is a significant public health issue in LMICs, and the chance of developing drug-resistant TB, such as XDR-TB and nonresponsive MDR-TB, is higher in LMICs (Reference Falzon, Mirzayev and Wares16). People with TB symptoms in LMICs often receive inadequate TB treatment from either self-medication, inappropriate prescriptions from drug stores or pharmacies, or low-quality care provided by physicians or nonregistered medical staff (Reference Fuady, Houweling, Mansyur, Burhan and Richardus17;Reference Balaji, Daley and Anand18). The behaviors and a weak health system increase the risk of MDR- and XDR-TB development. There has been a steady increase in XDR-TB cases in LMICs of Africa and Asia (Reference Ismail, Ismail and Omar19;Reference He, Tao, Liu, Zhang and Li20), and it urges treatment improvement and innovation. Therefore, the REA PTJA14 results can contribute to XDR- and nonresponsive MDR-TB treatment improvements in LMICs outside Europe, which has been struggling to overcome the pitfalls of the prolonged drug-resistant TB regimen (Reference Gandhi, Nunn and Dheda21;Reference Koch, Cox and Mizrahi22). However, one crucial question is whether the REA can be translated to their contexts.

Upon evaluating the transferability of REA PTJA14 to LMICs, the clinical efficacy of the BPaL regimen stood out. The clinical efficacy was based on a single-arm trial conducted in South Africa (15). The study suggested that BPaL resulted in a high efficacy rate—92 percent at 6-months after the end of treatment evaluation. If the assessment included subjects lost to follow up and died due to a non-TB cause, the efficacy was still high (90 percent). The study also highlighted the earlier sputum culture conversion in all but one patient. It is an essential finding since we are striving for a shorter regimen, which is worthwhile for XDR-TB and nonresponsive MDR-TB treatments. A shorter regimen improves the safety profile of drug-resistant TB treatment and leads to increased patients’ adherence and quality of life (Reference Khan, Salim and du Cros23;Reference Sotgiu and Migliori24).

However, the trial has limitations, and the REA is very informative in highlighting the limitations. First, the trial is unreliable for determining the true therapeutic effect because of lacking a control arm. Despite the promising clinical efficacy, the risks of bias due to the design of the single-arm trial should be carefully considered. The potential risks of bias include the noncomparative nature of the trial, the low sample size, the absence of drug-resistance characterization upon baseline for some patients, and the missing long term efficacy data (15). Second, the trial had no robust data to prove the possible benefit of a shortened treatment regimen for XDR-TB and nonresponsive MDR-TB treatment at great length. Third, the REA also cannot assess the impact of the short regimen on the quality of life because of data limitations (15).

The clinical efficacy and limitations in methodology identified by the REA is useful for all settings. However, transferring this REA to the LMICs context should consider other challenges. First, the governments in LMICs should consider the treatment practice applied in their countries when transferring this REA, since it determines the relevance of the health technology and its comparator to the setting. Until now, there has been no current standard practice for XDR- and nonresponsive MDR-TB treatment. Countries may use patient-tailored treatment regimens based on patients’ drug sensitivity testing results and past medication use (Reference Bhering, Duarte and Kritski25). Hence, setting specific treatment practices should be considered when selecting a comparator for the novel regimen. Furthermore, governments in LMICs need to assess the availability of second-line TB drugs and drug sensitivity testing, which are very scarce in LMICs (Reference Seung, Keshavjee and Rich26). Bedaquiline, for example, was only available to less than 20 percent of the needs (Reference Seung, Keshavjee and Rich26). This may influence the relevance of the technology addressed in the REA for LMICs. The transfer will become more valuable with the increasing drug availability and systematically lowering drug prices. There has been increasing pressure to lower Bedaquiline price and endorse it as the backbone for future MDR TB regimens (Reference Gotham, McKenna, Frick and Lessem27). Through these movements, the REA is more relevant for transfer and, in parallel, can push a strategy to encourage the wide drug availability in LMICs.

Second, healthcare delivery systems or models of care for drug-resistant TB vary between countries. The treatment for XDR- and nonresponsive MDR-TB is long, complex, and expensive, with a potential for high rates of people lost to follow up. Ambulatory models of care and decentralization of drug-resistant TB services could lower the costs and lost to follow up rate (Reference Bassili, Qadeer and Floyd28). However, this model of care needs massive trainings for healthcare workers and investment. Otherwise, the delivery system will be nonoptimal, fail to widen patients’ access to adequate treatment (29), and eventually worsen patients’ treatment adherence and outcome (Reference de Vries, Tsolova and Anderson30).

The third challenge is the clinical practice variations of TB comorbidity management, such as TB coinfection on HIV or TB with diabetes mellitus. The comorbidities are significant risk factors to the high TB burden. The risk of contracting TB is three times higher among those with diabetes than nondiabetic individuals, while one-fourth of TB deaths are HIV-positive cases. The REA dismissed potential drug interactions between the BpaL regimen with an antiretroviral, Efavirenz because the drug is no longer used in the European setting. However, LMICs, such as Indonesia, still include Efavirenz in their guideline of HIV management (31). The treatment of TB treatment along with the comorbidities, therefore, should be carefully addressed.

Another challenge is the different countries’ methodological preferences in HTA. In general, HTA has two main parts: clinical and cost-effectiveness evaluations. Another part is exploring ethical, patient engagement, legal perspectives, and other relevant value dimensions. Countries have their specific preference in conducting HTA. For example, some LMICs like Indonesia often do not perform a separate clinical effectiveness evaluation but prefer to use an integrative method, that is, economic evaluation. Therefore, transferring REA, which mostly only provides clinical effectiveness evaluation, still needs to perform the economic evaluation before reaching the decision. However, the REA can still be used to inform the economic evaluation design.

Despite the challenges, the REA PTJA14 highlights the importance of developing XDR- and nonresponsive MDR-TB treatment regimens. Treatment for drug-sensitive and resistant TB is highly standardized worldwide, but the standard for XDR- and nonresponsive MDR-TB is still lacking. Nevertheless, REA in TB has advantages. The global standard of TB treatment can facilitate the REA transfer to LMICs outside Europe. Other health technologies do not have this advantage, and the REA transfer to LMICs context is more challenging because of the absence of supra-national guidelines on disease management.

Transferring this REA, and other HTA results from other jurisdictions, can help LMICs save their resources. Governments in LMICs can concentrate on setting-specific assessments, such as the economic evaluation of the BpaL Regimen. They can also focus more on developing a comprehensive assessment involving other elements influencing the success of TB treatment, such as drug surveillance to prevent inappropriate use and nonadherence, diagnosis, and equity of access to the medicine. This comprehensive assessment is helpful to strengthen the TB-related health system in LMICs, which is currently still weak (Reference Oluwasanu, Hassan and Adebayo32).

Another essential point is that a REA and HTA transfer guidance from high-income countries or other LMICs, which is now lacking, is urged. Many guidelines have been developed, such as the Agency for Care Effectiveness (ACE, Singapore) guide to assess generalizability (33) and the Swedish Agency for HTA (Sweden) handbook to assess transferability (34); however, nothing has been developed for LMICs. The guidance for LMICs can be adapted from those well-developed guidances with critical adjustment. Therefore, the guidance will help LMICs perform the transfer without abandoning their capacity building and compromising the integrity of their decision-making process (35). This movement should also promote collaborative assessment for HTA or REA through regional HTA agencies network, such as HTAsiaLink for Asian countries. It will also allow the adaptation of clinical practice guidelines between countries, for example, adapting MDR-TB guidelines between Vietnam, Thailand, Malaysia, and Indonesia.

In conclusion, the REA PTJA14 by EUnetHTA is partly useful for LMICs outside Europe, particularly those with a high burden of drug-resistant TB. However, careful assessment is still required in transferring the REA. Assessments on the clinical effectiveness and risks of bias provided by the REA were beneficial. However, transferring the REA should consider variations in applied treatment practice, healthcare delivery system or model of care, clinical variation in comorbidities or coinfection management, and countries’ HTA methodological approach.

Funding Statement

This research received no specific grant from any funding agency, commercial, or not-for-profit sectors.

Conflicts of Interest

The authors declare that there is no conflict of interest.

References

O’Rourke, B, Oortwijn, W, Schuller, T (2020) Announcing the new definition of health technology assessment. Value Health. 23, 824825. https://doi.org/10.1016/j.jval.2020.05.001.CrossRefGoogle ScholarPubMed
Tantivess, S, Chalkidou, K, Tritasavit, N, Teerawattananon, Y (2017) Health technology assessment capacity development in low- and middle-income countries: Experiences from the international units of HITAP and NICE. F1000Res. 6, 2119. https://doi.org/10.12688/f1000research.13180.1.CrossRefGoogle ScholarPubMed
Babigumira, JB, Jenny, AM, Bartlein, R, Stergachis, A, Garrison, LP (2016) Health technology assessment in low- and middle-income countries: A landscape assessment. J Pharm Health Serv Res. 7, 3742. https://doi.org/10.1111/jphs.12120.CrossRefGoogle Scholar
Oortwijn, W, Mathijssen, J, Banta, D (2010) The role of health technology assessment on pharmaceutical reimbursement in selected middle-income countries. Health Policy. 95, 174184. https://doi.org/10.1016/j.healthpol.2009.12.008.CrossRefGoogle ScholarPubMed
Oortwijn, W, Broos, P, Vondeling, H, Banta, D (2013) Mapping of health technology assessment: Developing and testing an evaluation matrix in selected countries. Int J Technol Assess Health Care. 29, 424434. https://doi.org/10.1017/S0266462313000469.CrossRefGoogle Scholar
Bijlmakers, L, Mueller, D, Kahveci, R, Chen, Y, van der Wilt, GJ (2017) INTEGRATE-HTA: A low- and middle-income country perspective. Int J Technol Assess Health Care. 33, 599604. https://doi.org/10.1017/S0266462317000927.CrossRefGoogle ScholarPubMed
Barnsley, P, Marsden, G, Towse, A, Henshall, C (2014) Background paper: Transferability of Hta, Htai Asia policy forum meeting; [cited 9 April 2021]. Available at: https://htai.org/wp-content/uploads/2018/02/17023_HTAi_AsiaForumBackground2014.pdf (Accessed 2021).Google Scholar
Goeree, R, He, J, O’Reilly, D, et al (2011 ) Transferability of health technology assessments and economic evaluations: A systematic review of approaches for assessment and application. Clinicoecon Outcomes Res. 3, 89104. https://doi.org/10.2147/CEOR.S14404.CrossRefGoogle ScholarPubMed
Németh, B, Goettsch, W, Kristensen, FB, et al (2020 ) The transferability of health technology assessment: The European perspective with focus on central and Eastern European countries. Expert Rev Pharmacoecon Outcomes Res. 20, 321330. https://doi.org/10.1080/14737167.2020.1779061.CrossRefGoogle ScholarPubMed
Kristensen, FB, Lampe, K, Wild, C, et al (2017 ) The HTA core model®-10 years of developing an international framework to share multidimensional value assessment. Value Health. 20, 244250. https://doi.org/10.1016/j.jval.2016.12.010.CrossRefGoogle ScholarPubMed
Kleijnen, S, Toenders, W, de Groot, F, et al (2015) European collaboration on relative effectiveness assessments: What is needed to be successful? Health Policy. 119, 569576. https://doi.org/10.1016/j.healthpol.2015.01.018.CrossRefGoogle ScholarPubMed
Drummond, M, Augustovski, F, Kaló, Z, et al (2015) Challenges faced in transferring economic evaluations to middle income countries. Int J Technol Assess Health Care. 31, 442448. https://doi.org/10.1017/S0266462315000604.CrossRefGoogle ScholarPubMed
Kisser, A, Knieriemen, J, Fasan, A, et al (2021 ) Towards compatibility of EUnetHTA JCA methodology and German HTA: A systematic comparison and recommendations from an industry perspective. Eur J Health Econ. https://doi.org/10.1007/s10198-021-01400-2.CrossRefGoogle ScholarPubMed
EUnetHTA European Network for Health Technology Assessment (2011) EUnetHTA European network for health technology assessment. Adapting existing HTAs from one country into other settings. Working Package 5; [cited 14 March 2022]. Available at: https://www.eunethta.eu/wp-content/uploads/2011/01/EUnetHTA_adptation_toolkit_2011_version_5.pdf (Accessed 2022).Google Scholar
EUnetHTA European Network for Health Technology Assessment (2020) Relative effectiveness assessment of pharmaceutical technologies, Pretomanid in combination with Bedaquiline and Linezolid in adults for the treatment of pulmonary extensively drug-resistant (XDR) or treatment-intolerant or nonresponsive multidrug-resistant (MDR) tuberculosis; [cited 25 May 2021]. Available at: https://eunethta.eu/wp-content/uploads/2020/08/PTJA14-Final-Assessment-Reportv1.0.pdf (Accessed 2021).Google Scholar
Falzon, D, Mirzayev, F, Wares, F, et al (2015) Multidrug-resistant tuberculosis around the world: What progress has been made? Eur Respir. 45, 150160. https://doi.org/10.1183/09031936.00101814.CrossRefGoogle Scholar
Fuady, A, Houweling, TAJ, Mansyur, M, Burhan, E, Richardus, JH (2020) Cost of seeking care for tuberculosis since the implementation of universal health coverage in Indonesia. BMC Health Serv Res. 20, 502. https://doi.org/10.1186/s12913-020-05350-y.CrossRefGoogle ScholarPubMed
Balaji, V, Daley, P, Anand, AA, et al (2010) Risk factors for MDR and XDR-TB in a tertiary referral hospital in India. PloS One. 5, e9527. https://doi.org/10.1371/journal.pone.0009527.CrossRefGoogle Scholar
Ismail, N, Ismail, F, Omar, SV et al (2018 ) Drug resistant tuberculosis in Africa: Current status, gaps and opportunities. Afr J Lab Med. 7, 781. https://doi.org/10.4102/ajlm.v7i2.781.CrossRefGoogle ScholarPubMed
He, S, Tao, N, Liu, Y, Zhang, X, Li, H (2017) Epidemiological trends and outcomes of extensively drug-resistant tuberculosis in Shandong, China. BMC Infect Dis. 17, 555. https://doi.org/10.1186/s12879-017-2652-x.CrossRefGoogle ScholarPubMed
Gandhi, NR, Nunn, P, Dheda, K, et al (2010 ) Multidrug-resistant and extensively drug-resistant tuberculosis: A threat to global control of tuberculosis. Lancet. 375, 18301843. https://doi.org/10.1016/S0140-6736(10)60410-2.CrossRefGoogle ScholarPubMed
Koch, A, Cox, H, Mizrahi, V (2018) Drug-resistant tuberculosis: Challenges and opportunities for diagnosis and treatment. Curr Opin Pharmacol. 42, 715. https://doi.org/10.1016/j.coph.2018.05.013.CrossRefGoogle ScholarPubMed
Khan, FA, Salim, MAH, du Cros, P, et al (2017 ) Effectiveness and safety of standardised shorter regimens for multidrug-resistant tuberculosis: Individual patient data and aggregate data meta-analyses. Eur Respir. 50, 1700061. https://doi.org/10.1183/13993003.00061-2017.CrossRefGoogle Scholar
Sotgiu, G, Migliori, GB (2017) Effect of the short-course regimen on the global epidemic of multidrug-resistant tuberculosis. Lancet Respir Med. 5, 159161. https://doi.org/10.1016/S2213-2600(16)30432-5.CrossRefGoogle ScholarPubMed
Bhering, M, Duarte, R, Kritski, A (2019) Predictive factors for unfavourable treatment in MDR-TB and XDR-TB patients in Rio de Janeiro State, Brazil, 2000–2016. PloS One. 14, e0218299. https://doi.org/10.1371/journal.pone.0218299.CrossRefGoogle Scholar
Seung, KJ, Keshavjee, S, Rich, ML (2015) Multidrug-resistant tuberculosis and extensively drug-resistant tuberculosis. Cold Spring Harb Perspect Med. 5, a017863. https://doi.org/10.1101/cshperspect.a017863.CrossRefGoogle ScholarPubMed
Gotham, D, McKenna, L, Frick, M, Lessem, E (2020) Public investments in the clinical development of Bedaquiline. PloS One. 15, e0239118. https://doi.org/10.1371/journal.pone.0239118.CrossRefGoogle ScholarPubMed
Bassili, A, Qadeer, E, Floyd, K, et al (2013) A systematic review of the effectiveness of hospital- and ambulatory-based management of multidrug-resistant tuberculosis. Am J Trop Med. 89, 271280. https://doi.org/10.4269/ajtmh.13-0004.CrossRefGoogle ScholarPubMed
Institute of Medicine (U.S.) (2009) Forum on drug discovery and translation. In: Addressing the threat of drug-resistant tuberculosis: A realistic assessment of the challenge: Workshop summary. Washington, DC: National Academies Press.Google Scholar
de Vries, G, Tsolova, S, Anderson, LF, et al (2017 ) Health system factors influencing management of multidrug-resistant tuberculosis in four European Union countries - Learning from country experiences. BMC Public Health. 17, 334. https://doi.org/10.1186/s12889-017-4216-9.CrossRefGoogle ScholarPubMed
Ministry of Health Republic of Indonesia Decree on The National Guideline for HIV Care, No. HK.01.07/MENKES/90/2019, enacted 19 February 2019. Google Scholar
Oluwasanu, MM, Hassan, A, Adebayo, AM, et al (2020) General and tuberculosis-specific service readiness in two states in Nigeria. BMC Health Serv Res. 20, 792. https://doi.org/10.1186/s12913-020-05626-3.CrossRefGoogle ScholarPubMed
Agency for Care Effectiveness (2018) Ministry of Health Republic of Singapore, Medical technologies evaluation methods and process guide; [cited 14 March 2022]. Available at: https://www.ace-hta.gov.sg/docs/default-source/process-methods/ace-methods-and-process-guide-for-medical-technologies-evaluation-(1-oct-2018).pdf (Accessed 2022).Google Scholar
Swedish Agency for Health Technology Assessment and Assessment of Social Services (2018) Assessment of methods in health care and social services; [cited 14 March 2022]. Available at: https://www.sbu.se/contentassets/76adf07e270c48efaf67e3b560b7c59c/eng_metodboken.pdf (Accessed 2022).Google Scholar
World Health Organization (2020) Good reliance practices in regulatory decision-making for medical products: High-level principles and considerations; [cited 9 April 2021]. Available at: https://www.who.int/medicines/areas/quality_safety/quality_assurance/QAS20_851_Rev_1_Good_Reliance_Practices.pdf?ua=1 (Accessed 2021).Google Scholar