Traditional, complementary, and integrative medicine evidence map: a methodology to an overflowing field of data and noise

Mapas de la evidencia de las medicinas tradicionales, complementarias e integrativas: metodología para un campo desbordado de datos e interferencias

Mapa de evidências das medicinas tradicionais, complementares e integrativas: uma metodologia para um campo repleto de dados e ruído

Mariana Cabral Schveitzer Carmen Verônica Mendes Abdala Caio Fabio Schlechta Portella Ricardo Ghelman About the authors

ABSTRACT

Every day there is criticism about lack of evidence on traditional, complementary, and integrative medicine (TCIM). But is this narrative evidence-based? Are we really missing research about TCIM? Or are we just not looking correctly at the evidence? Evidence maps are a useful method with the dual function of synthesizing available evidence on a specific topic and identifying knowledge gaps. This article presents a six-step evidence map methodology along with recently published TCIM evidence maps, including one related to COVID-19. TCIM evidence maps are useful instruments to inform decision-making for policymakers, health practitioners, and patients.

Keywords
Systematic review; complementary therapies; integrative medicine; coronavirus infections

RESUMEN

Es habitual que se critique la falta de evidencia con respecto a las medicinas tradicionales, complementarias e integrativas. Sin embargo, ¿se basa en la evidencia este discurso? ¿Falta realmente investigación sobre las medicinas tradicionales, complementarias e integrativas o es que simplemente no estamos analizando la evidencia de forma adecuada? Los mapas de evidencia son un método útil que tiene una función doble: sintetizar la evidencia disponible por temas específicos y determinar si hay alguna laguna en el conocimiento. En este artículo se presenta una metodología de elaboración de mapas de la evidencia en seis pasos, junto con los mapas de la evidencia de las medicinas tradicionales, complementarias e integrativas publicados recientemente, incluido un mapa sobre la COVID-19. Los mapas de la evidencia de las medicinas tradicionales, complementarias e integrativas son instrumentos útiles para fundamentar la toma de decisiones por parte de los encargados de las políticas, el personal de salud y los pacientes.

Palabras clave
Revisión sistemática; terapias complementarias; medicina integral; infecciones por coronavirus

RESUMO

A crítica é diária de que faltam evidências em medicinas tradicionais, complementares e integrativas (MTCI). Mas será que esta narrativa se baseia em evidências? Realmente faltam pesquisas em MTCI? Ou será que simplesmente não estamos atentando corretamente às evidências? Os mapas de evidências consistem em uma metodologia útil de dupla função: sintetizar as evidências existentes em um determinado tópico e identificar as lacunas de conhecimento. Neste artigo é apresentada uma metodologia de mapa de evidências de seis passos junto com mapas de evidências de MTCI recém-publicados, incluindo um relacionado à COVID-19. Os mapas de evidências de MTCI são instrumentos úteis para subsidiar a tomada de decisão dos responsáveis por políticas, profissionais da saúde e pacientes.

Palavras-chave
Revisão sistemática; terapias complementares; medicina integrativa; infecções por coronavirus

Every day there is criticism about lack of evidence on traditional, complementary, and integrative medicine (TCIM). This lack of evidence was a common topic in the narratives of over 15 000 health care professionals (11. Schveitzer MC, Zoboli ELCP. Role of complementary therapies in the understanding of primary healthcare professionals: a systematic review. Rev Esc Enferm USP. 2014;48(spe):184–91. https://doi.org/10.1590/S0080-623420140000500026
https://doi.org/10.1590/S0080-6234201400...
). There is a lot of work to be done on body-mind medicine and many challenges persist (22. Dossett ML, Fricchione GL, Benson H. A New Era for Mind-Body Medicine. N Engl J Med. 2020;382(15):1390–1. https://doi.org/10.1056/NEJMp1917461
https://doi.org/10.1056/NEJMp1917461...
). But is this narrative evidence-based? Are we really lacking research on TCIM? Or are we just not looking correctly at the evidence?

In 2019, the World Health Organization (WHO) Global Report on Traditional and Complementary Medicine (33. World Health Organization. WHO global report on traditional and complementary medicine 2019. Geneva: WHO; 2019. Available from: https://www.who.int/traditional-complementary-integrative-medicine/WhoGlobalReportOnTraditionalAndComplementaryMedicine2019.pdf [cited 2020 May 11].
https://www.who.int/traditional-compleme...
) revealed that Member States considered the “lack of research data” in the field the main challenge to advancing regulation processes to integrate TCIM practices into health systems and services. This perception is frequently based on lack of knowledge of existing evidence, on barriers to access (language of publication, paid access), and on difficulties in interpreting results and the research particularities of the field.

Since 2002, the WHO Traditional Medicine Strategy (44. World Health Organization. WHO traditional medicine strategy: 2014-2023. Geneva: WHO; 2014. Available from: https://apps.who.int/iris/bitstream/handle/10665/92455/9789241506090_eng.pdf [cited 2020 May 11].
https://apps.who.int/iris/bitstream/hand...
) has been encouraging and strengthening the insertion, recognition, and use of TCIM products and practitioners in national health systems at all levels: primary health care, specialized care, and hospital care.

Overall, TCIM evidence production has increased significantly over the last 20 years. During the regional meeting “Advancing towards Universal Health, Contributions of Traditional and Complementary Medicine,” organized by the Pan American Health Organization (PAHO) in 2017 in Managua, Nicaragua, the PAHO/WHO Latin American and Caribbean Center on Health Sciences Information (BIREME/PAHO/WHO) presented a proposal for creation of a Virtual Health Library (VHL) specialized in TCIM. During the meeting, delegates from various countries proposed the creation of a TCIM Collaborative Network for the Americas as a technical cooperation response to the demand from PAHO Member States for reliable sources of scientific evidence on TCIM (55. Pan American Health Organization/World Health Organization Latin American and Caribbean Center on Health Sciences Information (BIREME) [Internet]. Sao Paolo: BIREME; 2017 Nov 29. BIREME/PAHO/WHO Bulletin, BIREME Bulletin no. 14, Cooperation to strengthen Traditional Medicine and Complementary Therapies. Available from: https://boletin.bireme.org/en/2017/11/29/cooperation-to-strengthen-traditional-medicine-and-complementary-therapies/
https://boletin.bireme.org/en/2017/11/29...
).

Currently there are over 1 million bibliographic references in the VHL TCIM (https://mtci.bvsalud.org/en/). The sheer number of studies creates a challenge for anyone navigating this saturated field. The VHL TCIM is a thematic virtual library that aims to promote the visibility, access, use, and publication of scientific, technical, and educational content that will contribute to promotion, development, and integration of TCIM into health care services and systems in the Americas through stakeholder collaboration.

As a contribution to facilitate access to available evidence and identify knowledge gaps, and in response to a demand from the Ministry of Health of Brazil, BIREME/PAHO/WHO, in collaboration with the Brazilian Academic Consortium for Integrative Health (CABSIN), brought together a group of researchers and experts in the field to develop clinical evidence maps on TCIM. The objective of this article is to present the six steps of evidence map methodology and recently published TCIM evidence maps, including one related to COVID-19.

MATERIALS AND METHODS

Evidence mapping allows different types of evidence integration, as well as graphical or dynamic representations, through interactive online databases, which facilitates interpretation of results and may also include information about quality analysis and effects (66. Saran A, White H. Evidence and gap maps: a comparison of different approaches. Campbell Syst Rev. 2018;14:1–38. https://doi.org/10.4073/cmdp.2018.2
https://doi.org/10.4073/cmdp.2018.2...
). These characteristics make it a useful instrument to inform decision-making for managers, health care professionals, and patients and for prioritizing research needs in order to address knowledge gaps.

The first map developed by BIREME/PAHO/WHO was about the clinical effectiveness of ozone therapy, with a medical focus, revealing a need to widen its use. After this experience, the organizations involved in the project deliberated about the areas for the following maps, considering their application in the Brazilian health system. The seven practices selected are included in the National Policy of Integrative and Complementary Practices prioritized by the Ministry of Health of Brazil: traditional Chinese medicine (acupuncture, auriculotherapy, mind and body practices), medicinal plants and phytotherapy, yoga, meditation, reflexology, oral ozone therapy, and shantala (infant massage). Because of the large number of studies in each area, the working groups decided only to include systematic reviews about each of the practices in these evidence maps.

We report the methods and results according to PRISMA guidelines (77. Moher D, Liberati A, Tetzlaff J, Altman DG, Altman D, Antes G, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097
https://doi.org/10.1371/journal.pmed.100...
) and the International Initiative for Impact Evaluation (3iE) Evidence Gap Methodology (88. Snilstveit B, Vojtkova M, Bhavsar A, Stevenson J, Gaarder M. Evidence & Gap Maps: A tool for promoting evidence informed policy and strategic research agendas. J Clin Epidemiol. 2016 Nov;79:120–9. https://doi.org/10.1016/j.jclinepi.2016.05.015
https://doi.org/10.1016/j.jclinepi.2016....
). We applied AMSTAR 2 (99. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. https://doi.org/10.1136/bmj.j4008
https://doi.org/10.1136/bmj.j4008...
) to analyze the quality of the included systematic reviews. Each evidence map was supported by a technical expert panel of librarians, practitioners, policymakers, and researchers. The maps are easy to navigate and most of the included studies are free access and with full text available in English.

TCIM evidence map methodology can be described considering six steps, each with a set of activities (Table 1).

RESULTS

TCIM evidence maps are all available from the TCIM Evidence Map website https://mtci.bvsalud.org/en/evidence-map. These maps include over 800 systematic reviews, 500 interventions, and 400 outcomes (e.g., depression, anxiety, quality of life, stress, sleep quality, physical functions, pain relief, blood pressure, blood glucose, fatigue, balance, humor). Table 2 summarizes the TCIM evidence maps and the number of systematic reviews in each category of outcomes.

In relation to level of confidence, we applied AMSTAR 2 and found studies with high, moderate, and low levels of confidence. Regarding evidence quality, the majority of TCIM evidence maps presented positive effects—although lack of effect was also attributed, as well as a few negative effects—analyzed using different methods by each systematic review. All this information is available on the TCIM Evidence Map website and is easy to access for policymakers, health professionals, and patients.

Due to the challenges and urgency brought by the development of the COVID-19 pandemic, the Ministry of Health of Brazil, BIREME/PAHO/WHO, CABSIN, and the TCIM Network teamed up to develop a specific evidence map to describe different TCIM interventions and report health outcomes that could help in times of COVID-19. The main objective of this evidence map was to systematize scientific evidence in order to support professionals, managers, and researchers in the construction of documents and actions related to TCIM in the response to the pandemic.

This evidence map includes 126 controlled clinical studies and reviews that are arranged in a graphic platform and distributed across 62 interventions and 67 clinical outcomes divided into immunological response, complementary clinical management, and mental health (1010. Portella CFRS, Ghelman R, Abdala CVM, Schveitzer MC. Evidence map on the contributions of traditional, complementary and integrative medicines for health care in times of COVID-19. Integr Med Res. 2020;9(3):100473. https://doi.org/10.1016/j.imr.2020.100473
https://doi.org/10.1016/j.imr.2020.10047...
).

Until now, there is no evidence of specific treatments for COVID-19. This work synthesized evidence for researchers and health professionals duly trained in the use of complementary therapies in the management of symptoms, especially in the dimensions of mental health and mild symptoms. Most antiviral activity findings described refer to respiratory viruses in general, not specifically to SARS-CoV-2; these may guide new research but do not necessarily support a therapeutic protocol recommendation (1010. Portella CFRS, Ghelman R, Abdala CVM, Schveitzer MC. Evidence map on the contributions of traditional, complementary and integrative medicines for health care in times of COVID-19. Integr Med Res. 2020;9(3):100473. https://doi.org/10.1016/j.imr.2020.100473
https://doi.org/10.1016/j.imr.2020.10047...
).

DISCUSSION

Evidence maps represent a broad grouping and repository of evidence published in indexed scientific journals, from various countries, to contribute to evidence-informed practices and also to respond to the ongoing pandemic. There is much evidence about TCIM that still needs to be gathered.

There are several different ways to do evidence mapping (66. Saran A, White H. Evidence and gap maps: a comparison of different approaches. Campbell Syst Rev. 2018;14:1–38. https://doi.org/10.4073/cmdp.2018.2
https://doi.org/10.4073/cmdp.2018.2...
), but usually the data are presented without showing their effects or “what works,” making it difficult to access all databases and usually not answering specific questions that policymakers, health practitioners, and patients might have.

The aim of making all TCIM evidence maps available through an interactive platform at the VHL TCIM is to facilitate policymakers, health practitioners, and patients’ access to this information. In each map, it is possible to access different interventions, outcomes, and effects in order to promote TCIM evidence-based decision-making. Every map presents the number of studies in each category, areas with gaps, and level of confidence (based on AMSTAR 2) for each included study, so researchers can also identify areas that still require research.

TABLE 1.
Six-step TCIM evidence map methodology
TABLE 2.
TCIM evidence maps, number of systematic reviews, and principal category of outcomes

In these times of uncertainty, we would like to have all the cause-effect answers that Western medicine promises (1111. Greenhalgh T. Will COVID-19 be evidence-based medicine’s nemesis? PLoS Med. 2020;17(6):e1003266. https://doi.org/10.1371/journal.pmed.1003266
https://doi.org/10.1371/journal.pmed.100...
), as well as access to all the hard technology needed to attend severe COVID-19 cases and to protect health care workers. But alongside these we can use the abundant TCIM evidence to provide information to help people isolate at home. For those at risk of developing or deteriorating mental health issues, chronic disease, or pain, the evidence shows benefits and possible uses for TCIM.

Limitations

We understand that evidence maps can only provide a broad overview of research, and the TCIM evidence maps cited will not be able to answer more refined questions, such as the most adequate TCIM application method, differences between health services, adequate training for practitioners, patient access, and self-application effects. But we believe future research, including qualitative research and case studies, is needed to answer these questions and is very important for TCIM-related evidence development.

Conclusion

Evidence maps provide an easy visualization of valuable information on TCIM for policymakers, health practitioners, and patients, in order to promote evidence-based complementary therapies in line with the WHO Traditional Medicine Strategy 2014–2024 (33. World Health Organization. WHO global report on traditional and complementary medicine 2019. Geneva: WHO; 2019. Available from: https://www.who.int/traditional-complementary-integrative-medicine/WhoGlobalReportOnTraditionalAndComplementaryMedicine2019.pdf [cited 2020 May 11].
https://www.who.int/traditional-compleme...
).

Disclaimer.

Authors hold sole responsibility for the views expressed in the manuscript, which may not necessarily reflect the opinion or policy of the RPSP/PAJPH and/or PAHO.

The authors would like to express their gratitude to BIREME/PAHO/WHO and TCIM Network volunteers for support in the development of the evidence maps, and the technical expert panel advising the project. Any errors of fact or interpretation in this article remain the responsibility of the authors. We would like specially to acknowledge Adair Roberto Soares, Hildebrando Sábato, Carla Holandino, Danilo Santaella, Rosely Cardon, Lissandra Zanovelo Fogaça, Erika Cardozo Pereira, and Natalia Sofia Aldana.

  • Funding.
    TCIM evidence maps were funded by the Ministry of Health of Brazil.
  • Author contributions.
    All authors designed the evidence map methodology, designed and executed the search strategy, and were involved in data acquisition and analysis. All authors were involved in the interpretation of the data and contributed to the final manuscript. MCS and CVMA drafted the manuscript. All authors read and approved the final version.
  • Conflict of interest.
    None declared

REFERENCES

Publication Dates

  • Publication in this collection
    03 May 2021
  • Date of issue
    2021

History

  • Received
    21 Aug 2020
  • Accepted
    01 Dec 2020
Organización Panamericana de la Salud Washington - Washington - United States
E-mail: contacto_rpsp@paho.org