Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-09T14:40:14.269Z Has data issue: false hasContentIssue false

IMPACT OF EDUCATIONAL INTERVENTIONS ON ADVERSE DRUG EVENTS REPORTING

Published online by Cambridge University Press:  02 December 2013

Caroline Pagotto
Affiliation:
Drugs and Medicines, School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho-Unesp
Fabiana Varallo
Affiliation:
Drugs and Medicines, School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho-Unesp
Patrícia Mastroianni
Affiliation:
Drugs and Medicines, School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho-Unesp
Rights & Permissions [Opens in a new window]

Abstract

Introduction: Spontaneous adverse drug events (ADE) reporting is the main source of data for assessing the risk/benefit of drugs available in the pharmaceutical market. However, its major limitation is underreporting, which hinders and delays the signal detection by Pharmacovigilance (PhV).

Objectives: To identify the techniques of educational intervention (EI) for promotion of PhV by health professionals and to assess their impact.

Methods: A systematic review was performed in the PUBMED, PAHO, LILACS and EMBASE databases, from November/2011 to January/2012, updated in March/2013. The strategy search included the use of health descriptors and a manual search in the references cited by selected papers.

Results: 101 articles were identified, of which 16 met the inclusion criteria. Most of these studies (10) were conducted in European hospitals and physicians were the health professionals subjected to most EI (12), these studies lasted from one month to two years. EI with multifaceted techniques raised the absolute number, the rate of reporting related to adverse drug reactions (ADR), technical defects of health technologies, and also promoted an improvement in the quality of reports, since there was increased reporting of ADR classified as serious, unexpected, related to new drugs and with high degree of causality.

Conclusion: Multifaceted educational interventions for multidisciplinary health teams working at all healthcare levels, with sufficient duration to reach all professionals who act in the institution, including issues related to medication errors and therapeutic ineffectiveness, must be validated, with the aim of standardizing the Good Practice of PhV and improve drug safety indicators.

Type
Assessments
Copyright
Copyright © Cambridge University Press 2013 

A systematic review showed that one of two hospital admissions may be arising from adverse drug events (ADEs) (Reference Leendertse, Visser, Egberts and van den Bemt1). A same prevalence of occurrence of adverse drug reactions (ADRs) can be observed during the length of hospital stay of inpatients (Reference Dequiro, Mol and van Doormaal2); however, only 6 percent of them are reported (Reference Hazell and Shaki3). This proportion is far below than that one recommended by the World Health Organization, which targets the number of 250 reports per million of inhabitants (Reference Ribeiro-Vaz, Herdeiro, Polónia and Figueiras4). Therefore, underreporting decreases the sensitivity of the passive method of vigilance, hindering and delaying the assessment of risk/benefit of the drugs available on the pharmaceutical market.

Despite of this limitation, the spontaneous reporting systems provide high volume of information at a low cost and their most important function is the early detection of a signal (hypothesis regarding a causal relationship between the use of a drug and the development of ADR). The voluntary reports of ADE are done, mainly, by health professionals, especially physicians (Reference Meyboom, Egberts, Gribnau and Hekster5), pharmacists (Reference Conforti, Opri and D'Incau6), and nurses (Reference Gedde-Dahl, Harg and Stenberg-Nilsen7). When the minimum and desirable fields for ADE are filled in the yellow card (or another specific document, because the safety drugs polices vary from country to country), this information helps to prevent and/or decrease the occurrence of ADR, medication errors and ineffective treatment, as well as to contribute to the quality of the drugs (8). Therefore, it is necessary to develop strategies that contribute to the promotion of pharmacovigilance by multidisciplinary teams in healthcare institutions.

General educational interventions (EI) have been demonstrated as an effective method applied to change the health professionals’ behavior/attitude (Reference Forsetlund, Bjorndal and Rashidian9), because the main reasons of underreporting (ignorance, diffidence, lethargy, indifference, and complacency) (Reference López-Gonzalez, Herdeiro and Figueiras10) are demonstrated, the appropriate concepts and practices of pharmacovigilance are explained and the correct fill of forms are elucidated. Therefore, EI contribute to decrease the lack of knowledge among the reporters and to increase the awareness regarding the importance of this service in health institutions. Consequently, there is an improvement in the adherence of nurses, pharmacists and physicians in the service, resulting in the increment of the problems reporting related to safety, quality, and effectiveness of health technologies (Reference Molokhia, Tanna and Bell11).

In this context, the present study aimed to identify the techniques of educational interventions used to promote pharmacovigilance in healthcare institutions by health professionals and to assess their impact on ADE reports.

METHODS

A systematic review was performed in PUBMED, PAHO, LILACS, and EMBASE computerized databases, between November of 2011 and January of 2012, updated in March/2013, to identify original studies that assessed the impact of educational interventions to encourage spontaneous reporting of ADE by health professionals.

The strategy of search was carried out according to PRISMA Statement(Reference Moher, Liberati, Tetzlaff and Altman12). The following health descriptors were used for data collection: “education, continuing” OR “education, medical” OR “intervention” OR “health knowledge, attitudes, practice” AND “adverse drug reaction reporting systems” OR “adverse drug reaction reported spontaneously” AND “pharmacovigilance”. A manual search was also performed in the references of selected articles to look for relevant studies that might not be identified by the health descriptors used (STEP 1).

A first screening of all articles identified was carried out, with a view to exclude review manuscripts, editorials, letters, news, abstracts of conference proceedings, data from thesis/dissertations, and original studies published in journals indexed in the databases consulted which were not written in English, Portuguese, or Spanish languages (STEP 2).

The selected articles were reviewed and those which did not perform educational interventions for health professionals to promote spontaneous reports of ADE in healthcare institutions and did not assess their impact were excluded from the present study. Included manuscripts were independently reviewed by two authors (C.P., F.R.V.) (STEP 3). Quality assessment of the manuscripts was not carried out. Disparities were resolved by discussion.

The extraction of the following variables of interest was performed: (i) design of the study; (ii) target group; (iii) workplace (level of health care where the educational interventions were carried out, corresponding to: primary [family physicians, pharmacies and drugstores]; secondary [outpatient clinics]; and tertiary [hospitals]); (iv) duration of the educational interventions; (v) techniques developed and applied; (vi) the impact on ADE reporting; and (vii) country where the study was performed.

The impact on ADE reporting was assessed in terms of the quantitative and qualitative parameters that were compared before and after the educational interventions. The quantitative impact was identified as the increase in the absolute numbers, percentages or rates of ADE reports after the educational intervention. The qualitative impact was observed as the increase in the absolute numbers, percentages or rates of reports of ADR classified as serious, unexpected, with a high degree of causality and related to new drugs on the market after the educational interventions.

RESULTS

Using the search strategy in computerized databases and manual search (STEP 1), a total of 101 articles was identified (Figure 1). After the initial screening, twenty-six were selected to be reviewed (STEP 2). Of these, sixteen met the inclusion criteria (Reference Ribeiro-Vaz, Herdeiro, Polónia and Figueiras4,Reference Herdeiro, Ribeiro-Vaz and Ferreira13Reference Johansson, Brunlöf, Edward and Wallerstedt27) (STEP 3); and ten were excluded (Reference Gerritsen, Faddegon, Dijkers, van Grootheest and van Puijenbroek28Reference Goldman37) (Table 1).

Figure 1. Flowchart of article selection process for systematic review on ADR reporting, adapted to The PRISMA Statement.

Table 1. Articles Excluded after Content Analysis and the Reason for Exclusion

Note. EI, educational intervention.

The designs of the eligible studies were longitudinal (six randomized controlled trials, five quasi-experimental, two case-control studies, two ecological time series analysis, one observational analytic), with duration ranging between 1 month and 2 years. A breakdown by geographical region showed that fourteen studies were conducted in Europe. In general, the physician was the main professional involved in the educational interventions (N = 12) and tertiary health care was the preferred level to carry out the interventions (N = 11). The educational interventions techniques frequently developed in the studies were: distribution of educational material or repeated sending of emails (N = 14); presentations - lectures, workshops, group dynamics, periodic meetings and outreach visits (N = 10) and interviews or questionnaires (N = 8) (Table 2).

Table 2. Description of the Countries, Level of Healthcare, Methods, and Educational Interventionsʼ Impact of the Studies Published in the Databases PUBMED, PAHO, LILACS, and EMBASE, from November of 2011 to January of 2012, Updated in March of 2013

Note. EI, educational intervention; ADR, adverse drug reaction; RR, relative risk; CI, confidence interval.

Regarding the impact of educational interventions, most studies (N = 12)(4,Reference Herdeiro, Ribeiro-Vaz and Ferreira13Reference Scott, Thacher-Renshaw and Rosenbaum23) showed an increase in the absolute numbers, percentages or rates of the spontaneous reports of ADR (including those considered serious, unexpected, with a high degree of causality and related to new drugs) and technical defects of health technologies. Two studies assessed only quantitative impacts (24,25); one showed only qualitative impacts (Reference Johansson, Hägg and Wallerstedt26); and the other one did not show significant differences in the indicators evaluated (Reference Johansson, Brunlöf, Edward and Wallerstedt27) (Table 2).

DISCUSSION

Pharmacovigilance-based educational interventions showed positive impacts (quantitative and qualitative) on ADE spontaneous reporting by health professionals in twelve studies analyzed, which adopted multifaceted techniques for interventions, including: lectures, placement of yellow cards, distribution of printed educational materials and giveaways, as well as the organization of workshops. The strategies adopted contributed to the adherence of health professionals to pharmacovigilance activities, changing the behavior/attitude of the employees toward the reporting of suspicions of problems related to safety and quality of health technologies. These findings corroborate the data of a systematic review performed by Forsetlund et al. (Reference Forsetlund, Bjorndal and Rashidian9), whose authors noted that general interventions (not related to ADR reporting/vigilance) developed for health professionals which apply multifaceted techniques are more effective in changing their behavior/attitude than single strategies.

Two studies applied only one technique in the educational intervention – repeated sending of emails (Reference Biagi, Montanaro and Buccellato24,Reference Johansson, Brunlöf, Edward and Wallerstedt27). However, just one showed a quantitative impact on ADR reporting (Reference Biagi, Montanaro and Buccellato24). The difference may be explained due to the major frequency of EI technique carried out by the Italian group (they sent an email with a brief newsletter on drug safety, once a month, for 10 months) (Reference Biagi, Montanaro and Buccellato24) when compared with the work performed by the Swedish group (they sent an email, three times in a year, with information regarding the importance of ADR report) (Reference Johansson, Brunlöf, Edward and Wallerstedt27). This finding suggests the importance of continuing education for health professionals to improve ADR reports.

The assessment of educational interventions’ impact by the absolute numbers of ADE reports has an important limitation, because this indicator does not take several factors into account that may increase or decrease these numbers. Therefore, the safety indicators may be overestimated. For example, the rise in the absolute number of spontaneous reports of ADE may be related to the inauguration of new wards or to the recruitment of new employees in the health institutions. Therefore, the improvement in the number of ADE reports might not be associated, necessarily, with the educational interventions.

Most interventions (N = 11) were conducted at the tertiary healthcare level. This is a good strategy in countries where the health professionals work in different levels of healthcare services (primary/secondary and tertiary), because the knowledge and attitudes acquired in educational interventions at the hospital can cover a larger geographic area, improving the surveillance of different drugs. However, the conduction of EI is necessary in all healthcare levels (drugstores, pharmacies, offices, ambulatories, and hospitals), with the purpose of stimulating the passive vigilance, the detection of ADE and to contributing for the assessment of drug safety and the regulation of pharmaceutical market.

Physicians were frequently included in the educational interventions identified (N = 12). In Europe, these professionals contribute with the most of the ADR reports received by Pharmacovigilance Centers (Reference Zolezzi and Parsotam38); indeed, some international programs of drug monitoring, for example the Swedish program, do not allow ADR reporting by pharmacists and nurses (Reference Grootheest, Olsson, Couper and de Jong-van den Berg39). The reason for this approach may be the belief that doctors, because they are the professionals responsible for the diagnosis, perform ADR reports of better quality (8).

All studies were conducted in countries that are members of the official World Health Organization (WHO) Program for International Drug Monitoring, which demonstrate the concern of these nations to raise the compliance of the health professionals to the pharmacovigilance service and to achieve the target number of ADR reports recommended by WHO. Therefore, the rates of underreporting would be minimized, allowing accurate evaluation of the safety, quality and effectiveness of available health technologies on the pharmaceutical market.

Regarding the duration of educational interventions, it was noted that those of longer duration aimed to cover larger numbers of employees of the institutions to increase the health professionals’ adherence and participation in the study, and to contribute to safety drug analysis. Besides, the periods established for the monitoring of ADE spontaneous reporting were useful to demonstrate the need for continuing education, because the numbers and rates of reports tended to be equal to those in the period before intervention, that is to say, a few months after the application of the educational intervention techniques. Therefore, Ribeiro-Vaz et al. (Reference Ribeiro-Vaz, Herdeiro, Polónia and Figueiras4) recommend the periodic updating of professionals, to keep them aware about the importance of reporting the suspicion of ADE.

Limitations of the Study

Data may be underestimated, owing to selection bias, because just four databases were consulted and only articles written in Spanish, English and Portuguese were analyzed. Consequently, some other pharmacovigilance educational interventions carried out to improve ADE reporting may not have been identified by the methodology adopted in this study. Furthermore, the quality assessment of the eligible manuscripts was not carried out. Therefore, the reliability of the findings demonstrated in the systematic review should be evaluated with caution.

CONCLUSION

Educational interventions for the promotion of pharmacovigilance by health professionals should: (i) be directed at a multidisciplinary health team and include issues related to ADR, technical defects of health technologies, medication errors and ineffective therapy; (ii) use multifaceted techniques with: lectures, group dynamics (to practice correct filling of yellow card), distribution of educational material and certificates; (iii) continue for the length of time needed to reach most professionals in the health institution (this variable depends on the size of the establishment staff); (iv) be conducted at all levels of health care to reach different patients and drugs, making it possible to assess the attributes of safety, quality and effectiveness of most drugs available in the public health sector, and (v) be offered periodically, with the view to update the health professionals in the pharmacovigilance service.

CONTACT INFORMATION

Caroline Pagotto Pharmacy student of the School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho – UNESP

Fabiana Varallo, MD, PhD student of the School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho – UNESP

Patrícia Mastroianni, PhD, () Assistant Doctor Professor of the School of Pharmaceutical Sciences of the Universidade Estadual Paulista Júlio de Mesquita Filho – UNESP

CONFLICTS OF INTEREST

All authors report they have no potential conflicts of interest.

References

REFERENCES

1.Leendertse, AJ, Visser, D, Egberts, AC, van den Bemt, PM. The relationship between study characteristics and the prevalence of medication-related hospitalizations: A literature review and novel analysis. Drug Saf. 2010;33:233244.CrossRefGoogle ScholarPubMed
2.Dequiro, AB, Mol, PG, van Doormaal, JE, et al.Preventable and non-preventable adverse drug events in hospitalized patients: A prospective chart review in the Netherland. Drug Saf. 2011;34:10891100.CrossRefGoogle Scholar
3.Hazell, L, Shaki, SA. Under-reporting of adverse drug reactions: A systematic review. Drug Saf. 2006;29:385386.CrossRefGoogle ScholarPubMed
4.Ribeiro-Vaz, I, Herdeiro, MT, Polónia, J, Figueiras, A. Strategies to increase the sensitivity of pharmacovigilance in Portugal. Rev Saude Publica. 2011;45:129135.CrossRefGoogle ScholarPubMed
5.Meyboom, RH, Egberts, AC, Gribnau, FW, Hekster, YA. Pharmacovigilance in Perspective. Drug Saf. 1999;21:429447.CrossRefGoogle Scholar
6.Conforti, A, Opri, S, D'Incau, P, et al.Adverse drug reaction reporting by nurses: Analysis of Italian pharmacovigilance database. Pharmacoepidemiol Drug Saf. 2012;21:597602.CrossRefGoogle ScholarPubMed
7.Gedde-Dahl, A, Harg, P, Stenberg-Nilsen, H, et al.Characteristics and quality of adverse drug reaction reports by pharmacists in Norway. Pharmacoepidemiol Drug Saf. 2007;16:9991005.CrossRefGoogle ScholarPubMed
8.OPS. Buenas Prácticas de Farmacovigilancia para las Américas. Washington, DC: OPS, © 2010. (Red PARF Documento Técnico No. 5). 78 pág.Google Scholar
9.Forsetlund, L, Bjorndal, A, Rashidian, A, et al.Continuing Education meeting and workshops: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;15:CD00303.Google Scholar
10.López-Gonzalez, E, Herdeiro, MT, Figueiras, A. Determinants of under-reporting of adverse drug reactions: A systematic review. Drug Saf. 2009;32:1931.CrossRefGoogle ScholarPubMed
11.Molokhia, M, Tanna, S, Bell, D. Improving reporting of adverse drug reactions: Systematic review. Clin Epidemiol. 2009;1:7592.CrossRefGoogle ScholarPubMed
12.Moher, D, Liberati, A, Tetzlaff, J, Altman, DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. J Clin Epidemiol. 2009;62:10061012.CrossRefGoogle ScholarPubMed
13.Herdeiro, MT, Ribeiro-Vaz, I, Ferreira, M, et al.Workshop- and telephone-based interventions to improve adverse drug reaction reporting: A cluster-randomized trial in Portugal. Drug Saf. 2012;35:655665.CrossRefGoogle ScholarPubMed
14.Cereza, G, Agustí, A, Pedrós, C, et al.Effect of an intervention on the features of adverse drug reactions spontaneously reported in a hospital. Eur J Clin Pharmacol. 2010;66:937945.CrossRefGoogle ScholarPubMed
15.Gony, M, Badie, K, Sommet, A, et al.Improving adverse drug reaction reporting in hospitals results of the French pharmacovigilance in Midi-Pyrénées Region (PharmacoMIP) Network 2-Year Pilot Study. Drug Saf. 2010;33:409416.CrossRefGoogle ScholarPubMed
16.Pedrós, C, Vallano, A, Cereza, G, et al.An intervention to improve spontaneous adverse drug reaction reporting by hospital physicians: A time series analysis in Spain. Drug Saf. 2009;32:7783.CrossRefGoogle ScholarPubMed
17.Herdeiro, MT, Polónia, J, Gestal-Otero, JJ, Figueiras, A. Improving the reporting of adverse drug reactions. A cluster-randomized trial among pharmacists in Portugal. Drug Saf. 2008;31:335344.CrossRefGoogle ScholarPubMed
18.Figueiras, A, Herdeiro, MT, Polónia, J, Gestal-Otero, JJ. An educational intervention to improve physician reporting of adverse drug reactions. A cluster-randomized controlled trial. JAMA. 2006;296:10861093.CrossRefGoogle ScholarPubMed
19.Bracchi, RC, Houghton, J, Woods, FJ, et al.A distance-learning programme in pharmacovigilance linked to educational credits is associated with improved reporting of suspected adverse drug reactions via the UK yellow card scheme. Br J Clin Pharmacol. 2005;60:221223.CrossRefGoogle ScholarPubMed
20.Backström, M, Mjorndal, T, Dahlqvist, R. Spontaneous reporting of adverse drug reactions by nurses. Pharmacoepidemiol Drug Saf. 2002;11:647650.CrossRefGoogle ScholarPubMed
21.Clarkson, A, Ingleby, E, Choonara, I, Bryan, P, Arlett, P. A novel scheme for the reporting of adverse drug reactions. Arch Dis Child. 2001;84:337339.CrossRefGoogle ScholarPubMed
22.McGettigan, P, Golden, J, Conroy, RM, Arthur, N, Feely, J. Reporting of adverse drug reaction by hospital doctors and the response to intervention. Br J Clin Pharmacol. 1997;44:98100.CrossRefGoogle ScholarPubMed
23.Scott, HD, Thacher-Renshaw, A, Rosenbaum, SE, et al.Physician reporting of adverse drug reaction. Results of the Rhode Island adverse drug reaction reporting project. JAMA. 1990;263:17851788.CrossRefGoogle ScholarPubMed
24.Biagi, C, Montanaro, N, Buccellato, E, et al.Underreporting in pharmacovigilance: An intervention for Italian GPs (Emilia-Romagna region). Eur J Clin Pharmacol. 2013;69:237244.CrossRefGoogle ScholarPubMed
25.Primo, LP, Capucho, HC. Intervenções educativas para estímulo a notificações voluntárias em um hospital de ensino da rede sentinela. Rev Bras Farm Hosp Serv. 2011;2:2630.Google Scholar
26.Johansson, ML, Hägg, S, Wallerstedt, SM. Impact of information letters on the reporting rate of adverse drug reactions and the quality of the reports: A randomized controlled study. BMC Clin Pharmacol. 2011;11:1419.CrossRefGoogle ScholarPubMed
27.Johansson, ML, Brunlöf, G, Edward, C, Wallerstedt, SM. Effects of e-mails containing ADR information and a current case report on ADR reporting rate and quality of reports. Eur J Clin Pharmacol. 2009;65:511514.CrossRefGoogle Scholar
28.Gerritsen, R, Faddegon, H, Dijkers, F, van Grootheest, K, van Puijenbroek, E. Effectiveness of pharmacovigilance training of general practitioners: A retrospective cohort study in the Netherlands comparing two methods. Drug Saf. 2011;34:755762.CrossRefGoogle ScholarPubMed
29.Baniasadi, S, Fahimi, F, Shalviri, G. Developing an adverse drug reaction reporting system at a teaching hospital. Basic Clin Pharmacol Toxicol. 2008;102:408411.CrossRefGoogle ScholarPubMed
30.Bäckström, M, Ekman, E, Mjörndal, T. Adverse drug reaction reporting by nurses in Sweden. Eur J Clin Pharmacol. 2007;63:613618.CrossRefGoogle ScholarPubMed
31.Durrieu, G, Hurault, C, Bongard, V, Damase-Michel, C, Montastruc, JL. Perception of risk of adverse drug reactions by medical students: Influence of 1 year pharmacological course. Br J Clin Pharmacol. 2007;64:233236.CrossRefGoogle ScholarPubMed
32.Granas, AG, Buajordet, M, Stenberg-Nilsen, H, Harg, P, Horn, AM. Pharmacists’ attitudes towards the reporting of suspected adverse drug reactions in Norway. Pharmacoepidemiol Drug Saf. 2007;16:429434.CrossRefGoogle ScholarPubMed
33.Bäckström, M, Mjörndal, T. A small economic inducement to stimulate increased reporting of adverse drug reactions – A way of dealing with an old problem? Eur J Clin Pharmacol. 2006;62:381385.CrossRefGoogle ScholarPubMed
34.Cox, AR, Marriott, JF, Wilson, KA, Ferner, RE. Adverse drug reaction teaching in UK undergraduate medical and programmes. J Clin Pharm Ther. 2004;29:3135.CrossRefGoogle ScholarPubMed
35.Rosebraugh, CJ, Tsong, Y, Zhou, F, et al.Improving the quality of adverse drug reaction reporting by 4th-year medical students. Pharmacoepidemiol Drug Saf. 2003;12:97101.CrossRefGoogle ScholarPubMed
36.Morrison-Griffiths, S, Walley, TJ, Park, BK, Breckenridge, AM, Pirmohamed, M. Reporting of adverse drug reactions by nurses. Lancet. 2003;361:13471348.CrossRefGoogle ScholarPubMed
37.Goldman, SA. Use of a mail-out continuing education article to teach health professionals about drug-induced disease. J Clin Pharmacol. 1999;39:11261135.CrossRefGoogle ScholarPubMed
38.Zolezzi, M, Parsotam, N. Adverse drug reaction reporting in New Zealand: Implications for pharmacists. Ther Clin Risk Manag. 2005;1:181188.Google ScholarPubMed
39.Grootheest, K, Olsson, S, Couper, M, de Jong-van den Berg, L. Pharmacists’ role in reporting adverse drug reactions in an international perspective. Pharmacoepidemiol Drug Saf. 2004;13:457464.CrossRefGoogle Scholar
Figure 0

Figure 1. Flowchart of article selection process for systematic review on ADR reporting, adapted to The PRISMA Statement.

Figure 1

Table 1. Articles Excluded after Content Analysis and the Reason for Exclusion

Figure 2

Table 2. Description of the Countries, Level of Healthcare, Methods, and Educational Interventionsʼ Impact of the Studies Published in the Databases PUBMED, PAHO, LILACS, and EMBASE, from November of 2011 to January of 2012, Updated in March of 2013