The Brazilian Journal of Infectious Diseases The Brazilian Journal of Infectious Diseases
Braz J Infect Dis 2017;21:140-7 - Vol. 21 Num.2 DOI: 10.1016/j.bjid.2016.11.003
Original article
Online continuing interprofessional education on hospital-acquired infections for Latin America
Julio C. Medina-Presentadoa, Alvaro Margolisb,c,, , Lucia Teixeirad,e, Leticia Lorierc, Ana C. Galesf, Graciela Pérez-Sartoria, Maura S. Oliveirag, Verónica Seijaa, Daniela Paciela, Rafael Vignolia, Silvia Guerraa, Henry Albornoza, Zaida Artetaa, Antonio Lopez-Arredondob,c, Sofía Garcíac
a Universidad de la República, Facultad de Medicina, Montevideo, Uruguay
b Universidad de la República, Facultad de Ingeniería, Montevideo, Uruguay
c EviMed, Montevideo, Uruguay
d Universidade Federal do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
e American Society for Microbiology, Washington DC, United States
f Universidade Federal de São Paulo, São Paulo, SP, Brazil
g Universidade de São Paulo, São Paulo, SP, Brazil
Received 31 May 2016, Accepted 05 November 2016
Abstract
Introduction

Latin America is a large and diverse region, comprising more than 600 million inhabitants and one million physicians in over 20 countries. Resistance to antibacterial drugs is particularly important in the region. This paper describes the design, implementation and results of an international bi-lingual (Spanish and Portuguese) online continuing interprofessional interactive educational program on hospital-acquired infections and antimicrobial resistance for Latin America, supported by the American Society for Microbiology.

Methods

Participation, satisfaction and knowledge gain (through pre and post tests) were used. Moreover, commitment to change statements were requested from participants at the end of the course and three months later.

Results

There were 1169 participants from 19 Latin American countries who registered: 57% were physicians and 43% were other health care professionals. Of those, 1126 participated in the course, 46% received a certificate of completion and 54% a certificate of participation. There was a significant increase in knowledge between before and after the course. Of 535 participants who took both tests, the grade increased from 59 to 81%. Commitments to change were aligned with course objectives.

Discussion

Implementation of this educational program showed the feasibility of a continent-wide interprofessional massive course on hospital acquired-infections in Latin America, in the two main languages spoken in the region. Next steps included a new edition of this course and a “New Challenges” course on hospital-acquired infections, which were successfully implemented in the second semester of 2015 by the same institutions.

Keywords
Internet, Continuing education, Interprofessional education, MOOC, Hospital-acquired infections, Latin America
Introduction

Latin America is a large and diverse region, where the predominant languages are Spanish and Portuguese, comprising more than 600 million inhabitants and one million physicians in over 20 countries, from Mexico in the North to Argentina and Chile in the South.

Resistance to antibacterial drugs is particularly important in Latin America. In this regard, a serious public health problem has been identified in the region on account of the emergence of resistance mechanisms and dissemination of these clones – particularly extended spectrum beta-lactamases (ESBLs) of the CTX-M type, and carbapenemases (KPC).1–4

Among non-fermenting Gram-negative bacilli infections, Acinetobacter baumannii has increased in most of South America and the Caribbean. As a result, in the last decade, resistance of A. baumannii to antibiotics has increased substantially probably due to the relative impermeability of the outer membrane and environmental exposure to a broad group of resistance genes.5–7

Moreover, in the last few years Clostridium difficile emerged worldwide as the main causative agent of nosocomial diarrhea. The Centers for Disease Control and Prevention (CDC, US Government) report an annual incidence of 453,000 cases in 2011, with 30,000 deaths per year related to “Clostridium difficile infection” (CDI). In Latin America there are few published studies, mainly of outbreaks reported in Brazil, Argentina, and Chile, but the real impact of CDI in this region as an agent of endemic infection is unknown. Only CDI cases caused by hypervirulent strains (ribotype 027) have been reported in Costa Rica and Chile but most likely this is underdiagnosed.8–11

Gram-positive cocci infections such as methicillin-resistant Staphylococcus aureus (MRSA) and vancomycin-resistant Enterococcus constitute a long-standing problem, but its real impact on hospital-acquired infections (HAI) has not been properly evaluated in our region.12

This complex situation is a challenge health care professionals in the region face everyday as to which is the best antimicrobial strategy – not only to cure their patients, but also to care for the ecosystem. Moreover, contact isolation policies for multi-resistant microorganisms, proper hospital hygiene, and compliance with hand hygiene procedures are highly variable and impact on patient safety.

A challenge of this online course was to address the problem described above, and its main objective was to provide comprehensive continuing interprofessional education about HAI caused by the most frequent microorganisms in Latin America. The target audience was the health personnel involved in this process: professional nurses certified in infection control, members of Committees of Hospital-Acquired Infections, members of Committees for Bacterial Control, medical doctors specialized in infectious diseases, intensive care and internal medicine, microbiologists, bacteriologists, and other health professionals related to this topic in Latin America.

The use of information and communication technologies (ICT) is evolving constantly, with innovations and the potential for more interactive and engaging strategies to be incorporated into educational programming, still allowing for massive participation of physicians, some of them from more remote locations of the countries. Therefore, in 2014, EviMed was invited by the Society for Worldwide Medical Exchange, a non-profit organization based in Miami, to implement together with the American Society for Microbiology and the Department of Infectious Diseases, School of Medicine, Universidad de la República, Uruguay, the integration of ICT into their more traditional formats, based on its record of blended multifaceted programs in Latin America.13–16

The Faculty coordination, development of multimedia study materials, and tutoring roles were in charge of professors from four universities: Universidad de la República, Uruguay; Universidade Federal de São Paulo – Brazil (UNIFESP); University Clinical Hospital, School of Medicine, University of São Paulo – Brazil (HCFM-USP); School of Medical Sciences, Federal University of Rio de Janeiro – Brazil.

A collaborative work was done together with the American Society for Microbiology (ASM), Centers for Disease Control and Prevention (CDC), Pan American Health Organization (PAHO/WHO) and the Pan American Association of Infectious Diseases (API), which provided information for the needs assessment, international and regional experts to develop teaching materials, speakers for the launching event, and dissemination across the region.

This paper describes the design, implementation and results of a multi-country bi-lingual (Spanish and Portuguese) continuing interprofessional education program on HAI and antimicrobial resistance for Latin America.

MethodsProgram content and structure

The course was implemented in the months of July to September 2014. The topic was HAI and antimicrobial resistance. A needs assessment with experts from the region and the target audience was performed through telephone interviews, in order to prioritize the topics to be addressed. The program design was then developed in conjunction between the Uruguayan and Brazilian central Faculty and the ASM liaison expert from Brazil (co-author LT), for which a two-day live workshop was organized.

The content included:

  • Current threats of the main antimicrobial resistances: local and global epidemiological aspects.

  • Resistance mechanisms.

  • Diagnostic approaches in the laboratory: detection methods and interpretation of results.

  • Rational use of antimicrobial agents.

  • Prevention and surveillance measures.

  • Isolation and hygiene measures.

  • Outbreaks control.

  • Clinical management and new treatments.

The topics above were covered while addressing the following microorganisms: C. difficile, infections caused by extended spectrum beta-lactamase producing Gram-negative bacilli (ESBL-GNB), Acinetobacter, carbapenemase producing enterobacteria, vancomycin resistant Enterococcus (VRE), and MRSA.

Target audience

The target audience was Spanish- and Portuguese-speaking professionals dealing with these conditions across the Latin American region. It could be subdivided into three main groups:

  • (1)

    Physicians taking care of individual patients with these infections (e.g., infectious disease specialists, internists, intensive care physicians, nephrologists, and others).

  • (2)

    Infection control professionals, both nurses and physicians, working in infection control committees or in hospital wards at health care institutions, dealing with the prevention and management of outbreaks and antimicrobial resistance at the institutional level.

  • (3)

    Microbiologists, who deal with this problem from the laboratory perspective, in coordination with the above two groups. In Latin America, microbiologists can be either specialized physicians or biochemists, depending on the country.

There was a challenge involved in having such a diverse audience, in order to produce learning paths meaningful to each of them and to the teams as a whole, and at the same time benefit in the case discussions from the fact that both Faculty and learners had these different backgrounds, resembling real-life settings. The course was then structured in modules, some of them were more focused on solving individual clinical cases, and some of the others were more focused on solving outbreaks of the infections produced by these lead cases, therefore allowing for the different professions to participate and interact with each other, according to their training and experience, thus enriching the discussions.

Health care professionals were invited to register through the different academic networks and with the help of professional congress organizers in some of the countries; promotion was also done to potential sponsors. The Society for Worldwide Medical Exchange coordinated the convening for the course with the different stakeholders and the registration process. There was a registration fee: USD 100 for physicians and USD 75 for other health professionals. Full scholarships were also given by the organizing institutions to national scientific societies and upon request and by commercial sponsors to groups of professionals invited by them.

Implementation of program

EviMed provided a multidisciplinary team of communication and educational experts, clinicians, system engineers, medical information specialists and translators to design and implement the course, together with regional and international domain experts provided by the participating academic institutions. There were 25 expert lecturers, including 21 from Latin America, as well as 2 European and 2 North American experts. Including the tutoring roles, 28 domain experts participated in the design and implementation of this course.

A multifaceted approach was used, in order to maximize opportunities for health care professional participation and ensure that participants could interact and reflect on the material and with each other.

Accordingly, the activities began with on-site and on-line synchronous launching event. The launching event was in Montevideo, Uruguay, on July 25, 2014; experts from CDC and ASM coming from the US, Europe, and Brazil participated onsite. It had simultaneous translation between Spanish and Portuguese at the main room and with two streaming channels for the remote participants, according to their language preference. It was also designed for both remote and onsite participation for large audiences, with voting and questions from the audience.

This was followed by a distance education six-week on-line modality with multiple educational strategies. Reading resources, videos and voice-over-presentations were published, together with pre and post tests, patient aids, and electronic rounds (e-rounds) on clinical cases. Additionally, two clinical simulations using a custom tool developed with the School of Engineering, Universidad de la República, Uruguay17 were used, in order to provide applied learning through knowledge discovery and automatic feedback. They were implemented for two of the six modules; there were two versions of each, designed for either physicians or nurses, and had multiple possible pathways, some better than others, not only right or wrong paths, as in real settings. See Fig. 1.

Fig. 1.
(0.36MB).

Graph of one of the simulations. Please note different paths can eventually have similar results.

The e-rounds were asynchronous discussion groups in either Spanish or Portuguese, coordinated by tutors who were native speakers of each of the two languages, and were specifically trained for that role; moreover, there was a weekly remote meeting among all tutors and course coordinators to ensure that the feedback provided was consistent among the groups. There were four groups (one in Portuguese and three in Spanish) for the discussions of clinical cases and outbreaks. For the clinical simulations, there were two groups (one in Spanish and another in Portuguese), where people could comment their perspective on the simulated cases. Finally, the introductory and final exchange spaces were shared by all participants, no matter the language; this was particularly important for Brazil, to see the international dimension of the course.

This modality allowed course attendees to participate whenever they could and wished to, lacking a fixed schedule to access the e-round.

A total of 26h of study workload along two months was estimated, in order to complete the course.

Most of the study materials were developed by the central Faculty, except for the short video lectures by international experts, which were taped remotely from their work or home, then underwent post production and subtitling.

Data collection and analysis

Regarding course evaluation, participation, satisfaction and knowledge gain pre and post tests were used. Moreover, commitment to change statements was requested from participants at the end of the course.

The requirements for the certificate of completion were:

  • -

    Access to at least 70% of the study materials.

  • -

    Grading of at least 70% of tests in each module.

  • -

    Completion of the clinical simulations.

  • -

    Participation in at least 50% of discussion forums.

A t test for paired samples was used to compare pre and post test results. Commitment to change statements was categorized by topic.

A sample site with the layout of this course in English can be seen at: http://courses.evimed.net/.

ResultsRegistration

There were 1169 participants, most of them coming from 19 Latin American Countries, but also from the USA, Spain and Portugal (see Table 1), who registered for the course, of which 824 registered individually, 247 had a sponsored scholarship, and 98 were given a scholarship by the organizing institutions. Of this total, 265 were Portuguese-speaking and 904 were Spanish-speaking.

Table 1.

Individual number of registrations by country.

Individual registrations by country  Number of respondents 
Brazil  264 
Argentina  238 
Uruguay  229 
Mexico  207 
Chile  62 
Panama  24 
Paraguay  24 
Colombia  23 
Venezuela  22 
Ecuador  21 
Peru  15 
Costa Rica  11 
Dominican Republic 
Salvador 
Bolivia 
Spain and Portugal 
Honduras 
USA 
Nicaragua 
Cuba 
Guatemala 
Puerto Rico 

Regarding the characteristics of the audience, 57% were physicians and 43% were other health care professionals.

Participation

Ninety-six percent of registrants enrolled in the course (n=1128) accessed the online campus, and 99.8% of them (n=1126) participated in the course. Of this last figure, 46% received a certificate of completion (n=522) and 54% a certificate of participation (n=604). The hybrid launching event had a live participation of 225 onsite and 110 online. The lecture recordings from the event were later uploaded in the virtual campus.

The total amount of posts in discussions was 7945, with an average of posts by participant of 6.8. Regarding the interactive case simulations, the numbers were the following: A – Non-Physicians: 409. A – Physicians: 504. B – Non-Physicians: 608. B – Physicians: 533.

Satisfaction

The number of respondents that completed the satisfaction survey was 393. Seventy-three of them (n=286) defined the course as “very good”, 24% (n=94) as “good”, 3% as acceptable (n=13), with no mentions as bad or very bad.

Regarding the relative importance of learning activities, see Table 2. The best and worst aspects of the course are listed in Tables 3 and 4, and the aspects that limited learning in Table 5.

Table 2.

Order of importance for learning activities.

Order of importance in campus components as a learning contribution
(1=contributed less – 6=contributed more)
ItemNumber of people who marked each position
1  2  3  4  5  6 
Videos by experts  19  23  44  52  79  108 
Reading materials  14  15  25  54  115  108 
Clinical simulations  17  58  108  58  78 
Discussion forums of cases  23  96  101  65  30  10 
Knowledge tests  51  105  82  38  40 
General exchange forum  211  69  15  19 
Table 3.

Course evaluation by participants. Best aspects of the course.

Item  Number of respondents 
Topic and approach  251  64 
Clinical simulations  248  63 
Didactic materials  204  52 
Teaching methodology  173  44 
Participation of several countries  120  31 
Interaction with professors  104  26 
Interaction with colleagues  67  17 
Learning assessments  62  16 
Campus usability  53  13 
Users support service  17 
Nothing in particular 
Other 
Table 4.

Course evaluation by participants. Worst aspects of the course.

Item  Number of respondents 
Nothing in particular  291  74 
Interaction with colleagues  17 
Interaction with professors  14 
Topic and approach  11 
Learning assessments  18 
Users support service 
Didactic materials 
Campus usability 
Teaching methodology 
Participation of several countries 
Clinical simulation 
Other  41  10 
Table 5.

Course evaluation by participants. Aspects which limited learning.

Item  Number of respondents 
Time shortage  225  57 
None  111  28 
Internet connection  33 
Interacting requirement  39  10 
Distance learning modality  14 
Challenges with software 
Topic lacked interest 
Other  37 

A special request was made by nurses, to have specific tests for them in next courses, since most of the questions about antibiotic selection were not pertinent for their professional profile.

Knowledge acquisition

There was a significant increase in knowledge between before and after the course. Of 535 participants who took both tests, the grade increased from 59 to 81% (p<0.001).

Commitment to change

The number of participants who completed the commitment to change was 298, who produced 795 commitments. The topics addressed in these commitments are shown in Table 6, and the follow-up three months later is shown in Table 7.

Table 6.

Commitment to change.

Indicator  Number of commitments 
Education of colleagues, patients and self  204 
Improve self professional practice  131 
Improve antimicrobial use  118 
Hygiene measures  94 
Epidemiological surveillance  76 
Improve diagnosis  54 
Creation of infection control committees  31 
Scientific dissemination  24 
Biosecurity  16 
Table 7.

Follow-up of commitments.

Indicator  Number of respondents   
Participants who responded three months later  84  28  Of the total of participants who completed the commitment to change 
Commitments fulfilled  101  13  Of the total of commitments 
Commitments not fulfilled  62  Of the total of commitments 
Commitments partially fulfilled  100  13  Of the total of commitments 
Discussion

The results of participation and completion of the course were similar to other courses with this design, and better than most MOOCs.16,18 In most Latin American countries, professional recertification is not enforced, so participants mostly registered in this course for learning, rather than earning credits. The pretest was not required to obtain the certificate, while the post test was: this limited the number of participants who took both tests. Still, the percentage of participants who took both tests in our experience was similar to other courses in different disciplines.16

It could be debated whether the number of participants in each of the e-round groups should have been lower, such in certificate courses, or larger such as in MOOCs; empirically, we have found that this group size works, as long as peers are stimulated to engage actively in the discussions with each other, and the role of Faculty and tutors is guiding them, rather than interacting on a one-to-one basis.

Regarding the reach as a percentage of the target audience, it is difficult to estimate because of the different professional profiles involved, but in any case, having over 1100 professionals taking a course from most countries in the region implies a massive educational intervention.

Regarding its impact on knowledge, there is a well-defined increase, probably related to some design elements that produced positive results (i.e., a sequential, multifaceted, interactive course).19–21 Moreover, there are indirect indicators of possible impact on clinical practice, such as the commitment to change statements, aligned with the course objectives.22

Interprofessional education occurs when two or more health and social care professions are interactively learning “about, from and with each other”.23 It focuses on changing practice of health care teams in order to improve health care outcomes. Computer-supported collaborative learning has shown to be more engaging than individual online learning, as a result of immediate feedback from their co-learners and social pressure from them, and has been proposed when deeper learning is sought, particularly in complex and interprofessional educational experiences.24 It may also mimic real-life interactions within the health care team. On the other hand, it needs to be well designed and guided, to avoid negative outcomes.24 In this case, in most instances the learning experience was positive and engaging throughout the course for all professional profiles, and the exchange across professions in the case discussions was fruitful.

Regarding the limitations of this study, it should be noted that it had no control group, and that it lacks information about results on participants who did not complete all the evaluations (satisfaction, knowledge acquisition, among other). However, it provides insight about the cohort who did complete all stages, and it also has objective data on the total cohort (such as participation).

Regarding next steps, a new edition of this course and a “new challenges” course on HAI were implemented during the second semester of 2015 with support from the American Society for Microbiology and the same Universities in Latin America. Requests for improvement from participants in this first edition were taken into account for these courses. Particularly, two different tests were produced for this new edition: for physicians and for non-physicians, to focus evaluation on topics more related to their knowledge and practice.

Conclusions

The implementation of this educational program showed the feasibility of an international and interprofessional massive course on hospital acquired-infections in Latin American, covering the two main languages spoken across the entire region, Spanish and Portuguese.

The inherently different cost structure of online versus onsite educational interventions,25 and the potential reach across and within Latin American countries by using online education as a disruptive innovation,26,27 shows a possible way of providing quality education to its one million physicians along with the other members of the health care team.

Lessons for practice

Continuing interprofessional education in HAI was challenging but possible, mimicking real-world interactions, thus explaining part of the success of this initiative.

Massive interactive online courses in the regional languages, addressing local needs, with international and local Faculty, may be a possible way to efficiently address the educational needs of one million physicians working in Latin America, as well as the other health professionals and teams considered as a whole.

Funding

This educational program was supported financially by the Society for Worldwide Medical Exchange and the American Society for Microbiology.

Conflicts of interest

The authors declare no conflicts of interest.

Acknowledgements

The authors would like to acknowledge the participation of the international experts and tutors for the regional needs assessment, the production of study materials and the delivery of the course. And in particular, the presence of Dr. Rafael Cantón (Hospital Universitario Ramón y Cajal, Madrid, Spain) and Dr. Denise Cardo (CDC, USA) at the live launching event in Montevideo was very important.

We also thank the enthusiasm and support from Ms. Connie Herndon, Director of Strategic Alliances at the American Society for Microbiology.

References
1
C.G. Carvalhaes,R. Cayô,A.C. Gales
Klebsiella pneumoniae carbapenemase-producing Klebsiella pneumoniae in the intensive care unit: a real challenge to physicians, scientific community, and society
2
A.C. Gales,M. Castanheira,R.N. Jones,H.S. Sader
Antimicrobial resistance among Gram-negative bacilli isolated from Latin America: results from SENTRY Antimicrobial Surveillance Program (Latin America, 2008–2010)
Diagn Microbiol Infect Dis, 73 (2012), pp. 354-360 http://dx.doi.org/10.1016/j.diagmicrobio.2012.04.007
3
N. Cordeiro,L. Robino,J. Medina
Profloxacin-resistant enterobacteria harboring the aac(6)-Ib-cr variant isolated from feces of inpatients in an intensive care unit in Uruguay
Antimicrob Agents Chemother, 52 (2008), pp. 806-807 http://dx.doi.org/10.1128/AAC.00444-07
4
M.S. de Oliveira,D.B. de Assis,M.P. Freire
Treatment of KPC-producing Enterobacteriaceae: suboptimal efficacy of polymyxins
Clin Microbiol Infect, 21 (2015),
179.e1–7
5
J.C. Medina-Presentado,V. Seija,R. Vignoli
Polyclonal endemicity of Acinetobacter baumannii in ventilated patients in an intensive care unit from Uruguay
Int J Infect Dis, 17 (2013), pp. e422-e427 http://dx.doi.org/10.1016/j.ijid.2012.12.025
6
J. Medina,C. Formento,J. Pontet
Prospective study of risk factors in patients with ventilator-associated pneumonia caused by Acinetobacter spp.
J Crit Care, 22 (2007), pp. 18-27 http://dx.doi.org/10.1016/j.jcrc.2006.06.010
7
R. Cayô,F. Rodrigues-Costa,A.P. Matos,C.G. Carvalhaes,T. Jové,A.C. Gales
Identification of a new integron harboring blaIMP-10 in carbapenem-resistant Acinetobacter baumannii clinical isolates
Antimicrob Agents Chemother, 59 (2015), pp. 3687-3689 http://dx.doi.org/10.1128/AAC.04991-14
8
F.C. Lessa,Y. Mu,W.M. Bamberg
Burden of Clostridium difficile infection in the United States
N Engl J Med, 372 (2015), pp. 825-834 http://dx.doi.org/10.1056/NEJMoa1408913
9
C. Aguayo,R. Flores,S. Lévesque
Rapid spread of Clostridium difficile NAP1/027/ST1 in Chile confirms the emergence of the epidemic strain in Latin America
Epidemiol Infect, 17 (2015), pp. 1-5
10
C. Quesada-Gómez,D. López-Ureña,L. Acuña-Amador
Emergence of an outbreak-associated Clostridium difficile variant with increased virulence
J Clin Microbiol, 53 (2015), pp. 1216-1226 http://dx.doi.org/10.1128/JCM.03058-14
11
D. Paciel,J. Medina
Clostridium difficile: historia de una infección emergente y su manejo actual
An Fac Med (Univ Repúb Urug), 2 (2015), pp. 1-10
12
V.L. Merquior,A.R. Faria,F.S. Rocha,J.M. Morais,F.P. Neves,L.M. Teixeira
Emergence and characterisation of vanB vancomycin-resistant Enterococcus faecalis in Rio de Janeiro, Brazil
Mem Inst Oswaldo Cruz, 107 (2012), pp. 557-560
13
H. Cohen,A. Margolis,N. González
[Implementation and evaluation of a blended learning course on gastroesophageal reflux disease for physicians in Latin America]
Gastroenterol Hepatol, 37 (2014), pp. 402-407 http://dx.doi.org/10.1016/j.gastrohep.2014.01.004
14
L. Llambí,E. Esteves,E. Martinez
Teaching tobacco cessation skills to Uruguayan physicians using information and communication technologies
J Contin Educ Health Prof, 31 (2011), pp. 43-48 http://dx.doi.org/10.1002/chp.20100
15
A. Margolis,B. Santiago,E. Martínez
Four-year collaboration in CME among Latin American institutions
CME Congress, (2012)
16
A. Margolis,F. Gonzalez-Martinez,O. Noboa
Online continuing medical education for the Latin American nephrology community
Stud Health Technol Inform, 216 (2015), pp. 372-375
17
Medeiros N, Pérez G, Sniadover N, López A. Generador de casos interactivos. Presented at MoodleMoot Uruguay 2011. Available at: http://www.moodlemoot.org.uy/moodlemoot_2011/moodlemoot/moodlemootuy2011_submission_26.pdf.
18
T.R. Liyanagunawardena,S.A. Williams
Massive open online courses on health and medicine: review
J Med Internet Res, 16 (2014), pp. e191 http://dx.doi.org/10.2196/jmir.3439
19
M. Mansouri,J. Lockyer
A meta-analysis of continuing medical education effectiveness
J Contin Educ Health Prof, 27 (2007), pp. 6-15 http://dx.doi.org/10.1002/chp.88
20
M. Lam-Antoniades,S. Ratnapalan,G. Tait
Electronic continuing education in the health professions: an update on evidence from RCTs
J Contin Educ Health Prof, 29 (2009), pp. 44-51 http://dx.doi.org/10.1002/chp.20005
21
J. Parboosingh,V.A. Reed,J. Caldwell Palmer,H.H. Bernstein
Enhancing practice improvement by facilitating practitioner interactivity: new roles for providers of continuing medical education
J Contin Educ Health Prof, 31 (2011), pp. 122-127 http://dx.doi.org/10.1002/chp.20116
22
J. Wakefield,C.P. Herbert,M. Maclure,C. Dormuth,J.M. Wrig,J. Legare
Commitment to change statements can predict actual change in practice
J Contin Educ Health Prof, 23 (2003), pp. 81-93 http://dx.doi.org/10.1002/chp.1340230205
23
J.A. Owen,M.H. Schmitt
Integrating interprofessional education into continuing education: a planning process for continuing interprofessional education programs
J Contin Educ Health Prof, 33 (2013), pp. 109-117 http://dx.doi.org/10.1002/chp.21173
24
H. MacNeill,D. Telner,A. Sparaggis-Agaliotis,E. Hanna
All for one and one for all: understanding health professionals’ experience in individual versus collaborative online learning
J Contin Educ Health Prof, 34 (2014), pp. 102-111 http://dx.doi.org/10.1002/chp.21226
25
S. Maloney,R. Haas,J.L. Keating
Breakeven cost benefit cost effectiveness and willingness to pay for web-based versus face-to-face education delivery for health professionals
J Med Internet Res, 14 (2012), pp. e47 http://dx.doi.org/10.2196/jmir.2040
26
C.M. Christensen,E.G. Armstrong
Disruptive technologies: a credible threat to leading programs in continuing medical education?
J Contin Educ Health Prof, 18 (1998), pp. 69-80
27
J.M. Harris Jr.,B.M. Sklar,R.W. Amend,C. Novalis-Marine
The growth, characteristics, and future of online CME
J Contin Educ Health Prof, 30 (2010), pp. 3-10 http://dx.doi.org/10.1002/chp.20050
Corresponding author. (Alvaro Margolis Alvaro.Margolis@evimed.net)
Copyright © 2016. Sociedade Brasileira de Infectologia
Braz J Infect Dis 2017;21:140-7 - Vol. 21 Num.2 DOI: 10.1016/j.bjid.2016.11.003