A systematic review of the effectiveness of journal clubs in undergraduate medicine
DOI:
https://doi.org/10.36834/cmej.72758Abstract
Background: Training future doctors in the skills of evidence-based medicine (EBM) is clearly important. Journal club (JCs) are well-recognized educational interventions for teaching EBM. In contrast to postgraduate medical education, JCs use in undergraduate medical education (UME) has not been adequately explored. We conducted a realist review of the effectiveness of JCs in UME to unpack the underlying mechanisms by which the intervention works (or fails) in teaching EBM.
Methods: The scope of review was the evaluation of the effectiveness of JCs in UME settings. We searched major bibliographic databases - MEDLINE, Embase, ERIC, PSYCInfo, CINAHL, Scopus, and Web of Science and found fifteen articles eligible for inclusion. Data was extracted aided by a modified Kirkpatrick framework and presented in evidence tables. Themes and chains of inference were identified, and finally, we formulated new hypotheses on how and why JC intervention works.
Results: Mandatory vs. voluntary JC did not differentially impact attendance of JC in UME settings though JC duration beyond two hours decreased attendees’ self-reported satisfaction. Coupling lectures to JCs positively impacts knowledge gain and retention. Coupled Mentorship or using critical appraisal worksheets helped the achievement of manuscript writing skills and a positive attitude towards EBM.
Conclusions: Journal clubs are effective interventions to teach EBM in UME settings and are well-received by learners. They improve specific learning outcomes of knowledge gain and retention, skills of manuscript writing and critical appraisal. However, we found no evidence that these translates to the practice of EBM nor impacts patient outcomes.
References
Aronson JK. Journal Clubs: 1. Origins. BMJ Evidence-Based Med. 2017;22:231. https://doi.org/10.1136/ebmed-2017-110860 DOI: https://doi.org/10.1136/ebmed-2017-110860
Straus S, Glasziou P, Richardson W, Haynes R. Evidence-based medicine: how to practice and teach EBM. Edinburgh: Elsevier; 2019.
Harris J, Kearley K, Heneghan C, et al. Are journal clubs effective in supporting evidence-based decision making? A systematic review BEME Guide No. 16. Med Teach. 2011;33(1):9-23. https://doi.org/10.3109/0142159X.2011.530321 DOI: https://doi.org/10.3109/0142159X.2011.530321
Biswas T. Role of journal clubs in undergraduate medical education. Indian J Community Med. 2011;36(4):309-310. https://doi.org/10.4103/0970-0218.91422 DOI: https://doi.org/10.4103/0970-0218.91422
Deenadayalan Y, Grimmer‐Somers K, Prior M, Kumar S. How to run an effective journal club: a systematic review. J Eval Clin Pract. 2008;14:898-911. https://doi.org/10.1111/j.1365-2753.2008.01050.x DOI: https://doi.org/10.1111/j.1365-2753.2008.01050.x
Honey CP, Baker JA. Exploring the impact of journal clubs: a systematic review. Nurse Educ Today. 2011;31(8):825-831. https://doi.org/10.1016/j.nedt.2010.12.020 DOI: https://doi.org/10.1016/j.nedt.2010.12.020
Ebbert JO, Montori VM, Schultz HJ. The journal club in postgraduate medical education: a systematic review. Med Teach. 2001;23(5):455-461. https://doi.org/10.1080/01421590120075670 DOI: https://doi.org/10.3109/01421590109177943
Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004;329(7473):1017. https://doi.org/10.1136/bmj.329.7473.1017 DOI: https://doi.org/10.1136/bmj.329.7473.1017
Edwards R, White M, Gray J, Fischbacher C. Use of a journal club and letter-writing exercise to teach critical appraisal to medical undergraduates. Med Educ. 2001;35:691-694. https://doi.org/10.1046/j.1365-2923.2001.00972.x DOI: https://doi.org/10.1046/j.1365-2923.2001.00972.x
Banerjee Y, Azar AJ, Tuffnell C, Lansberg PJ, Bayoumi R, Davis D. A novel 6D-approach to radically transform undergraduate medical education: preliminary reflections from MBRU. BMC Med Educ. 2018; 18(1):304. https://doi.org/10.1186/s12909-018-1402-0 DOI: https://doi.org/10.1186/s12909-018-1402-0
Willett LR, Kim S, Gochfeld M. Enlivening journal clubs using a modified 'jigsaw' method’. Med Educ. 2013; 47(11):1127-1128. https://doi.org/10.1111/medu.12342 DOI: https://doi.org/10.1111/medu.12342
Kirkpatrick DL, Kirkpatrick JD. Kirkpatrick’s four levels of training evaluation. Alexandria, VA: ATD Press; 2016.
Praslova L. Adaptation of Kirkpatrick’s four level model of training criteria to assessment of learning outcomes and program evaluation in Higher Education. Educ. Assessment, Eval. Account. 2010;22:215–225. https://doi.org/10.1007/s11092-010-9098-7 DOI: https://doi.org/10.1007/s11092-010-9098-7
Frye AW, Hemmer PA. Program evaluation models and related theories: AMEE guide no. 67. Med Teach. 2012;34(5):e288-e299. https://doi.org/10.3109/0142159X.2012.668637 DOI: https://doi.org/10.3109/0142159X.2012.668637
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review--a new method of systematic review designed for complx policy interventions. J Health Serv Res Policy. 2005;10(Suppl 1):21–34. https://doi.org/10.1258/1355819054308530 DOI: https://doi.org/10.1258/1355819054308530
Reed DA, Beckman TJ, Wright SM, Levine RB, Kern DE, Cook DA. Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue. J Gen Intern Med. 2008;23(7):903-907. https://doi.org/10.1007/s11606-008-0664-3 DOI: https://doi.org/10.1007/s11606-008-0664-3
Berman D, Braig Z, Simms B, et al. Efficacy of medical student surgery journal club. J Surg Educ. 2019;76(1):83-88. https://doi.org/10.1016/j.jsurg.2018.06.006 DOI: https://doi.org/10.1016/j.jsurg.2018.06.006
Marušić A, Malički M, Sambunjak D, Jerončić A, Marušić M. Teaching science throughout the six-year medical curriculum: two-year experience from the University of Split School of Medicine, Split, Croatia. Acta Med Acad. 2014;43(1):50-62. https://doi.org/0.5644/ama2006-124.100 DOI: https://doi.org/10.5644/ama2006-124.100
Rosenthal J, Rosenthal KS. interactive journal club: teaching an old dog new tricks. J Med Educ Curric Dev. 2017;4:2382120517719710. https://doi.org/10.1177/2382120517719710 DOI: https://doi.org/10.1177/2382120517719710
Williams AD, Mann BD. Improved knowledge gain and retention for third-year medical students during surgical journal club using basic science review: a pilot study. Am J Surg. 2017;213(2):238-243. http://dx.doi.org/10.1016/j.amjsurg.2016.09.055 DOI: https://doi.org/10.1016/j.amjsurg.2016.09.055
Bahner DP, Royall NA. Advanced ultrasound training for fourth-year medical students: a novel training program at The Ohio State University College of Medicine. Acad Med. 2013;88(2):206-213. https://doi.org/10.1097/ACM.0b013e31827c562d DOI: https://doi.org/10.1097/ACM.0b013e31827c562d
Chakraborti C. Teaching evidence-based medicine using team-based learning in journal clubs. Med Educ. 2011;45(5):516-517. https://doi.org/10.1111/j.1365-2923.2011.03972.x DOI: https://doi.org/10.1111/j.1365-2923.2011.03972.x
Gokani SA, Sharma E, Sharma T, Moudhgalya, SV, Selvendran SS, Aggarwal N. Impact of a national journal club and letter writing session on improving medical students' confidence with critical appraisal. Adv Med Educ Pract. 2019;10:1081-1087. https://doi.org/10.2147/AMEP.S235260 DOI: https://doi.org/10.2147/AMEP.S235260
Quinn EM, Cantillon P, Redmond HP, Bennett D. Surgical journal club as a community of practice: a case study. J Surg Educ. 2014;71(4):606-612. https://doi.org/10.1016/j.jsurg.2013.12.009 DOI: https://doi.org/10.1016/j.jsurg.2013.12.009
Lucia VC, Swanberg, S.M. Utilizing journal club to facilitate critical thinking in pre-clinical medical students. Int J Med Educ. 2018;9:7-8. https://doi.org/10.5116/ijme.5a46.2214 DOI: https://doi.org/10.5116/ijme.5a46.2214
Bertelsen NS, DallaPiazza M, Hopkins MA, Ogedegbe G. Teaching global health with simulations and case discussions in a medical student selective. Global Health. 2015;11:28. https://doi.org/10.1186/s12992-015-0111-2 DOI: https://doi.org/10.1186/s12992-015-0111-2
Curtis A, Viyasar T, Ahluwalia V, Lazarus K. Educating medical students: introducing a journal club. Clin Teach. 2016;13(3):233-234. https://doi.org/10.1111/tct.12356 DOI: https://doi.org/10.1111/tct.12356
Currier RL, Schneider MR, Heubi JE. Taking journal clubs off autopilot: a case study of teaching literature evaluation skills to preclinical md/phd students. Med Sci Educ. 2013;23(4):572-577. https://doi.org/10.1007/BF03341682 DOI: https://doi.org/10.1007/BF03341682
Hultman CS, Connolly A, Halvorson EG, et al. Get on your boots: preparing fourth-year medical students for a career in surgery, using a focused curriculum to teach the competency of professionalism. J Surg Res. 2012;177(2):217-223. https://doi.org/10.1016/j.jss.2012.06.019 DOI: https://doi.org/10.1016/j.jss.2012.06.019
Eraut M, Hirsh W. The significance of workplace learning for individuals, groups and organisations; 2007 Available from: http://www.skope.ox.ac.uk/wp-content/uploads/2014/12/Monogrpah-09.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Jibril O Bello, Paul Grant
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Medical Education Journal will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication. If accepted for publication, it will be published online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
Authors who publish in the Canadian Medical Education Journal agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 Canada Licence. This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.
