Evaluating the outcomes of problem-based learning in postgraduate medical education: a systematic review and meta-analysis
DOI:
https://doi.org/10.36834/cmej.77394Abstract
Background: Educators have recently been compelled to incorporate more active instructional formats into medical education, such as problem-based learning (PBL). In view of the mixed outcome data on the use of PBL in postgraduate medical education (PGME), there is a need to synthesize the data to inform the application of PBL in PGME contexts.
Objective: The aim of this systematic review and meta-analysis was to synthesize learning outcomes of PBL in PGME contexts.
Methods: The authors systematically searched MEDLINE, Embase, APA PsycINFO, AMED, CINAHL, Web of Science, ERIC, and Cochrane databases from January 1, 1950, to July 1, 2022 for original studies that reported Kirkpatrick outcomes of PBL in PGME contexts. Outcomes data were extracted. Quantitative data relating to learning outcomes were meta-analyzed using a random-effects model to generate weighted mean differences.
Results: Of 4310 abstracts screened, the authors included 21 studies encompassing anesthesia, family medicine, internal medicine, occupational medicine, pediatrics, psychiatry, public health and surgical residency programs. The studies reported reaction (n = 12), learning (n = 15), behavioural (n = 6) and/or results outcomes (n = 4). Meta-analysis of the three eligible articles demonstrated no significant difference after PBL in pre- and post-test results (pooled mean difference=0.13%, 95% CI, -6.74–7.00). There were observed improvements in satisfaction levels and self-reported behavioural outcomes following PBL.
Conclusions: Although similar learning outcomes were observed using PBL and the usual teaching in PGME, PBL was associated with benefits in trainee satisfaction and behavioural changes that contribute to learning and performance. PGME programs should consider incorporating PBL into curricula.
References
1. Prober CG, Khan S. Medical education reimagined: A call to action. Acad Med. 2013;88(10):1407–10. https://doi.org/10.1097/ACM.0b013e3182a368bd
2. Prober CG, Heath C. Lecture halls without lectures — a proposal for medical education. N Engl J Med.2012 May 3;366(18):1657–9. https://doi.org/10.1056/NEJMp1202451
3. Trullàs JC, Blay C, Sarri E, Pujol R. Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review. BMC Med Ed 2022 22:1 2022 Feb 17;22(1):1–12. https://doi.org/10.1186/s12909-022-03154-8
4. Al-azri H, Ratnapalan S. Problem-based learning in continuing medical education L ’ apprentissage par problèmes en éducation médicale continue. Can Fam Phys. 2014;60:157–65.
5. Donner RS, Bickley H. Problem-based learning: an assessment of its feasibility and cost. Hum Pathol. 1990;21(9):881–5. https://doi.org/10.1016/0046-8177(90)90170-A
6. Trullàs JC, Blay C, Sarri E, Pujol R. Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review. BMC Med Educ. 2022;22(1):1–12. https://doi.org/10.1186/s12909-022-03154-8
7. Albanese MA, Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med 1993 Jan;68(1):52–81. https://doi.org/10.1097/00001888-199301000-00012.
8. Suliman S, Al-Mohammed A, Al Mohanadi D, et al. It is all about patients’ stories: case-based learning in residents’ education. Qatar Med J. 2019:17. http://dx.doi.org/10.5339/qmj.2019.17
9. Smits PB, de Buisonjé CD, Verbeek JH, van Dijk FJ, Metz JC, ten Cate OJ. Problem-based learning versus lecture-based learning in postgraduate medical education. Scand J Work Environ Health. 2003;29(4):280–7. https://doi.org/10.5271/sjweh.732
10. Santos‐Gomez L, Kalishman S, Rezler A, Skipper B, Mennin SP. Residency performance of graduates from a problem-based and a conventional curriculum. Med Educ.1990 Jul 1;24(4):366–75. https://doi.org/10.1111/j.1365-2923.1990.tb02453.x.
11. Albanese MA, Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med. 1993/01/01. 1993;68(1):52–81. https://doi.org/10.1097/00001888-199301000-00012
12. Hakim A, Gibson R, Johansson L. Problem-based learning as a tool in postgraduate medical education. Euro Resp J. 2017 Sep 1;50(suppl 61):PA2770. https://doi.org/10.1183/1393003.congress-2017.PA2770.
13. Hurst JW. The overlecturing and underteaching of clinical medicine. Arch Intern Med. 2004;164(15):1605. https://dx.doi.org/10.1001/archinte.164.15.1605
14. Graffam B. Active learning in medical education: strategies for beginning implementation. Med Teach. 2007 Feb;29(1):38-42. https://doi.org/10.1080/01421590601176398.
15. Karunathilake I. Role of Problem-Based Learning (PBL) in postgraduate medical education. J Postgraduate Inst Med. 2019 Jul 31;6(1):91. https://doi.org/10.4038/jpgim.8255
16. Zhao W, He L, Deng W, Zhu J, Su A, Zhang Y. The effectiveness of the combined problem-based learning (PBL) and case-based learning (CBL) teaching method in the clinical practical teaching of thyroid disease. BMC Med Educ. 2020;20(1). https://dx.doi.org/10.1186/s12909-020-02306-y
17. Albanese M. Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills. Med Educ. 2000 Sep;34(9):729–38. https://doi.org/10.1046/j.1365-2923.2000.00753.x
18. Covidence. Veritas Health Innovation.
19. Emily Jones M. Lib guides: creating a PRISMA flow diagram: new. PRISMA. 2020;
20. Cook DA, Reed DA. Appraising the quality of medical education research methods: the medical education research study quality instrument and the Newcastle–Ottawa scale-education. Acad Med. 2015;90(8):1067–76. https://doi.org/10.1097/ACM.0000000000000786
21. StataCorp L. Stata statistical software: Release 15 (2017). College Station, TX: StataCorp LP. 2017;
22. Smidt A, Balandin S, Sigafoos J, Reed VA. The Kirkpatrick model: A useful tool for evaluating training outcomes. J Intellect Dev Disabil. 2009;34(3):266–74. https://doi.org/10.1080/13668250903093125
23. Heading GS, Fuller JD, Lyle DM, Madden DL. Using problem-based learning in public health service based training. N S W Public Health Bull. 2007;18(1–2):8–13. https://doi.org/10.1071/NB07008
24. Sass P, Edelsack P. Teaching community health assessment skills in a problem-based format. Acad Med. 2001;76(1):88–91. https://doi.org/10.1097/00001888-200101000-00023
25. Cook DA, Thompson WG, Thomas KG, Thomas MR. Lack of interaction between sensing-intuitive learning styles and problem-first versus information-first instruction: a randomized crossover trial. Adv Health Sci Ed. 2009;14(1):79–90. https://doi.org/10.1007/s10459-007-9089-8
26. Foley RP, Levy J, Russinof HJ, Lemon MR. Planning and implementing a problem-based learning rotation for residents. Teach Learn Med. 1993;5(2):102–6. https://doi.org/10.1080/10401339309539600
27. Goodyear HM. Problem based learning in a junior doctor teaching programme. Arch Dis Child. 2005;90(3):275–8. https://doi.org/10.1136/adc.2003.037630
28. Ozuah PO, Curtis J, Stein REK. Impact of problem-based learning on residents’ self-directed learning. 2001;155(June):669–73. https://doi.org/10.1001/archpedi.155.6.669
29. Heru AM. Teaching psychosomatic medicine using problem-based learning and role-playing. Acad Psych. 2011;35(4):245–8. https://doi.org/10.1176/appi.ap.35.4.245
30. Schultz-Ross RA, Kline AE. Using problem-based learning to teach forensic psychiatry. Acad Psych. 1999;23(1):37–41. https://doi.org/10.1007/BF03340034
31. Shefet D, Levkovitz Y. A national educational interactive conference for psychiatry residents in Israel. Acad Psychiatry 2011 Nov 1;35(6):419–20. https://doi.org/10.1176/appi.ap.35.6.419
32. Nguyen L, Brunicardi FC, Dibardino DJ, Scott BG, Awad SS, Bush RL, et al. Education of the modern surgical resident: Novel approaches to learning in the era of the 80-hour workweek. World J Surg. 2006;30(6):1120–7. https://doi.org/10.1007/s00268-005-0038-5
33. Yates WR, Gerdes TT. Problem-Based Learning in Consulttion. Gen Hosp Psychiatry. 1996;1638343(96):139–44. https://doi.org/10.1016/0163-8343(96)00022-9
34. Prislin MD, Lenahan P, Shapiro J, Radecki S. Family practice residency behavioral science training: influence on graduate practice activity. Fam Med. 1997;29(7):483–7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/9232409
35. Lee L, Brunicardi FC, Scott BG, et al. Impact of a novel education curriculum on surgical training within an academic training program. J Surg Res. 2008;145(2):308–12. https://doi.org/10.1016/j.jss.2007.03.046
36. Mulder SF, Bleijenberg G, Verhagen SC, Stuyt PMJ, Schijven MP, Tack CJ. Improved competence after a palliative care course for internal medicine residents. Palliat Med. 2009;23(4):360–8. https://doi.org/10.1177/0269216308100250
37. Carrero E, Gomar C, Penzo W, Rull M. Comparison between lecture-based approach and case/problem-based learning discussion for teaching pre-anaesthetic assessment. Eur J Anaesthesiol. 2007;24(12):1008–15. https://doi.org/10.1017/S0265021506002304
38. Komasawa N, Berg BW, Minami T. Problem-based learning for anesthesia resident operating room crisis management training. PLoS One. 2018;13(11):1–10. https://doi.org/10.1371/journal.pone.0207594
39. Grol R, Mokkink H, Helsper‐Lucas A, Tielens V, Bulte J. Effects of the vocational training of general practice consultation skills and medical performance. Med Educ. 1989;23(6):512–21. https://doi.org/10.1111/j.1365-2923.1989.tb01577.x
40. Rodrigues de Oliveira Filho G, Schonhorst L. Problem-based learning implementation in an intensive course of anaesthesiology: a preliminary report on residents’ cognitive performance and perceptions of the educational environment. Med Teach. 2005;27(4):382–4. https://doi.org/10.1080/01421590500151021
41. Sakai T, Karausky PL, Valenti SL, Sandusky SL, Hirsch SC, Xu Y. Use of a problem-based learning discussion format to teach anesthesiology residents research fundamentals. J Clin Anesth. 2013 Sep;25(6):434–8. https://doi.org/10.1016/j.jclinane.2013.04.008
42. Schmidt HG. Problem-based learning: rationale and description. Med Educ. 1983 Jan;17(1):11–6. https://doi.org/10.1111/j.1365-2923.1983.tb01086.x
43. Itani KMF, Miller CC, Church HM, McCollum CH. Impact of a problem-based learning conference on surgery residents’ in training exam (ABSITE) scores. J Surg Res. 1997;70(1):66–8. https://doi.org/10.1006/jsre.1997.5112
44. Gruppen LD, Stansfield RB, Zhao Z, Sen S. Institution and specialty contribute to resident satisfaction with their learning environment and workload. Acad Med. 2015 Nov;90(11 Suppl):S77-82. https://doi.org/10.1097/ACM.0000000000000898
45. Thrush CR, Hicks EK, Tariq SG, et al. Optimal learning environments from the perspective of resident physicians and associations with accreditation length. Acad Med. 2007 Oct;82(10 Suppl):S121-5. https://doi.org/10.1097/ACM.0b013e318140658f
46. Cook DA, West CP. Perspective: Reconsidering the focus on “outcomes research” in medical education: a cautionary note. Acad Med. 2013 Feb;88(2):162–7. https://doi.org/10.1097/ACM.0b013e31827c3d78
47. Dweck C. Self-theories, their role in motivation, personality and development. Philadelphia, PA: Pyschology Press; 2000.
48. Newman M, Van Den Bossche P, et al. Responses to the pilot systematic review of problem-based learning. Med Educ. 2004;38(9):921–3. https://doi.org/10.1111/j.1365-2929.2004.01943.x.
49. Verma AA, Pasricha S V, Jung HY, et al. Assessing the quality of clinical and administrative data extracted from hospitals: the General Medicine Inpatient Initiative (GEMINI) experience. J Am Med Inform Assoc . 2021 Mar 1;28(3):578–87. https://doi.org/10.1093/jamia/ocaa225
50. Gonzalez ML, Salmoni AJ. Online problem-based learning in postgraduate medical education - content analysis of reflection comments. Teach Higher Educ. 2008;13(2):183–92. https://doi.org/10.1080/13562510801923302.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Emma A Mensour, Carolyn Tran, Toni Li, Indika Mallawaarachchi , Jennifer Shaw, Sarah Blissett
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Medical Education Journal will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication. If accepted for publication, it will be published online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
Authors who publish in the Canadian Medical Education Journal agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 Canada Licence. This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.
