Assessing the impact of virtual learning on family medicine trainees’ medical knowledge using progress tests: a retrospective cohort study
DOI:
https://doi.org/10.36834/cmej.78343Abstract
Background: Progress testing provides residents with an opportunity to identify strengths and weaknesses, encouraging self-directed learning. The University of Toronto’s Department of Family & Community Medicine administers the Family Medicine Mandatory Assessment of Progress (FM-MAP) biannually to track resident competency and medical knowledge. Our aim was to determine the impact of virtual learning on Family Medicine residents.
Methods: We administered previous iterations of the FM-MAP to the virtual learning cohort and compared scores to those of the in-person cohort between October 2020 - Spring 2022.
Results: There were no statistically significant differences between in-person and virtual cohorts of first- and second-year postgraduate family medicine trainees regarding their overall FM-MAP score. Second-year family medicine trainees outperformed first year trainees in both cohorts.
Conclusion: The study found no significant effect on the scores of first- and second-year family medicine trainees caused by the shift to virtual learning, suggesting medical curricula can incorporate virtual learning without compromising trainee progress, offering flexibility in medical education. Future studies could explore its applicability across different residency programs and long-term effects on clinical performance.
Downloads
References
1. Rose S. Medical student education in the time of COVID-19. JAMA. 2020;323(21):2131–2. https://doi.org/10.1001/jama.2020.5227
2. McCarthy C, Carayannopoulos K, Walton JM. COVID-19 and changes to postgraduate medical education in Canada. CMAJ 2020;192(35):E1018–20. https://doi.org/10.1503/cmaj.200882
3. The Association of Faculties of Medicine of Canada (AFMC). AFMC principles and guidelines in the era of COVID-19. Ottawa, ON; AFCM 2020. Available from: https://afmc.ca/en/priorities/covid19. [Accessed Apr 2021].
4. Leung FH, Herold J, Iglar K. Family medicine mandatory assessment of progress: results of a pilot administration of a family medicine competency-based in-training examination. Can Fam Physician. 2016;62(5):e264–7.
5. Royal College of Physicians and Surgeons of Canada. CanMEDS framework. Royalcollege.ca. Available from: https://canmeds.royalcollege.ca/guide [Accessed on Jul 1, 2023].
6. Iglar K, Leung F-H, Moineddin R, Herold J. FM-MAP: a novel in-training examination predicts success on family medicine certification examination. Fam Med. 2017;49(5):369–73.
7. Chen Y, Henning M, Yielder J, Jones R, Wearn A, Weller J. Progress testing in the medical curriculum: students’ approaches to learning and perceived stress. BMC Med Educ 2015;15(1). https://doi.org/10.1186/s12909-015-0426-y
8. Schuwirth LWT, Van der Vleuten CPM. The use of progress testing. Perspect Med Educ. 2012;1(1):24–30. https://doi.org/10.1007/S40037-012-0007-2
9. Department of Family and Community Medicine. Family medicine medical expert assessment of progress (FM-MAP) performance. Toronto; DFCM. Updated 2023. Available from: https://dfcm.utoronto.ca/family-medicine-medical-expert-assessment-progress-fm-map-performance. [Accessed Jul 1, 2023]
10. Rajab M, Gazal A, Alkattan K. Challenges to online medical education during the COVID-19 pandemic. Cureus. 2020;12(7):e8966. https://doi.org/10.7759/cureus.8966
11. Tabatabai S. COVID-19 impact and virtual medical education. J Adv Med Educ Prof. 2020;8(3):140–3. https://doi.org/10.30476/jamp.2020.86070.1213.
12. Lim JJ and Veasuvalingam B. Do virtual case-based discussions foster clinical reasoning in medical students? [version 1; not peer reviewed]. MedEdPublish 2023, 13:55 (slides) (https://doi.org/10.21955/mep.1115223.1)
13. Plackett R, Kassianos AP, Mylan S, et al. The effectiveness of using virtual patient educational tools to improve medical students’ clinical reasoning skills: a systematic review. BMC Med Educ. 2022;22, 365 https://doi.org/10.1186/s12909-022-03410-x.
14. Andrew RF. How do IMGs compare with Canadian medical school graduates in a family practice residency program? Can Fam Physician. 2010;56(9), e318–e322.
15. Nath A, Yadav K, Chagnon N, Cheung WJ. Competency based medical education (CBME) in CCFP(EM) programs. CJEM 2022;24(6):599–605. https://doi.org/10.1007/s43678-022-00345-6.
16. Rutgers DR, van Raamt F, van Lankeren W, et al. Fourteen years of progress testing in radiology residency training: experiences from The Netherlands. Eur Radiol. 2018;28(5):2208–15. https://doi.org/10.1007/s00330-017-5138-8.
17. Ramlogan S, Raman V. An educational approach for early student self-assessment in clinical periodontology. BMC Med Educ. 2022;22(1). https://doi.org/10.1186/s12909-021-03078-9.
18. Weiss PM, Koller CA, Hess LW, Wasser T. How do medical student self-assessments compare with their final clerkship grades? Med Teach. 2005;27(5):445–9. https://doi.org/10.1080/01421590500046999
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Karina Prucnal, Stuart Murdoch, Kulamakan Kulasegaram, Fok-Han Leung
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Medical Education Journal will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication. If accepted for publication, it will be published online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
Authors who publish in the Canadian Medical Education Journal agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 Canada Licence. This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.
