Documenting medical students’ use of self-explanations: tool development and initial validity evidence
DOI:
https://doi.org/10.36834/cmej.78199Abstract
Introduction: Self-explanation (SE), an individual learning strategy for the development of clinical reasoning skills, has been implemented in undergraduate medical curricula. A tool for documenting students’ appropriate use of SE is needed to ensure benefit on learning. The objective of this project was to develop such a tool and report on evidence of its validity.
Methods: We used DeVellis’s eight steps to develop the tool. Assessors applied the tool to 85 audio-recorded SEs. We calculated students’ mean number of inferences (biomedical, clinical, monitoring) and case elements used when self-explaining to document validity evidence of content. We used interrater agreement, with intraclass correlation coefficients, to document validity evidence of response processes.
Results: Three assessors documented the students’ use of SE with the tool. They found means of 13.33 to 17.76 biomedical inferences, 16.27 to 27.04 clinical inferences, 2.03 to 3.10 monitoring statements, and listed 21.77 to 26.87 case elements. Interrater reliability varied from 0.53 to 0.96.
Discussion: We developed the tool using the principles underlying SE. The way students used SE aligned with our expectations. Assessors used the tool in a consistent way. The tool could document students’ use of SE in experimental or educational contexts.
Downloads
References
1. Schmidt HG, Mamede S. How to improve the teaching of clinical reasoning: a narrative review and a proposal. Med Educ. 2015;49(10):961‑73. https://doi.org/10.1111/medu.12775. DOI: https://doi.org/10.1111/medu.12775
2. Torre D, Chamberland M, Mamede S. Implementation of three knowledge-oriented instructional strategies to teach clinical reasoning: self-explanation, a concept mapping exercise, and deliberate reflection: AMEE Guide No. 150. Med Teach. 2023;45(7):676-84. https://doi.org/10.1080/0142159X.2022.2105200 DOI: https://doi.org/10.1080/0142159X.2022.2105200
3. Chamberland M, St‐Onge C, Setrakian J, Lanthier L, Bergeron L, Bourget A, et al. The influence of medical students’ self‐explanations on diagnostic performance. Med Educ. 2011;45(7):688‑95. https://doi.org/10.1111/j.1365-2923.2011.03933.x. DOI: https://doi.org/10.1111/j.1365-2923.2011.03933.x
4. Chamberland M, Mamede S. Self-explanation, an instructional strategy to foster clinical reasoning in medical students. Health Prof Educ. 2015;1(1):24‑33. https://doi.org/10.1016/j.hpe.2015.11.005 DOI: https://doi.org/10.1016/j.hpe.2015.11.005
5. Chebbihi H, Varpio L, St-Onge C, Chamberland M. Self-explanation to support knowledge development for clinical reasoning: perspectives from third year medical clerks. MedEdPublish. 2019;8. https://mededpublish.org/articles/8-225 DOI: https://doi.org/10.15694/mep.2019.000225.1
6. Chamberland M, Mamede S, Bergeron L, Varpio L. A layered analysis of self-explanation and structured reflection to support clinical reasoning in medical students. Perspect Med Educ. 2021;10:171‑9. https://doi.org/10.1007/s40037-020-00603-2. DOI: https://doi.org/10.1007/S40037-020-00603-2
7. Cooper N, Bartlett M, Gay S, et al. Consensus statement on the content of clinical reasoning curricula in undergraduate medical education. Med Teach. 2021;43(2):152‑9. https://doi.org/10.1080/0142159X.2020.1842343. DOI: https://doi.org/10.1080/0142159X.2020.1842343
8. Chi MTH. Self-explaining expository texts: the dual processes of generating inferences and repairing mental models. In: Glaser R, éditeur. Advances in Instructional Psychology. Mahaw, NJ: Lawrence Erlbaum Associates, Inc; 2000. p. 161‑238.
9. Renkl A, Eitel A. Self-explaning: Learning about principles and their application. In: Dunlosky J, Rawson KA, éditeurs. The Cambridge handbook of cognition and education. Cambridge: Cambridge Cambridge University Press; 2019. p. 528‑49. DOI: https://doi.org/10.1017/9781108235631.022
10. Chamberland M, Mamede S, St‐Onge C, et al. Students’ self-explanations while solving unfamiliar cases: the role of biomedical knowledge. Med Educ. 2013;47(11):1109‑16. https://doi.org/10.1111/medu.12253. DOI: https://doi.org/10.1111/medu.12253
11. Kelekar A, Afonso N. Evaluation of the effect of a new clinical reasoning curriculum in a pre-clerkship clinical skills course. Perspect Med Educ. 2020;9(2):123‑7. https://doi.org/10.1007/s40037-020-00566-4. DOI: https://doi.org/10.1007/S40037-020-00566-4
12. Chiu JL, Chi MT. Supporting self-explanation in the classroom. In: Benassi VA, Overson CE, & Hakala CM. Applying science of learning in education: Infusing psychological science into the curriculum. Retrieved from the Society for the Teaching of Psychology web site: http://teachpsych.org/ebooks/asle2014/index.php 2014;91‑103.
13. Cianciolo AT, Regehr G. Learning theory and educational intervention: Producing meaningful evidence of impact through layered analysis. Acad Med. 2019;94(6):789‑94. https://doi.org/10.1097/ACM.0000000000002591. DOI: https://doi.org/10.1097/ACM.0000000000002591
14. DeVellis RF. Scale development: Theory and applications. Vol. 26. Los Angeles: Sage publications; 2016.
15. Chamberland M, Setrakian J, Bergeron L, Varpio L, St-Onge C, Thomas A. Harnessing a knowledge translation framework to implement an undergraduate medical education intervention: A longitudinal study. Perspect Med Educ. 2022;1‑8. https://doi.org/10.1007/s40037-022-00735-7. DOI: https://doi.org/10.1007/s40037-022-00735-7
16. American Educational Research Association., American Psychological Association., National Council on Measurement in Education., Joint Committee on Standards for Educational and Psychological Testing (U.S.). Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014.
17. Shankar, S, St-Onge, Christina, Young, Meredith. When I say… response process validity evidence. Med Educ. 2022;56(9):878‑80. https://doi.org/10.1111/medu.14853. DOI: https://doi.org/10.1111/medu.14853
18. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155‑63. https://doi.org/10.1016/j.jcm.2016.02.012. DOI: https://doi.org/10.1016/j.jcm.2016.02.012
19. Al Rumayyan A, Ahmed N, Al Subait R, et al. Teaching clinical reasoning through hypothetico-deduction is (slightly) better than self-explanation in tutorial groups: an experimental study. Perspect Med Educ. 2018;7(2):93‑9. https://doi.org/10.1007/s40037-018-0409-x. DOI: https://doi.org/10.1007/S40037-018-0409-X
20. Larsen DP, Butler AC, Roediger Iii HL. Comparative effects of test-enhanced learning and self-explanation on long-term retention. Med Educ. 2013;47(7):674‑82. https://doi.org/10.1111/medu.12141. DOI: https://doi.org/10.1111/medu.12141
21. Heitzmann N, Fischer F, Kühne‐Eversmann L, Fischer MR. Enhancing diagnostic competence with self-explanation prompts and adaptable feedback. Med Educ. Oct 2015;49(10):993‑1003. https://doi.org/10.1111/medu.12778. DOI: https://doi.org/10.1111/medu.12778
22. Dyer JO, Hudon A, Montpetit-Tourangeau K, Charlin B, Mamede S, Van Gog T. Example-based learning: comparing the effects of additionally providing three different integrative learning activities on physiotherapy intervention knowledge. BMC Med Educ. 2015;15(1):1‑16. https://doi.org/10.1186/s12909-015-0308-3. DOI: https://doi.org/10.1186/s12909-015-0308-3
23. Chamberland M, Setrakian J, St-Onge C, Bergeron L, Mamede S, Schmidt HG. Does providing the correct diagnosis as feedback after self-explanation improve medical students diagnostic performance? BMC Med Educ. 2019;19(1):194. https://doi.org/10.1186/s12909-019-1638-3. DOI: https://doi.org/10.1186/s12909-019-1638-3
24. Chamberland M, Mamede S, St-Onge C, Setrakian J, Schmidt HG. Does medical students’ diagnostic performance improve by observing examples of self-explanation provided by peers or experts? Adv Health Sci Educ. 2015;20(4):981‑93. https://doi.org/10.1007/s10459-014-9576-7. DOI: https://doi.org/10.1007/s10459-014-9576-7
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Élise Vachon Lachiver, Martine Chamberland, Linda Bergeron, Jean Setrakian, Hassiba Chebbihi, Christina St-Onge
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Medical Education Journal will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication. If accepted for publication, it will be published online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
Authors who publish in the Canadian Medical Education Journal agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 Canada Licence. This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.
