Comparison of Student Performance on Internally Prepared Clerkship Examinations and NBME Subject Examinations

Authors

  • Pamela Veale University of Calgary
  • Wayne Woloschuk
  • Sylvain Coderre
  • Kevin McLaughlin
  • Bruce Wright

DOI:

https://doi.org/10.36834/cmej.36560

Abstract

Background: This pilot study compared performance of University of Calgary students on internal clerkship examinations with corresponding National Board of Medical Examiners (NBME) subject examinations.

Methods: Between April and October 2007, students completed internal and NBME subject examinations following six mandatory rotations. Local faculty within each discipline set the minimum performance level (MPL) for internal examinations. Two methods of standard setting were considered for NBME exams and a sensitivity analysis was performed. Corresponding internal and NBME examination scores were compared using McNemar’s discordant pair analysis.

Results: A significant and unexpected difference in failure rate between internal and external examinations was found in all clerkships. 1.4% of students were below the MPL for internal examinations and 27.3% (modified Angoff) or 25.9% (mean Hofstee compromise) (p<0.0001 for both) for the NBME. The proportion of students below MPL for internal examinations was also below the lower limit of the Hofstee compromise (14.4%).

Conclusion: Possible explanations include leniency bias in internal standard setting, discrepant content validity between local curriculum and NBME examinations, difference in student perception of examinations, and performance bias due to unfamiliar units.

Metrics

Metrics Loading ...

Author Biography

Pamela Veale, University of Calgary

Assistant Dean, Undergraduate Medical Education

Assistant Professor, Department of Pediatrics

Downloads

Published

2011-11-22

How to Cite

1.
Veale P, Woloschuk W, Coderre S, McLaughlin K, Wright B. Comparison of Student Performance on Internally Prepared Clerkship Examinations and NBME Subject Examinations. Can. Med. Ed. J [Internet]. 2011 Nov. 22 [cited 2024 Oct. 15];2(2):e81-e85. Available from: https://journalhosting.ucalgary.ca/index.php/cmej/article/view/36560

Issue

Section

Brief Reports

Most read articles by the same author(s)

1 2 > >>