Comparison of Student Performance on Internally Prepared Clerkship Examinations and NBME Subject Examinations

Auteurs-es

  • Pamela Veale University of Calgary
  • Wayne Woloschuk
  • Sylvain Coderre
  • Kevin McLaughlin
  • Bruce Wright

DOI :

https://doi.org/10.36834/cmej.36560

Résumé

Background: This pilot study compared performance of University of Calgary students on internal clerkship examinations with corresponding National Board of Medical Examiners (NBME) subject examinations.

Methods: Between April and October 2007, students completed internal and NBME subject examinations following six mandatory rotations. Local faculty within each discipline set the minimum performance level (MPL) for internal examinations. Two methods of standard setting were considered for NBME exams and a sensitivity analysis was performed. Corresponding internal and NBME examination scores were compared using McNemar’s discordant pair analysis.

Results: A significant and unexpected difference in failure rate between internal and external examinations was found in all clerkships. 1.4% of students were below the MPL for internal examinations and 27.3% (modified Angoff) or 25.9% (mean Hofstee compromise) (p<0.0001 for both) for the NBME. The proportion of students below MPL for internal examinations was also below the lower limit of the Hofstee compromise (14.4%).

Conclusion: Possible explanations include leniency bias in internal standard setting, discrepant content validity between local curriculum and NBME examinations, difference in student perception of examinations, and performance bias due to unfamiliar units.

Statistiques

Chargement des statistiques…

Biographie de l'auteur-e

Pamela Veale, University of Calgary

Assistant Dean, Undergraduate Medical Education

Assistant Professor, Department of Pediatrics

Téléchargements

Publié-e

2011-11-22

Comment citer

1.
Veale P, Woloschuk W, Coderre S, McLaughlin K, Wright B. Comparison of Student Performance on Internally Prepared Clerkship Examinations and NBME Subject Examinations. Can. Med. Ed. J [Internet]. 22 nov. 2011 [cité 18 mai 2024];2(2):e81-e85. Disponible à: https://journalhosting.ucalgary.ca/index.php/cmej/article/view/36560

Numéro

Rubrique

Communications brèves

Articles les plus lus du,de la,des même-s auteur-e-s

1 2 > >>