Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees – a Canadian multi-centred study

Authors

  • J. Damon Dagnone Queen's University
  • Andrew K. Hall
  • Stefanie Sebok-Syer
  • Don Klinger
  • Karen Woolfrey
  • Colleen Davison
  • John Ross
  • Gordon McNeil
  • Sean Moore

DOI:

https://doi.org/10.36834/cmej.36682

Keywords:

Simulation, OSCE, competency-based, resuscitation, multi-centred

Abstract

Background: The use of high-fidelity simulation is emerging as a desirable method for competency-based assessment in postgraduate medical education. We aimed to demonstrate the feasibility and validity of a multi-centre simulation-based Objective Structured Clinical Examination (OSCE) of resuscitation competence with Canadian Emergency Medicine (EM) trainees.

Method: EM postgraduate trainees (n=98) from five Canadian academic centres participated in a high fidelity, 3-station simulation-based OSCE.  Expert panels of three emergency physicians evaluated trainee performances at each centre using the Queen’s Simulation Assessment Tool (QSAT).  Intraclass correlation coefficients were used to measure the inter-rater reliability, and analysis of variance was used to measure the discriminatory validity of each scenario.  A fully crossed generalizability study was also conducted for each examination centre.  

Results: Inter-rater reliability in four of the five centres was strong with a median absolute intraclass correlation coefficient (ICC) across centres and scenarios of 0.89 [0.65-0.97]. Discriminatory validity was also strong (p < 0.001 for scenarios 1 and 3; p < 0.05 for scenario 2). Generalizability studies found significant variations at two of the study centres.

Conclusions: This study demonstrates the successful pilot administration of a multi-centre, 3-station simulation-based OSCE for the assessment of resuscitation competence in post-graduate Emergency Medicine trainees.

Metrics

Metrics Loading ...

Author Biography

J. Damon Dagnone, Queen's University

Assistant Professor, Department of Emergency Medicine
Special Assistant to Associate Dean, Faculty Lead, CBME,
Postgraduate Medical Education
Queen's University

Downloads

Published

2016-04-02

How to Cite

1.
Dagnone JD, Hall AK, Sebok-Syer S, Klinger D, Woolfrey K, Davison C, Ross J, McNeil G, Moore S. Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees – a Canadian multi-centred study. Can. Med. Ed. J [Internet]. 2016 Apr. 2 [cited 2024 Oct. 6];7(1):e57-e67. Available from: https://journalhosting.ucalgary.ca/index.php/cmej/article/view/36682

Issue

Section

Original Research