Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees – a Canadian multi-centred study

Auteurs-es

  • J. Damon Dagnone Queen's University
  • Andrew K. Hall
  • Stefanie Sebok-Syer
  • Don Klinger
  • Karen Woolfrey
  • Colleen Davison
  • John Ross
  • Gordon McNeil
  • Sean Moore

DOI :

https://doi.org/10.36834/cmej.36682

Mots-clés :

Simulation, OSCE, competency-based, resuscitation, multi-centred

Résumé

Background: The use of high-fidelity simulation is emerging as a desirable method for competency-based assessment in postgraduate medical education. We aimed to demonstrate the feasibility and validity of a multi-centre simulation-based Objective Structured Clinical Examination (OSCE) of resuscitation competence with Canadian Emergency Medicine (EM) trainees.

Method: EM postgraduate trainees (n=98) from five Canadian academic centres participated in a high fidelity, 3-station simulation-based OSCE.  Expert panels of three emergency physicians evaluated trainee performances at each centre using the Queen’s Simulation Assessment Tool (QSAT).  Intraclass correlation coefficients were used to measure the inter-rater reliability, and analysis of variance was used to measure the discriminatory validity of each scenario.  A fully crossed generalizability study was also conducted for each examination centre.  

Results: Inter-rater reliability in four of the five centres was strong with a median absolute intraclass correlation coefficient (ICC) across centres and scenarios of 0.89 [0.65-0.97]. Discriminatory validity was also strong (p < 0.001 for scenarios 1 and 3; p < 0.05 for scenario 2). Generalizability studies found significant variations at two of the study centres.

Conclusions: This study demonstrates the successful pilot administration of a multi-centre, 3-station simulation-based OSCE for the assessment of resuscitation competence in post-graduate Emergency Medicine trainees.

Statistiques

Chargement des statistiques…

Biographie de l'auteur-e

J. Damon Dagnone, Queen's University

Assistant Professor, Department of Emergency Medicine
Special Assistant to Associate Dean, Faculty Lead, CBME,
Postgraduate Medical Education
Queen's University

Téléchargements

Publié-e

2016-04-02

Comment citer

1.
Dagnone JD, Hall AK, Sebok-Syer S, Klinger D, Woolfrey K, Davison C, Ross J, McNeil G, Moore S. Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees – a Canadian multi-centred study. Can. Med. Ed. J [Internet]. 2 avr. 2016 [cité 30 juin 2024];7(1):e57-e67. Disponible à: https://journalhosting.ucalgary.ca/index.php/cmej/article/view/36682

Numéro

Rubrique

Recherche originale