Developing a national competency framework for pediatric hospital medicine in Canada using the Delphi method
DOI:
https://doi.org/10.36834/cmej.80136Abstract
Background: Over the past three decades, the field of Pediatric Hospital Medicine (PHM) has expanded rapidly in North America in response to the increasing complexity and acuity of the pediatric inpatient population. While 78 fellowship programs and a published PHM Core Competencies framework exist in the United States, Canadian fellowship programs lack a national competency framework to guide curriculum and practice. This absence creates uncertainty in defining the scope of practice and training expectations for PHM in Canada. The purpose of this study was to define this scope.
Methods: Using Delphi methodology, a national panel of experts in PHM iteratively rated potential competencies, on a 5-point scale, to determine their priority for inclusion. Responses were analyzed after each round. Competencies that were assigned a rating of three or less by ≥80% of the panelists were removed from subsequent rounds. The remaining competencies were re-sent to panelists for further ratings until consensus was reached, defined as Cronbach’s α ≥0.95 and after a minimum of two survey rounds. At the conclusion of the Delphi process, competencies where ≥80% of the panelists assigned a rating of ≥4 were included.
Results: Two rounds of the Delphi process were required to reach consensus. Thirty-five panelists completed both survey rounds. The panelists represented 13 Canadian pediatric tertiary care centers and five community hospitals. Of 176 initial competencies, 109 PHM competencies achieved consensus, spanning the seven CanMEDS roles.
Conclusion: This is the first study to define competencies for PHM in Canada. The competencies identified provide a framework for PHM fellowship program directors to shape local curricula. The results may also be used to inform the development of comprehensive national PHM fellowship curricula.
Downloads
References
1. Stucky ER, Ottolini MC, Maniscalco J. Pediatric hospital medicine core competencies: development and methodology. J Hosp Med. 2010;5(6):339–43. https://doi.org/10.12788/jhm.3391
2. Landrigan CP, Conway PH, Edwards S, Srivastava R. Pediatric hospitalists: a systematic review of the literature. Pediatrics. 2006;117(5):1736–44. https://doi.org/10.1542/peds.2005-0609
3. Srivastava, R. Landrigan CP, Ross-Degnan D, et al. Impact of a hospitalist system on length of stay and cost for children with common conditions. Pediatrics. 2007;120(2):267-274. https://doi.org/10.1542/peds.2006-2286
4. Mussman GM, Conway PH. Pediatric hospitalist systems versus traditional models of care: effect on quality and cost outcomes. J Hosp Med. 2012;7(4)350-7. https://doi.org/10.1002/jhm.951
5. Landrigan CP, Muret-Wagstaff S, Chiang VW, et al. Effect of a pediatric hospitalist system on housestaff education and experience. Arch Pediatr Adolesc Med. 2002;156(9):877–83. https://doi.org/10.1001/archpedi.156.9.877
6. Simon TD, Berry J, Feudtner C, et al. Children with complex chronic conditions in inpatient hospital settings in the US. Peds. 2010;126(4):647-655. https://doi.org/10.1542/peds.2009-3266
7. Roberts KB. The intertwined histories of resident education and pediatric hospital medicine in the US. Peds. 2020;146(6). https://doi.org/10.1542/peds.2020-017210
8. Leyenaar J, Harrison W, Truelove J, et al. Responsibilities and interests of pediatricians practicing hospital medicine in the United States. J. Hosp Med. 2021;16(12):709-715. https://doi.org/10.12788/jhm.3720
9. Roberts K, Fisher ES, Rauch D. The history of pediatric hospital medicine in the United States, 1996-2019. J Hosp Med. 2020;15(7): 424-427. https://doi.org/10.12788/jhm.3381
10. Jerardi K, Fisher E, Rassbach C, et al. Development of a curricular framework for pediatric hospital medicine fellowships. Peds. 2017;140(1):e20170698. https://doi.org/10.1542/peds.2017-0698
11. Maniscalco J, Gage S, Teferi S, Fisher E. The pediatric hospital medicine core competencies: 2020 revision introduction and methodology. J Hosp Med. 2020;15(7):389-394. https://doi.org/10.12788/jhm.3391
12. Vetere P, Cooke S. Preparedness to practice paediatric hospital medicine. Paediatr Child Health. 2020;25(7):447–54. https://doi.org/10.1093/pch/pxz113
13. Canadian Paediatric Society. Hospital Paediatrics. June 21, 2023. Available from: https://cps.ca/en/sections/hospital-paediatrics. [Accessed on Dec 17, 2023].
14. Paediatric Inpatient Research Network. About PIRN. 2023 Available from: https://www.pirncanada.com. [Accessed on Nov 4, 2023].
15. Al Maawali A, Puran A, Schwartz S, Johnstone J, Bismilla Z. The current state of general paediatric fellowships in Canada. Paediatr Child Health. 2021;26(6):353–7. https://doi.org/10.1093/pch/pxaa136
16. Frank J, Danoff D. The CanMEDS initiative: Implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29(7):642-647 https://doi.org/10.1080/0142159070174698
17. Penciner R, Langhan T, Lee R, et al. Using a Delphi process to establish consensus on emergency medicine clerkship competencies. Med Teach. 2011;33(6):e333–9. https://doi.org/10.3109/0142159X.2011.575903
18. De Villiers MR, De Villiers PJT, Kent AP. The Delphi technique in health sciences education research. Med Teach. 2005;27(7):639–43. https://doi.org/10.1080/13611260500069947
19. Graham B, Regehr G, Wright JG. Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol. 2003;56(12):1150–6. https://doi.org/10.1016/s0895-4356(03)00211-7
20. Shang Z. Use of Delphi in health sciences research: a narrative review. Medicine (Baltimore). 2023;102(7):e32829. https://doi.org/10.1097/MD.0000000000032829
21. Adler M, Ziglio E. Gazing into the oracle: the Delphi method and its application to social policy and public health. Jessica Kingsley Publishers; 1996.
22. Diamond IR, Grant RC, Feldman BM, et al. Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9. https://doi.org/10.1016/j.jclinepi.2013.12.002
23. Murphy MK, Black NA, Lamping DL, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2(3):i–88.
24. Canadian Paediatric Society. Hospital pediatrics (CPS statements related to hospitalized pediatrics patients). 2023. Available from: https://cps.ca/en/documents/tag/hospital-paediatrics. [Accessed on Oct 9, 2021].
25. College of Physicians and Surgeons of Canada. Objectives of training in pediatric medicine. Ottawa, ON: Royal College of Physicians and Surgeons of Canada, 2021. Available from: https://www.royalcollege.ca/content/dam/documents/ibd/pediatrics/pediatrics-competencies-e.pdf. [Accessed on Dec 20, 2023].
26. Frank JR, Snell L, Sherbino J. CanMEDS 2015. Royal College of Physicians and Surgeons of Canada. 2015. Available from http://www.royalcollege.ca/portal/page/portal/rc/canmeds/resources/publications. [Accessed on Dec 3, 2023].
27. Hoddinott SN, Bass MJ. The Dillman total design survey method: A sure-fire way to get high survey return rates. Can Fam Physician. 1986; 32:2366-2368.
28. Lilaonitkul M, Cosden CW, Markley JC, et al. Development of obstetric anesthesia core competencies for USA residency programs through a Delphi process. Can J Anaesth. 2023;70(10):1611–22. https://doi.org/10.1007/s12630-023-02536-w
29. Pawlak N, Dart C, Aguilar HS, et al. Academic global surgical competencies: a modified Delphi consensus study. PLOS Glob Public Health. 2023;3(7):e0002102. https://doi.org/10.1371/journal.pgph.0002102.
30. Lieberman L, Hajjaj OI, Walsh CM, Lin Y. Transfusion medicine curricular content for general pediatricians and pediatric subspecialists: a national multi‐specialty Delphi consensus study. Tranfus Med. 2023;63(8):1571-1579. https://doi.org/10.1111/trf.17453
31. Shorey S, Lau TC, Lau ST, Ang E. Entrustable professional activities in health care education: A scoping review. Med Educ. 2019;53(8):766-777. https://doi.org/10.1111/med
32. Frank J, Mungroo R, Ahmad Y, et al. Toward a definition of competency-based education in medicine: a systematic review of published definitions. Med Teach. 2010;32(8):631-637. https://doi.org/10.3109/0142159X.2010.500898
33. Khalife R, Gonsalves C, Code C, Halman S. Transitioning towards senior medical resident: identification of the required competencies using consensus methodology. Can Med Educ J. 2018;9(3):e64. https://doi.org/10.36834/cmej.42163
34. Ogundeji YK, Quinn A, Lunney M, et al. Optimizing physician payment models to address health system priorities: perspectives from specialist physicians. Healthcare Policy. 2021;17(1):58. https://doi.org/10.12927/hcpol.2021.26577
35. Royal College of Physicians and Surgeons of Canada. Objectives of training in the subspecialty of pediatric emergency medicine. Ottawa, ON: Royal College of Physicians and Surgeons of Canada, 2013. Available from: https://www.royalcollege.ca/content/dam/documents/ibd/pediatric-emergency-medicine/pediatric-emergency-medicine-otr-e.pdf [Accessed on Sept 29, 2023].
36. Royal College of Physicians and Surgeons of Canada. Objectives of training in the subspecialty of pediatric critical care medicine. Ottawa, ON: Royal College of Physicians and Surgeons of Canada, 2014. Available from: https://www.royalcollege.ca/content/dam/documents/ibd/critical-care-medicine/critical-care-medicine-pediatric-cbd-sa-e.pdf. [Accessed on Sept 29, 2023].
37. McGillivray D, Javis A. A history of paediatric emergency medicine in Canada. J Paediatr Child Health. 2007;12(6):453-456. https://doi.org/10.1093/pch/12.6.453
38. Fisher RD, Pries C, Keeler M, et al. Pediatric hospitalist co-management of neurosurgery patients reduces readmissions. Peds. 2021;147(3):581-583. https://doi.org/10.1542/peds.147.3MA6.581b
39. Brousseau M, Foster J, Adam D, Boggs S, et al. Pediatric intensive care unit admissions in children with respiratory technology dependence. Pediatr Pulmonol. 2023. https://doi.org/10.1002/ppul.26615
40. Verma S, Flynn L, Seguin R. Faculty’s and residents’ perceptions of teaching and evaluating the role of health advocate: a study at one Canadian university. Acad Med. 2005;80(1):103–8. https://doi.org/10.1097/00001888-200501000-00024
41. Freed GL, Dunham KM, Pediatrics RAC of the AB of. Pediatric hospitalists: training, current practice, and career goals. J Hosp Med. 2009;4(3):179–86. https://doi.org/10.1002/jhm.458
42. Solano JL, Richardson T, Walker JM, et al. Pathways to publication in pediatric hospital medicine. Hosp Pediatr. 2020; 10(11): 992-996. https://doi.org/10.1542/hpeds.2020-0100
43. Nigrovic SE, Fine HD, Nigrovic LE, Fine AM. Kicking it through the uprights: getting it published after presenting at PAS. Pediatr Res. 2021;89: 1598-1600. https://doi.org/10.1038/s41390-020-01182-y
44. Librizzi J, Winer JC, Banach L, Davis A. Perceived core competency achievements of fellowship and non‐fellowship‐trained early career pediatric hospitalists. J Hosp Med. 2015;10(6):373–9. https://doi.org/10.1002/jhm.2337
45. Rassbach CE, Fiore D. Research and career outcomes for pediatric hospital medicine fellowship graduates. Hosp Pediatr. 2021;11(10):1082–114. https://doi.org/10.1542/hpeds.2021-005938
46. Humphrey-Murto S, Varpio L, Wood TJ, et al. The use of the Delphi and other consensus group methods in medical education research: a review. Acad Med. 2017;92(10):1491–8. https://doi.org/10.1097/ACM.0000000000001812
47. Keeneya S, Hassona F, McKennab H. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;2(38):195–200. https://doi.org/10.1016/s0020-7489(00)00044-4
48. Murry Jr JW, Hammons JO. Delphi: aA versatile methodology for conducting qualitative research. Rev High Ed. 1995;18(4):423–36. https://doi.org/10.1353/rhe.1995.0008
49. Canadian Medical Association. Pediatrics profile. 2019. Available from: https://www.cma.ca/sites/default/files/2019-01/pediatrics-e.pdf. [Accessed on Jul 15, 2023]
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Peter Vetere, Catharine M Walsh, Ali Al Maawali, Allan Puran, Tanya N Beran, Zia Bismilla , Suzette Cooke
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Medical Education Journal will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication. If accepted for publication, it will be published online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
Authors who publish in the Canadian Medical Education Journal agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 Canada Licence. This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.
