Where the rubber meets the road: pearls and pitfalls of implementing competency-based assessment
Julia Adriana Kasmirski MD
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Contribution: Investigation, Project administration, Writing - original draft
Search for more papers by this authorChristopher Wu MD
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Contribution: Writing - original draft
Search for more papers by this authorCorresponding Author
Brenessa Lindeman MD, MEHP
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Correspondence
Brenessa Lindeman, Surgery and Medical Education, University of Alabama at Birmingham, 1808 7th Ave S, BDB 506, Birmingham, AL 35294, USA.
Email: [email protected]
Contribution: Conceptualization, Data curation, Methodology, Supervision, Writing - review & editing
Search for more papers by this authorJulia Adriana Kasmirski MD
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Contribution: Investigation, Project administration, Writing - original draft
Search for more papers by this authorChristopher Wu MD
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Contribution: Writing - original draft
Search for more papers by this authorCorresponding Author
Brenessa Lindeman MD, MEHP
Department of Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
Correspondence
Brenessa Lindeman, Surgery and Medical Education, University of Alabama at Birmingham, 1808 7th Ave S, BDB 506, Birmingham, AL 35294, USA.
Email: [email protected]
Contribution: Conceptualization, Data curation, Methodology, Supervision, Writing - review & editing
Search for more papers by this authorThis is a summary of the Hamilton Russell Memorial Lecture of the Royal Australasian College of Surgeons Annual Scientific Congress, May 2024, Christchurch, New Zealand.
References
- 1Rogers AD, Cartotto R. Dear program directors: there are numerous entrustable professional activities on a burns rotation! Plast. Surg. (Oakv) 2024; 32: 490–498.
- 2 RAS-ACS Symposium: Competency-based training: A gateway to efficiency or a hurried sprint to the finish line. [cited 21 July 2024.] Available from URL: https://www.facs.org/for-medical-professionals/news-publications/news-and-articles/bulletin/2021/08/ras-acs-symposium-competency-based-training-a-gateway-to-efficiency-or-a-hurried-sprint-to-the-finish-line/
- 3Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system–rationale and benefits. N. Engl. J. Med. 2012; 366: 1051–1056.
- 4ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad. Med. 2007; 82: 542–547.
- 5Frank JR, Snell LS, Cate OT et al. Competency-based medical education: theory to practice. Med. Teach. 2010; 32: 638–645.
- 6George BC, Bohnen JD, Williams RG et al. Readiness of US general surgery residents for independent practice. Ann. Surg. 2017; 266: 582–594. Erratum in: Ann Surg. 2018 Mar;267(3):e63.
- 7Stahl CC, Collins E, Jung SA et al. Implementation of entrustable professional activities into a general surgery residency. J. Surg. Educ. 2020; 77: 739–748. https://doi.org/10.1016/j.jsurg.2020.01.012.
- 8McKenna DT, Mattar SG. What is wrong with the training of general surgery? Adv. Surg. 2014; 48: 201–210.
- 9de Graaf J, Bolk M, Dijkstra A, van der Horst M, Hoff RG, ten Cate O. The implementation of entrustable professional activities in postgraduate medical education in The Netherlands: rationale, process, and current status. Acad. Med. 2021; 96: S29–S35.
- 10Montgomery KB, Mellinger JD, Lindeman B. Entrustable professional activities in surgery: a review. JAMA Surg. 2024; 159: 571–577.
- 11 Entrustable Professional Activities. [cited 27 July 2024.] Available from URL: https://www.absurgery.org/get-certified/epas/.
- 12Englander R, Flynn T, Call S et al. Toward defining the foundation of the MD degree: core entrustable professional activities for entering residency. Acad. Med. 2016; 91: 1352–1358.
- 13Kasmirski JA, Frank JR, Lindeman B. Competency-based assessment in North American Surgical Training: a tale of two countries. Ann. Surg. 2024. https://doi.org/10.1097/SLA.0000000000006445. Online ahead of print.
- 14Frank JR, Hall AK, Oswald A, Dagnone JD, Brand PLP, Reznick R. From competence by time to competence by design: lessons from a National Transformation Initiative. Perspect Med. Educ. 2024; 13: 224–228.
- 15Schumacher DJ, West DC, Schwartz A et al. Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network General Pediatrics Entrustable Professional Activities Study Group. Longitudinal assessment of resident performance using Entrustable professional activities. JAMA Netw. Open 2020; 3: e1919316.
- 16Lindeman B, Brasel K, Minter RM, Buyske J, Grambau M, Sarosi G. A phased approach: the general surgery experience adopting Entrustable professional activities in the United States. Acad. Med. 2021; 96: S9–S13.
- 17Montgomery KB, Mellinger JD, Jones A et al. Validity of entrustable professional activities in a National Sample of General Surgery Residency Programs. J. Am. Coll. Surg. 2024; 238: 376–384.
- 18Brasel KJ, Lindeman B, Jones A et al. Implementation of entrustable professional activities in general surgery: results of a National Pilot Study. Ann. Surg. 2023; 278: 578–586.
- 19Brazelle M, Zmijewski P, McLeod C, Corey B, Porterfield JR Jr, Lindeman B. Concurrent validity evidence for entrustable professional activities in general surgery residents. J. Am. Coll. Surg. 2022; 234: 938–946.
- 20Montgomery KB, Mellinger JD, McLeod MC et al. Decision-making confidence of clinical competency committees for entrustable professional activities. JAMA Surg. 2024; 159: 801–808.
- 21Hanson MN, Pryor AD, Jeyarajah DR et al. Implementation of entrustable professional activities into fellowship council accredited programs: a pilot project. Surg. Endosc. 2023; 37: 3191–3200.
- 22Zmijewski PV, McLeod C, Akhund R et al. Entrustable professional activities in endocrine surgery: results of a national pilot. Surgery. 2024. (In press).
- 23Sandhu G, Jones A, Barry C, Buyske J, Mellinger JD, Lindeman B. Research agenda for US general surgery entrustable professional activities. Ann. Surg. (Under review).
- 24Meyerson SL, Sternbach JM, Zwischenberger JB, Bender EM. The effect of gender on resident autonomy in the operating room. J. Surg. Educ. 2017; 74: e111–e118.
- 25Padilla EP, Stahl CC, Jung SA et al. Gender differences in entrustable professional activity evaluations of general surgery residents. Ann. Surg. 2022; 275: 222–229.
- 26Thompson-Burdine J, Sutzko DC, Nikolian VC et al. Impact of a resident's sex on intraoperative entrustment of surgery trainees. Surgery 2018; 164: 583–588.
- 27Millar JK, Matusko N, Evans J et al. Faculty entrustment and resident entrustability. JAMA Surg. 2024; 159: 277–285.
