Overcoming Barriers to Addressing Education Problems With Research Design: A Panel Discussion
Corresponding Author
Lalena M. Yarris MD, MCR
Department of Emergency Medicine, Oregon Health & Science University, Portland, OR
Address for correspondence and reprints: Lalena M. Yarris, MD, MCR; e-mail: [email protected].Search for more papers by this authorLarry D. Gruppen PhD
Department of Medical Education, University of Michigan Medical School, Ann Arbor, MI
Search for more papers by this authorStanley J. Hamstra PhD
Academy for Innovation in Medical Education, University of Ottawa Skills and Simulation Centre, Ottawa, Ontario, Canada
Search for more papers by this authorK. Anders Ericsson PhD
Department of Psychology, Florida State University, Tallahassee, FL
Search for more papers by this authorDavid A. Cook MD, MHPE
Division of General Internal Medicine, Office of Education Research, Mayo Clinic College of Medicine, Rochester, MN
Search for more papers by this authorCorresponding Author
Lalena M. Yarris MD, MCR
Department of Emergency Medicine, Oregon Health & Science University, Portland, OR
Address for correspondence and reprints: Lalena M. Yarris, MD, MCR; e-mail: [email protected].Search for more papers by this authorLarry D. Gruppen PhD
Department of Medical Education, University of Michigan Medical School, Ann Arbor, MI
Search for more papers by this authorStanley J. Hamstra PhD
Academy for Innovation in Medical Education, University of Ottawa Skills and Simulation Centre, Ottawa, Ontario, Canada
Search for more papers by this authorK. Anders Ericsson PhD
Department of Psychology, Florida State University, Tallahassee, FL
Search for more papers by this authorDavid A. Cook MD, MHPE
Division of General Internal Medicine, Office of Education Research, Mayo Clinic College of Medicine, Rochester, MN
Search for more papers by this authorThis paper reports on a panel discussion of the 2012 Academic Emergency Medicine consensus conference, “Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success,” May 9, 2012, Chicago, IL.
The authors have no relevant financial information or potential conflicts of interest to disclose.
Abstract
A plenary panel session at the 2012 Academic Emergency Medicine consensus conference “Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success” discussed barriers educators face in imagining, designing, and implementing studies to address educational challenges. This proceedings article presents a general approach to getting started in education research. Four examples of studies from the medical education literature that illustrate a distinct way to approach specific research questions are discussed. The study designs used are applicable to a variety of education research problems in emergency medicine (EM). Potential applications of studies are discussed, as well as effects and lessons learned.
References
- 1Farrell SE, Coates WC, Kuhn GJ, Fisher J, Shayne P, Lin M. Highlights in emergency medicine medical education research: 2008. Acad Emerg Med. 2009; 16: 1318–24.
- 2Kuhn GJ, Shayne P, Coates WC, Fisher J, Lin M, Maggio LA, Farrell SE. Critical appraisal of emergency medicine educational research: the best publications of 2009. Acad Emerg Med. 2010; 17(Suppl 2): S16–25.
- 3Shayne P, Coates WC, Farrell SE, et al. Critical appraisal of emergency medicine educational research: the best publications of 2010. Acad Emerg Med. 2011; 18: 1081–9.
- 4Dyrbye LN, Thomas MR, Papp KK, During SF. Clinician educators' experiences with institutional review boards: results of a national survey. Acad Med. 2008; 83: 590–5.
- 5Wolf FM. Methodological quality, evidence, and research in medical education (RIME). Acad Med. 2004; 79(Suppl 10): 68–9.
- 6Cook DA, Beckman TJ, Bordage G. Quality of reporting of experimental studies in medical education: a systematic review. Med Educ. 2007; 41: 737–45.
- 7Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008; 300: 1181–96.
- 8Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. Association between funding and quality of published medical education research. JAMA. 2007; 298: 1002–9.
- 9Baernstein A, Liss HK, Carney PA, Elmore JG. Trends in study methods used in undergraduate medical education research, 1969–2007. JAMA. 2007; 298: 1038–45.
- 10Cook DA, Levinson AJ, Garside S. Method and reporting quality in health professions education research: a systematic review. Med Educ. 2011; 45: 227–38.
- 11Beckman TJ, Cook DA. Developing scholarly projects in education: a primer for medical teachers. Med Teach. 2007; 29: 210–8.
- 12Bordage G. Conceptual frameworks to illuminate and magnify. Med Educ. 2009; 43: 312–9.
- 13Giacomini M. Theory-based medicine and the role of evidence: why the emperor needs new clothes, again. Perspect Biol Med. 2009; 52: 234–51.
- 14Cook DA, Bordage G, Schmidt HG. Description, justification, and clarification: a framework for classifying the purposes of research in medical education. Med Educ. 2008; 42: 128–33.
- 15Wong G, Greenhalgh T, Westhorp G, Pawson R. Realist methods in medical education research: what are they and what can they contribute? Med Educ. 2012; 46: 89–96.
- 16Cook DA, Beckman TJ. Reflections on experimental research in medical education. Adv Health Sci Educ Theory Pract. 2010; 15: 455–64.
- 17Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006; 119: 166e7–16.
10.1016/j.amjmed.2005.10.036 Google Scholar
- 18Dillman D. Mail and Internet Surveys: The Tailored Design Method, 2nd ed. New York, NY: JohnWiley & Sons, Inc., 2000.
- 19Cook DA, West CP. Conducting systematic reviews in medical education: a stepwise approach. Med Educ. 2012; 46: 943–52.
- 20Eva KW. On the limits of systematicity. Med Educ. 2008; 42: 852–3.
- 21Glassick CE, Huber MT, Maeroff G. Scholarship Assessed: Evaluation of the Professoriate. San Francisco, CA: Jossey-Bass, 1997.
- 22Cook DA. If you teach them, they will learn: why medical education needs comparative effectiveness research. Adv Health Sci Educ Theory Pract. 2012; 17: 305–10.
- 23Roberts LW, Geppert C, Connor R, Nguyen K, Warner TD. An invitation for medical educators to focus on ethical and policy issues in research and scholarly practice. Acad Med. 2001; 76: 876–85.
- 24Cook DA. Twelve tips for evaluating educational programs. Med Teach. 2010; 32: 296–301.
- 25Cook DA. Getting started in medical education scholarship. Keio J Med. 2010; 59: 96–103.
- 26Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD. The effect of bench model fidelity on endourologic skills: a randomized controlled study. J Urol. 2002; 167: 1243–7.
- 27Grober ED, Hamstra SH, Wanzel KR, et al. Laboratory based training in urological microsurgery with bench model simulators: a randomized controlled trial evaluating the durability of technical skill. J Urol. 2004; 172: 378–81.
- 28Matsumoto ED, Pace KT, Honey R, John D. Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol. 2006; 13: 896–901.
- 29Samuelson ML, Cadeddu JA, Matsumoto ED. Laparoscopic decision making: impact of preoperative reading and laparoscopic experience. J Urol. 2006; 176: 1553–7.
- 30Sabbagh RA, Chatterjee SB, Chawla AB, Hoogenes JC, Kapoor AB, Matsumoto ED. Transfer of laparoscopic radical prostatectomy skills from bench model to animal model: a prospective, single-blind, randomized, controlled study. J Urol. 2012; 187: 1861–6.
- 31Hauge LS, Frischknecht AC, Boehler M, et al. Simulating management of patient care: how prepared are your interns to take call? Presentation: Surgical Education Week (ASE/APDS). Boston, MA, March, 2011.
- 32Pusic M, Pecaric M, Boutis K. How much practice is enough? Using learning curves to assess the deliberate practice of radiograph interpretation. Using learning curves to assess the deliberate practice of radiograph interpretation. Acad Med. 2011; 86: 731–6.
- 33Ericsson KA. The influence of experience and deliberate practice on the development of superior expert performance. In: KA Ericsson, N Charness, P Feltovich, RR Hoffman (eds). Cambridge Handbook of Expertise and Expert Performance. Cambridge, UK: Cambridge University Press, 2006, pp 685–706.
10.1017/CBO9780511816796.038 Google Scholar
- 34Ericsson KA. Deliberate practice and acquisition of expert performance: a general overview. Acad Emerg Med. 2008; 15: 988–94.
- 35Thurstone LL. The learning curve equation. Psychological Monog. 1919; 26: 1–51.
10.1037/h0093187 Google Scholar
- 36Ma IW, Brindle ME, Ronksley PE, Lorenzetti DL, Sauve RS, Ghali WA. Use of simulation-based education to improve outcomes of central venous catheterization: a systematic review and meta-analysis. Acad Med. 2011; 86: 1137–47.
- 37Dong Y, Suri HS, Cook DA, et al. Simulation-based objective assessment discerns clinical proficiency in central line placement: a construct validation. Chest. 2010; 137: 1050–6.
- 38Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ. 2003; 37: 830–7.
