Learning by doing—teaching systematic review methods in 8 weeks
Corresponding Author
Tianjing Li
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Correspondence to: Tianjing Li, Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe Street, Room E6011, Baltimore, MD 21205, USA.
E-mail: [email protected]
Search for more papers by this authorIan J. Saldanha
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorS. Swaroop Vedula
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorTsung Yu
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorLori Rosman
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorClaire Twose
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorSteven N. Goodman
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorKay Dickersin
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorCorresponding Author
Tianjing Li
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Correspondence to: Tianjing Li, Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe Street, Room E6011, Baltimore, MD 21205, USA.
E-mail: [email protected]
Search for more papers by this authorIan J. Saldanha
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorS. Swaroop Vedula
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorTsung Yu
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorLori Rosman
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorClaire Twose
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorSteven N. Goodman
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorKay Dickersin
Center for Clinical Trials, Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205 USA
Search for more papers by this authorAbstract
Objective
The objective of this paper is to describe the course “Systematic Reviews and Meta-analysis” at the Johns Hopkins Bloomberg School of Public Health.
Methods
A distinct feature of our course is a group project in which students, assigned to multi-disciplinary groups, conduct a systematic review. In-class sessions comprise didactic lectures, hands-on exercises, demonstrations, discussion, and group work. Students also work outside of class to complete the systematic review. Students evaluated the course at the end of the term. We also surveyed students from 2004 to 2012 to learn more about the long-term impact of the course.
Results
The course has been offered to more than 800 students since 1995. In our view, aspects that worked well include the hands-on approach, students working in a multidisciplinary group, intensive interaction with the teaching team, moving to an online approach, and continuous updates of the course content. A persistent issue is the constraint of time. 193 of 211 (91%) survey participants reported that the course is currently useful or as having an impact on their work.
Conclusions
Our experiences have led us to remain committed to a hands-on approach. Our course serves as a bridge between classroom learning and real-world practice, and provides an example of teaching systematic review. Copyright © 2014 John Wiley & Sons, Ltd.
Supporting Information
| Filename | Description |
|---|---|
| jrsm1111-sup-0001-03_Online_materials.pdfPDF document, 588.6 KB | Supporting info item |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- Bhandari M, Morrow F, Kulkarni AV, Tornetta P, 3rd. 2001. Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. Journal of Bone and Joint Surgery (American) 83-A(1): 15–24.
- Chandler J, Churchill R, Higgins J, Tovey D. Methodological standards for the conduct of new Cochrane Intervention Reviews. Version 2.2. 17 December 2012. Available from http://www.editorial-unit.cochrane.org/sites/editorial-unit.cochrane.org/files/uploads/MECIR_conduct_standards%202.2%2017122012.pdf
- Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Board on Health Care Services, J Eden, L Levit, A Berg, S Morton, eds. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press, Washington, D.C.
- Coomarasamy A, Khan KS. 2004. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ 329(7473): 1017.
- Davis J, Chryssafidou E, Zamora J, Davies D, Khan K, Coomarasamy A. 2007. Computer-based teaching is as good as face to face lecture-based teaching of evidence-based medicine: a randomised controlled trial. BMC Medical Education 7: 23.
- Davis J, Crabb S, Rogers E, Zamora J, Khan K. 2008. Computer-based teaching is as good as face to face lecture-based teaching of evidence-based medicine: a randomized controlled trial. Medical Teacher 30(3): 302–7.
- Del Mar C, Glasziou P, Mayer D. 2004. Teaching evidence based medicine. BMJ 329(7473): 989–90.
- Delaney A, Bagshaw SM, Ferland A, Manns B, Laupland KB, Doig CJ. 2005. A systematic evaluation of the quality of meta-analyses in the critical care literature. Critical Care 9(5): R575–82.
- Dobbie AE, Schneider FD, Anderson AD, Littlefield J. 2000. What evidence supports teaching evidence-based medicine? Academic Medicine 75(12): 1184–5.
- Glenny AM, Esposito M, Coulthard P, Worthington HV. 2003. The assessment of systematic reviews in dentistry. European Journal of Oral Sciences 111(2): 85–92.
- Green ML. 1999. Graduate medical education training in clinical epidemiology, critical appraisal, and evidence-based medicine: a critical review of curricula. Academic Medicine 74(6): 686–94.
- Green ML. 2000. Evidence-based medicine training in internal medicine residency programs a national survey. Journal of General Internal Medicine 15(2): 129–33.
- JPT Higgins, S Green, eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane-handbook.org.
- Ip S, Hadar N, Keefe S, Parkin C, Iovin R, Balk EM, Lau J. 2012. A Web-based archive of systematic review data. Systematic Review 1(1): 15.
- Kulier R, Hadley J, Weinbrenner S, et al. 2008. Harmonising evidence-based medicine teaching: a study of the outcomes of e-learning in five European countries. BMC Medical Education 8: 27.
- Kulier R, Coppus SF, Zamora J, et al. 2009. The effectiveness of a clinically integrated e-learning course in evidence-based medicine: a cluster randomised controlled trial. BMC Medical Education 9: 21.
- Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, Germar MJ, Pisake L, Mittal S, Pattinson R, Wolomby-Molondo JJ, Bergh AM, May W, Souza JP, Koppenhoefer S, Khan KS. 2012. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA 308(21): 2218–25.
- Kunz R, Nagy E, Coppus SF, et al. 2009. How far did we get? how far to go? A European survey on postgraduate courses in evidence-based medicine. Journal of Evaluation in Clinical Practice 15(6): 1196–1204
- Lewis JS. Harrison MA. 2012. Online delivery as a course adjunct promotes active learning and student success. Teaching of Psychology 39(1): 72–6.
- Li T, Dickersin K. Citation of previous meta-analyses on the same topic: a clue to perpetuation of incorrect methods? Ophthalmology. 2013. DOI: pii: S0161-6420(12)01158-X. 10.1016/j.ophtha.2012.11.038. [Epub ahead of print]
- Lundh A, Knijnenburg SL, Jorgensen AW, van Dalen EC, Kremer LC. 2009. Quality of systematic reviews in pediatric oncology—a systematic review. Cancer Treatment Reviews 35(8): 645–52.
- Malick SM, Hadley J, Davis J, Khan KS. 2010. Is evidence-based medicine teaching and learning directed at improving practice? Journal of the Royal Society of Medicine 103(6): 231–8.
- Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. 2007. Epidemiology and reporting characteristics of systematic reviews. PLoS Medicine 4(3): e78.
- Oude Rengerink K, Thangaratinam S, Barnfield G, et al. 2011. How can we teach EBM in clinical practice? An analysis of barriers to implementation of on-the-job EBM teaching and learning. Medical Teacher 33(3): e125–e130.
- Shea B, Moher D, Graham I, Pham B, Tugwell P. 2002. A comparison of the quality of Cochrane reviews and systematic reviews published in paper-based journals. Evaluation & the Health Professions 25(1): 116–29.
-
Turney CSM.,
Robinson D,
Lee M,
Soutar A. 2009. Using technology to direct learning in higher education. The way forward? Active Learning in Higher Education 10(1): 71–83.
10.1177/1469787408100196 Google Scholar
- U.S. Department of Education, Office of Planning, Evaluation, and Policy Development. 2010. Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. Washington, D.C.
- Wallace BC, Small K, Brodley CE, Lau J, Schmid CH, Bertram L, Lill CM, Cohen JT, Trikalinos TA. 2012a. Toward modernizing the systematic review pipeline in genetics: efficient updating via data mining. Genetics in Medicine 14(7): 663–9.
- Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. 2012b. Deploying an interactive machine learning system in an evidence-based practice center: abstrackr. In Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium, 819–24.
-
Zepke N,
Leach L. 2010. Improving student engagement: ten proposals for action. Active Learning in Higher Education 11(3): 167–77.
10.1177/1469787410379680 Google Scholar
