Introducing Realist Approaches in Health Professions Education Research
Charlotte E. Rees
The University of Newcastle, Callaghan, New South Wales, Australia
Monash University, Clayton, Victoria, Australia
Search for more papers by this authorVan N.B. Nguyenand
Monash University, Clayton, Victoria, Australia
Search for more papers by this authorLynn V. Monrouxe
The University of Sydney, Camperdown, New South Wales Australia
Search for more papers by this authorCharlotte E. Rees
The University of Newcastle, Callaghan, New South Wales, Australia
Monash University, Clayton, Victoria, Australia
Search for more papers by this authorVan N.B. Nguyenand
Monash University, Clayton, Victoria, Australia
Search for more papers by this authorLynn V. Monrouxe
The University of Sydney, Camperdown, New South Wales Australia
Search for more papers by this authorCharlotte Rees
The University of Newcastle, Callaghan, New South Wales, Australia
Search for more papers by this authorLynn Monrouxe
The University of Sydney, Camperdown, New South Wales, Australia
Search for more papers by this authorBridget O'Brien
University of California San Francisco, San Francisco, California, USA
Search for more papers by this authorSummary
This chapter summarises common realist methodologies and methods in health professions education research (HPER), including key principles of sampling, data collection, and data analysis. Scientific realism suggests that real entities can be articulated in theory, with mature, well-confirmed theories being approximately true. Critical realism, on the other hand, is seen as combining a realist ontology with a relativist/constructivist epistemology. Realism is often considered as an epistemological middle ground to the extremes of radical positivism and radical constructivism. The chapter explains the main indicators of quality employed in realist approaches. Realist economic evaluations essentially integrate economic analyses and realist evaluations within a realist framework. Realist methodologies seek to understand how things work in complex systems, offering a conceptualisation of causation different to the causality-as-constant-conjunction understanding inherent in scientific experimentation. Configurational analysis is a key quality marker for realist approaches. The chapter discusses the strengths and challenges of realist approaches for HPER.
References
- Porter S , O'Halloran P . The use and limitation of realistic evaluation as a tool for evidence-based practice: A critical realist perspective . Nurs Inq . 2011 ; 19 ( 1 ): 18 – 28 .
- Ajjawi R , Crampton PES , Rees CE . What really matters for successful research environments? a realist synthesis . Med Educ . 2018 ; 52 ( 9 ): 936 – 950 .
- Monrouxe LV , Hockey P , Khanna P , et al. Senior medical students as assistants in medicine in COVID-19 crisis: a realist evaluation protocol . BMJ Open . 2021 ; 11 ( 9 ): e045822 .
- Rees CE , Nguyen VNB , Ottrey E , et al. The effectiveness of extended-duration supervision training for nurses and allied health professionals: a realist evaluation . Nurs Educ Today . 2022 ; 110 : 105225 .
- Rees CE , Nguyen VNB , Foo J , et al. Balancing the effectiveness and cost of online education: a preliminary realist economic evaluation . Med Teach . 2022 ; 44 ( 9 ): 977 – 985 .
- Rees CE , Lee SL , Huang E , et al. Supervision training in healthcare: a realist synthesis . Adv Health Sci Educ . 2020 ; 25 ( 3 ): 523 – 561 .
- Carter SM , Little M . Justifying knowledge, justifying method, taking action: epistemologies, methodologies, and methods in qualitative research . Qual Health Res . 2007 ; 17 ( 10 ): 1316 – 1328 .
- Palermo C , Reidlinger DP , Rees CE . Internal coherence matters: lessons for nutrition and dietetics research . Nutr Diet . 2021 ; 78 ( 3 ): 252 – 267 .
- Westhorp G . Realist Impact Evaluation: An Introduction . London : Overseas Development Institute ; 2014 .
-
Pawson R
.
The Science of Evaluation: A Realist Manifesto
.
London
:
SAGE
;
2013
.
10.4135/9781473913820 Google Scholar
- Porter S . The uncritical realism of realist evaluation . Evaluation . 2015 ; 21 ( 1 ): 65 – 82 .
-
Brekke J
,
Anastas J
,
Floersch J
, et al.
The realist frame: scientific realism and critical realism
. In
J Brekke
,
J Anastas
, eds.
Shaping a Science of Social Work: Professional Knowledge and Identity
,
Online
ed.
New York
:
Oxford Academic
;
2019
:
22
–
40
.
10.1093/oso/9780190880668.003.0002 Google Scholar
- Niiniluoto I . Critical Scientific Realism . New York : Oxford University Press ; 2002 .
- Bhaskar R . A Realist Theory of Science . London : Routledge ; 1979 .
- Fletcher AJ . Applying critical realism in qualitative research: methodology meets method . Int J Soc Res Methodol . 2017 ; 20 ( 2 ): 181 – 194 .
-
Vincent S
,
O'Mahoney J
.
Critical realism and qualitative research: an introductory overview
. In
C Cassell
,
AL Cunliffe
,
G Grandy
, eds.
The SAGE Handbook of Qualitative Business and Management Research Methods
.
London
:
SAGE
;
2018
:
201
–
216
.
10.4135/9781526430212.n13 Google Scholar
- Nash R . Explanation and quantification in educational research: the arguments of critical and scientific realism . Br Educ Res J . 2005 ; 31 ( 2 ): 185 – 204 .
- Chirkov V , Anderson A . Statistical positivism versus critical scientific realism. A comparison of two paradigms for motivation research: part I. A philosophical and empirical analysis of statistical positivism . Theory Psychol . 2018 ; 28 ( 6 ): 712 – 736 .
- Ellaway RH , Kehoe A , Illing J . Critical realism and realist inquiry in medical education . Acad Med . 2020 ; 95 ( 7 ): 984 – 988 .
- McEvoy P , Richards D . Critical realism: a way forward for evaluation research in nursing? J Adv Nurs . 2003 ; 43 ( 4 ): 411 – 420 .
- Dalkin SM , Greenhalgh J , Jones D , et al. What's in a mechanism? Development of a key concept in realist evaluation . Implement Sci . 2015 ; 10 : 49 .
-
Chernoff F
.
Critical realism, scientific realism, and international relations theory
.
Millennium: J Int Stud
.
2007
;
35
(
2
):
399
–
407
.
10.1177/03058298070350021701 Google Scholar
-
Chirkov V
,
Anderson J
.
Statistical positivism versus critical scientific realism. A comparison of two paradigms for motivation research: part 2. A philosophical and empirical analysis of critical scientific realism
.
Theory Psychol
.
2018
;
28
(
6
):
737
–
756
.
10.1177/0959354318816829 Google Scholar
- Astbury B . Some reflections on Pawson's Science of Evaluation: A Realist Manifesto . Evaluation . 2013 ; 19 ( 4 ): 383 – 401 .
- Wong G , Greenhalgh T , Westhorp G , et al. RAMESES publication standards: realist syntheses . BMC Med . 2013 ; 11 : 21 .
- Gorchs-Font N , Ramon-Aribau A , Yildirim M , et al. Nursing students' first experience of death: identifying mechanisms for practice learning. A realist review . Nurs Educ Today . 2021 ; 96 : 104637 .
- Bansal A , Greenley S , Mitchell C , et al. Optimising planned medical education strategies to develop learners' person-centredness: a realist review . Med Educ . 2022 ; 56 ( 5 ): 489 – 503 .
- Kerr A , Kelleher C , Pawlikowska T , et al. How can pharmacists develop patient-pharmacist communication skills? A realist synthesis . Patient Educ Couns . 2021 ; 104 ( 10 ): 2467 – 2479 .
- Carrieri D , Mattick K , Pearson M , et al. Optimising strategies to address mental ill-health in doctors and medical students: ‘Care Under Pressure’ realist review and implementation guidance . BMC Med . 2020 ; 18 : 76 .
- Pierce C , Corral J , Aagaard E , et al. A BEME realist synthesis review of the effectiveness of teaching strategies used in the clinical setting on the development of clinical skills among health professionals: BEME Guide no. 61 . Med Teach . 2020 ; 42 ( 6 ): 604 – 615 .
- Browne F , Hannigan B , Harden J . A realist evaluation of a safe medication administration education programme . Nurs Educ Today . 2021 ; 97 : 104685 .
- Kerr A , Strawbridge J , Kelleher C , et al. A realist evaluation exploring simulated patient role-play in pharmacist undergraduate communication training . BMC Med Educ . 2021 ; 21 : 325 .
- Lefroy J , Walters B , Molyneux A , et al. Can learning from workplace feedback be enhanced by reflective writing? A realist evaluation in UK undergraduate medical education . Educ Prim Care . 2021 ; 32 ( 6 ): 326 – 335 .
- Rees CE , Foo J , Nguyen VNB , et al. Unpacking economic program theory for supervision training: preliminary steps towards realist economic evaluation . Med Educ . 2022 ; 56 ( 4 ): 407 – 417 .
- Wong G , Greenhalgh T , Westhorp G , et al. Realist methods in medical education research: what are they and what can they contribute? Med Educ . 2012 ; 46 ( 1 ): 89 – 96 .
- Davydova I , Sharrock W . The rise and fall of the fact/value distinction . Sociol Rev . 2003 ; 51 ( 3 ): 357 – 375 .
-
Wilson M
,
Greenhill A
.
Theory and action for emancipation: elements of a critical realist approach
. In
B Kaplan
,
DP Truex
,
D Wastell
, et al., eds.
Information Systems Research: Relevant Theory and Informed Practice
. IFIP International Federation for Information Processing. vol.
143
.
London
:
Springer
;
2004
:
667
–
674
.
10.1007/1-4020-8095-6_42 Google Scholar
- Brown S , Dalkin SM , Bate A , et al. Exploring and understanding the scope and value of the Parkinson's nurse in the UK (The USP project): a realist economic evaluation protocol . BMJ Open . 2020 ; 10 ( 10 ): e037224 .
- Lee S , Denniston C , Edouard V , et al. Supervision training interventions in the health and human services: realist synthesis protocol . BMJ Open . 2019 ; 9 ( 5 ): e025777 .
- Greenhalgh T , Pawson R , Wong G , et al. Realist evaluation, realist synthesis, realist research – what's in a name. The RAMESES II Project. National Institute for Health Research ; 2017 . https://www.ramesesproject.org/media/RAMESES_II_RE_RS_RR_whats_in_a_name.pdf (accessed 9 July 2022 ).
- Pawson R , Greenhalgh T , Harvey G , et al. Realist review – a new method of systematic review designed for complex policy interventions . J Health Serv Res Policy . 2005 ; 10 ( S1 ): 21 – 34 .
- Greenhalgh T , Pawson R , Wong G , et al. Realist evaluation and ethical considerations. The RAMESES II Project; National Institute for Health Research ; 2017 . https://www.ramesesproject.org/media/RAMESES_II_Realist_evaluation_and_ethical_considerations.pdf (accessed 9 July 2022 ).
- Wong G , Westhorp G , Manzano A , et al. RAMESES II reporting standards for realist evaluations . BMC Med . 2016 ; 14 ( 1 ): 96 .
-
Anderson R
,
Hardwick R
,
Pearson M
, et al.
Using realist approaches to explain the costs and cost-effectiveness of programs
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
107
–
130
.
10.4135/9781526451729.n8 Google Scholar
- Anderson R , Hardwick R . Realism and resources: towards more explanatory economic evaluation . Evaluation . 2016 ; 22 ( 3 ): 323 – 341 .
- Foo J , Cook DA , Tolsgaard M , et al. How to conduct cost and value analyses in health professions education: AMEE Guide no. 139 . Med Teach . 2021 ; 43 ( 9 ): 984 – 998 .
-
Ritchie J
,
Spencer L
.
Qualitative data analysis for applied policy research
. In
A Bryman
,
R Burgess
, eds.
Analyzing Qualitative Data
.
London
:
Routledge
;
1994
:
173
–
194
.
10.4324/9780203413081_chapter_9 Google Scholar
-
Williams M
.
Making up mechanisms in realist research
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
25
–
40
.
10.4135/9781526451729.n3 Google Scholar
-
Marchal B
,
Kegels G
,
Van Belle S
.
Theory and realist methods
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
79
–
89
.
10.4135/9781526451729.n6 Google Scholar
-
Emmel N
,
Greenhalgh J
,
Manzano A
, et al.
Introduction: doing realist evaluation, synthesis and research
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
1
–
13
.
10.4135/9781526451729 Google Scholar
- Manzano A . The craft of interviewing in realist evaluation . Evaluation . 2016 ; 22 ( 3 ): 342 – 360 .
- Gilmore B , McAuliffe E , Power J , et al. Data analysis and synthesis within a realist evaluation: towards more transparent methodological approaches . Int J Qual Methods . 2019 ; 18 : 1 – 11 .
- Crampton P , Mehdizadeh L , Page M , et al. Realist evaluation of UK medical education quality assurance . BMJ Open . 2019 ; 9 ( 12 ): e033614 .
- Pawson R , Tilley N . Realistic Evaluation . London : SAGE ; 1997 .
- Westhorp G , Manzano A . Realist evaluation interviewing – a ‘starter set’ of questions. The RAMESES II Project; National Institute for Health Research ; 2017 . https://www.ramesesproject.org/media/RAMESES_II_Realist_interviewing_starter_questions.pdf (accessed 9 July 2022 ).
- Shearn K , Allmark P , Percy H , et al. Building realist program theory for large complex and messy interventions . Int J Qual Methods . 2017 ; 16 : 1 – 11 .
-
Wong G
.
Data gathering in realist reviews – looking for needles in haystacks
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
131
–
145
.
10.4135/9781526451729.n9 Google Scholar
- Greenhalgh T , Pawson R , Wong G , et al. The realist interview. The RAMESES II Project; National Institute for Health Research ; 2017 . http://www.ramesesproject.org/media/RAMESES_II_Realist_interviewing.pdf (accessed 9 July 2022 ).
- Ogrinc G , Ercolano E , Cohen ES , et al. Educational systems factors that engage resident physicians in an integrated quality improvement curriculum at a VA hospital: a realist evaluation . Acad Med . 2014 ; 89 ( 10 ): 1380 – 1385 .
- Pawson R , Manzano-Santaella A . A realist diagnostic workshop . Evaluation . 2012 ; 18 ( 2 ): 176 – 191 .
- Jagosh J . Retroductive theorizing in Pawson and Tilley's applied scientific realism . J Crit Realism . 2020 ; 19 ( 2 ): 121 – 130 .
- Husereau D , Drummond M , Petrou S , et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement . BMJ . 2013 ; 346 : f1049 – f1049 .
-
De Weger E
,
Van Vooren NJE
,
Wong G
, et al.
What's in a realist configuration? Deciding which causal configuration to use, how, and why?
Int J Qual Methods
.
2020
;
19
:
1
–
8
.
10.1177/1609406920938577 Google Scholar
- Astbury B , Leeuw F . Unpacking black boxes: mechanisms and theory building in evaluation . Am J Eval . 2010 ; 31 ( 3 ): 363 – 381 .
-
Greenhalgh J
,
Manzano A
.
Understanding ‘context’ in realist evaluation and synthesis
.
Int J Soc Res Methodol
.
2022
;
25
(
5
):
583
–
595
.
10.1080/13645579.2021.1918484 Google Scholar
-
Jolly H
,
Jolly L
.
Telling context from mechanism in realist evaluation: the role for theory
.
Learning Communities: Int J Learn in Soc Contexts
.
2014
;
14
:
28
–
45
.
10.18793/LCJ2014.14.03 Google Scholar
- Nguyen VNB , Rees CE , Ottrey E , et al. What really matters for supervision training workshops? A realist evaluation . Acad Med . 2022 ; 97 ( 8 ): 1203 – 1212 .
-
Biesta G
.
Improving education through research? From effectiveness, causality and technology to purpose, complexity and culture
.
Policy Futures Educ
.
2016
;
14
(
2
):
194
–
210
.
10.1177/1478210315613900 Google Scholar
-
Tilley N
.
The middle-range methodology of realist evaluation
. In
N Emmel
,
J Greenhalgh
,
A Manzano
, et al., eds.
Doing Realist Research
.
London
:
SAGE
;
2018
:
15
–
24
.
10.4135/9781526451729.n2 Google Scholar
- Pawson R , Tilley N . What works in evaluation research? Br J Criminol . 1994 ; 34 ( 3 ): 291 – 306 .