Event-Related Potentials in Monolingual and Bilingual Non-literal Language Processing
Anna Siyanova-Chanturia
Search for more papers by this authorPaolo Canal
Search for more papers by this authorRoberto R. Heredia
Search for more papers by this authorAnna Siyanova-Chanturia
Search for more papers by this authorPaolo Canal
Search for more papers by this authorRoberto R. Heredia
Search for more papers by this authorJohn W. Schwieter
Search for more papers by this authorMichel Paradis
Search for more papers by this authorSummary
Idioms and metaphors, in particular, have long been of interest to researchers working within the realm of online language processing. This chapter largely focus on these two kinds of expressions. It outlines the major findings in monolingual research on non-literal language processing that employed event-related potentials (ERPs). The chapter reviews a handful of ERP studies that have looked at bilingual figurative language processing and highlight the need for further research. It first discusses a number of theories put forward to account for non-literal language representation and access in a first language (L1), as well as some of the pertinent studies with second language (L2) speakers. It provides a discussion on the ERP methodology and, specifically, the ERP components implicated in non-literal language processing. Finally, the chapter reviews a selection of ERP studies on figurative language processing in monolingual participants, before turning to the studies on non-literal language processing in bilingual populations.
REFERENCES
- Abkarian , G. , Jones , A. , and West , G. ( 1992 ). Young children's idiom comprehension: trying to get the picture . Journal of Speech and Hearing Research 35 : 580 – 587 .
- Arzouan , Y. , Goldstein , A. , and Faust , M. ( 2007 ). Brainwaves are stethoscopes: ERP correlates of novel metaphor comprehension . Brain Research 1160 : 69 – 81 .
- Bambini , V. , Bertini , C. , Schaeken , W. et al. ( 2016 ). Disentangling metaphor from context: an ERP study . Frontiers in Psychology 7 : 559 . https://doi.org/10.3389/fpsyg.2016.00559 .
- Beck , S. and Weber , A. ( 2016 ). Bilingual and monolingual idiom processing is cut from the same cloth: the role of the L1 in literal and figurative meaning activation . Frontiers in Psychology https://doi.org/10.3389/fpsyg.2016.01350 .
- Bobrow , S. and Bell , S. ( 1973 ). On catching on to idiomatic expressions . Memory & Cognition 1 ( 3 ): 343 – 346 .
- Bornkessel-Schlesewsky , I. and Schlesewsky , M. ( 2008 ). An alternative perspective on ‘semantic P600’ effects in language comprehension . Brain Research Reviews 59 ( 1 ): 55 – 73 .
- Brouwer , H. and Hoeks , J.C. ( 2013 ). A time and place for language comprehension: mapping the N400 and the P600 to a minimal cortical network . Frontiers in Human Neuroscience 7 : 758 . https://doi.org/10.3389/fnhum.2013.00758 .
- Cacciari , C. and Levorato , M. ( 1989 ). How children understand idioms in discourse . Journal of Child Language 16 : 387 – 405 .
- Cacciari , C. and Tabossi , P. ( 1988 ). The comprehension of idioms . Journal of Memory and Language 27 : 668 – 683 .
- Canal , P. , Pesciarelli , F. , Vespignani , F. et al. ( 2017 ). Basic composition and enriched integration in idiom processing: an EEG study . Journal of Experimental Psychology: Learning, Memory, and Cognition 43 ( 6 ): 928 – 943 .
- Carrol , G. and Conklin , K. ( 2014 ). Getting your wires crossed: evidence for fast processing of L1 idioms in an L2 . Bilingualism: Language and Cognition 17 ( 4 ): 784 – 797 .
- Carrol , G. , Conklin , K. , and Gyllstad , H. ( 2016 ). Found in translation. The influence of the L1 on the reading of idioms in a L2 . Studies in Second Language Acquisition 38 : 403 – 443 .
-
Chen , H.
,
Peng , X.
, and
Zhao , Y.
(
2013
).
An ERP study on metaphor comprehension in the bilingual brain
.
Chinese Journal of Applied Linguistics
36
(
4
):
505
–
517
.
10.1515/cjal-2013-0034 Google Scholar
- Cieślicka , A.B. ( 2006 ). Literal salience in on-line processing of idiomatic expressions by second language learners . Second Language Research 22 ( 2 ): 115 – 144 .
- Cieślicka , A.B. , García , T. , and Heredia , R.R. ( 2017 ). Task effects in bilingual idiom comprehension . Poznań Studies in Contemporary Linguistics 53 ( 1 ): 95 – 117 . https://doi.org/10.1515/psicl-2017-0005 .
- Coulson , S. and Kutas , M. ( 2001 ). Getting it: human event-related brain response to jokes in good and poor comprehenders . Neuroscience Letters 316 ( 2 ): 71 – 74 .
- Coulson , S. and Van Petten , C. ( 2002 ). Conceptual integration and metaphor: an event-related potential study . Memory & Cognition 30 ( 6 ): 958 – 968 .
- Coulson , S. and Van Petten , C. ( 2007 ). A special role for the right hemisphere in metaphor comprehension? ERP evidence from hemifield presentation . Brain Research 1146 : 128 – 145 .
- Davidson , D. ( 1978 ). What metaphors mean . Critical Inquiry 5 ( 1 ): 31 – 47 .
- De Grauwe , S. , Swain , A. , Holcomb , P.J. et al. ( 2010 ). Electrophysiological insights into the processing of nominal metaphors . Neuropsychologia 48 ( 7 ): 1965 – 1984 .
- Donchin , E. and Coles , M. ( 1988 ). Is the P300 component a manifestation of context updating? Behavioral and Brain Sciences 11 : 357 – 374 .
- Fauconnier , G. and Turner , M. ( 1998 ). Conceptual integration networks . Cognitive Science 22 ( 2 ): 133 – 187 .
- Federmeier , K. and Kutas , M. ( 1999 ). A rose by any other name: long term memory structure and sentence processing . Journal of Memory and Language 41 : 469 – 495 .
- Friederici , A.D. ( 2002 ). Towards a neural basis of auditory sentence processing . Trends in Cognitive Sciences 6 ( 2 ): 78 – 84 .
- Friederici , A.D. ( 2011 ). The brain basis of language processing: from structure to function . Physiological Reviews 91 ( 4 ): 1357 – 1392 .
-
García , O.
,
Cieślicka , A.B.
, and
Heredia , R.R.
(
2015
).
Nonliteral language processing and methodological considerations
. In:
Bilingual Figurative Language Processing
(ed.
R.R. Heredia
and
A.B. Cieślicka
),
117
–
168
.
New York, NY
:
University of Cambridge Press
.
10.1017/CBO9781139342100.009 Google Scholar
- Gibbs , R. ( 1980 ). Spilling the beans on understanding and memory for idioms in conversation . Memory & Cognition 8 : 449 – 456 .
- Gibbs , R. ( 1986 ). Skating on thin ice: literal meaning and understanding of idioms in conversation . Discourse Processes 9 : 17 – 30 .
- Gibbs , R. , Nayak , N. , and Cutting , C. ( 1989 ). How to kick the bucket and not decompose: analyzability and idiom processing . Journal of Memory and Language 28 : 576 – 593 .
- Giora , R. ( 1997 ). Understanding figurative and literal language: the graded salience hypothesis . Cognitive Linguistics 7 : 183 – 206 .
- Giora , R. ( 2003 ). On our Mind: Salience, Context, and Figurative Language . Oxford, UK : Oxford University Press .
-
Glucksberg , S.
(
2001
).
Understanding Figurative Language: From Metaphor to Idioms
.
Oxford, UK
:
Oxford University Press
.
10.1093/acprof:oso/9780195111095.001.0001 Google Scholar
- Glucksberg , S. ( 2003 ). The psycholinguistics of metaphor . Trends in Cognitive Sciences 7 ( 2 ): 92 – 96 .
-
Grice , H.P.
(
1975
).
Logic and conversation
. In:
Syntax and Semantics: Speech Acts
, vol.
3
(ed.
P. Cole
and
J. Morgan
),
41
–
58
.
New York, NY
:
Academic Press
.
10.1163/9789004368811_003 Google Scholar
- Hagoort , P. and Van Berkum , J. ( 2007 ). Beyond the sentence given . Philosophical Transactions of the Royal Society, B: Biological Sciences 362 ( 1481 ): 801 – 811 .
- Hahne , A. ( 2001 ). What's different in second-language processing? Evidence from event-related brain potentials . Journal of Psycholinguistic Research 30 ( 3 ): 251 – 266 .
- Heredia , R.R. and Cieślicka , A.B. ( 2016 ). Metaphoric reference: an eye movement analysis of Spanish–English and English–Spanish bilingual readers . Frontiers in Psychology 7 : 439 . doi: 10.3389/fpsyg.2016.00439 .
- Ibáñez , A. , Manes , F. , Escobar , J. et al. ( 2010 ). Gesture influences the processing of figurative language in non-native speakers: ERP evidence . Neuroscience Letters 471 ( 1 ): 48 – 52 .
- Ibáñez , A. , Toro , P. , Cornejo , C. et al. ( 2011 ). High contextual sensitivity of metaphorical expressions and gesture blending: a video event-related potential design . Psychiatry Research: Neuroimaging 191 ( 1 ): 68 – 75 .
- Jankowiak , K. , Rataj , K. , and Naskręcki , R. ( 2017 ). To electrify bilingualism: electrophysiological insights into bilingual metaphor comprehension . PLoS One 12 ( 4 ): e0175578 . doi: 10.1371/journal.pone.0175578 .
- Kaan , E. and Swaab , T. ( 2003 ). Repair, revision, and complexity in syntactic analysis: an electrophysiological differentiation . Journal of Cognitive Neuroscience 15 ( 1 ): 98 – 110 .
- Kappenman , E.S. and Luck , S.J. ( 2012 ). ERP components: the ups and downs of brainwave recordings . In: The Oxford Handbook of Event-Related Potential Components (ed. E. Kappenman and S. Luck ), 3 – 30 . Oxford, UK : Oxford University Press .
- Kok , A. ( 2001 ). On the utility of P300 amplitude as a measure of processing capacity . Psychophysiology 38 : 557 – 577 .
- Konopka , A. and Bock , K. ( 2009 ). Lexical or syntactic control of sentence formulation? Structural generalizations from idiom production . Cognitive Psychology 58 ( 1 ): 68 – 101 .
- Kutas , M. and Federmeier , K.D. ( 2011 ). Thirty years and counting: finding meaning in the N400 component of the event related brain potential (ERP) . Annual Review of Psychology 62 : 621 – 647 .
- Kutas , M. and Hillyard , S.A. ( 1980 ). Reading senseless sentences: brain potentials reflect semantic incongruity . Science 207 ( 4427 ): 203 – 205 .
-
Kutas , M.
and
Kluender , R.
(
1994
).
What is who violating? A reconsideration of linguistic violations in light of event-related brain potentials
. In:
Cognitive Electrophysiology
(ed.
H.-J. Heinze
,
T.F. Munte
and
G.R. Mangun
),
183
–
210
.
Boston, MA
:
Birkhauser
.
10.1007/978-1-4612-0283-7_8 Google Scholar
- Lai , V.T. , Curran , T. , and Menn , L. ( 2009 ). Comprehending conventional and novel metaphors: an ERP study . Brain Research 1284 : 145 – 155 .
- Lau , E.F. , Phillips , C. , and Poeppel , D. ( 2008 ). A cortical network for semantics: (de)constructing the N400 . Nature Reviews Neuroscience 9 ( 12 ): 920 – 933 .
- Laurent , J. , Denhières , G. , Passerieux , C. et al. ( 2006 ). On understanding idiomatic language . Brain Research 1068 : 151 – 160 .
- Littlemore , J. and Low , G. ( 2006 ). Metaphoric competence, second language learning, and communicative language ability . Applied Linguistics 27 ( 2 ): 268 – 294 .
- Liu , Y. , Li , P. , Shu , H. et al. ( 2010 ). Structure and meaning in Chinese: an ERP study of idioms . Journal of Neurolinguistics 23 ( 6 ): 615 – 630 .
- Luck , S.J. ( 2014 ). An Introduction to the Event-Related Potential Technique . Cambridge, MA : MIT Press .
-
Martin , C.
,
Vu , H.
,
Kellas , G.
, and
Metcalf , K.
(
1999
).
Strength of discourse context as a determinant of the subordinate bias effect
.
The Quarterly Journal of Experimental Psychology
52A
(
4
):
813
–
839
.
10.1080/713755861 Google Scholar
-
Matlock , T.
and
Heredia , R.
(
2002
).
Understanding phrasal verbs in monolinguals and bilinguals
. In:
Bilingual Sentence Processing
(ed.
R. Heredia
and
J. Altarriba
),
251
–
274
.
Holland, The Netherlands
:
Elsevier Press
.
10.1016/S0166-4115(02)80014-0 Google Scholar
- Midgley , K.J. , Holcomb , P.J. , and Grainger , J. ( 2009 ). Language effects in second language learners and proficient bilinguals investigated with event-related potentials . Journal of Neurolinguistics 22 ( 3 ): 281 – 300 .
- Molinaro , N. , Barber , H.A. , and Carreiras , M. ( 2011 ). Grammatical agreement processing in reading: ERP findings and future directions . Cortex 47 ( 8 ): 908 – 930 .
- Molinaro , N. and Carreiras , M. ( 2010 ). Electrophysiological evidence of interaction between contextual expectation and semantic integration during the processing of collocations . Biological Psychology 83 ( 3 ): 176 – 190 .
- Mondini , S. , Jarema , G. , Luzzatti , C. et al. ( 2002 ). Why is ‘red cross’ different from ‘yellow cross’?: a neurophysiological study of non-adjective agreement within Italian compounds . Brain and Language 81 : 621 – 634 .
- Moreno , E. , Federmeier , K. , and Kutas , M. ( 2002 ). Switching languages, switching palabras (words): an electrophysiological study of code switching . Brain and Language 80 : 188 – 207 .
- Moreno , E.M. and Kutas , M. ( 2005 ). Processing semantic anomalies in two languages: an electrophysiological exploration in both languages of Spanish-English bilinguals . Brain Research. Cognitive Brain Research 22 ( 2 ): 205 – 220 .
- Moreno , E.M. , Rodrigues-Fornells , A. , and Laine , M. ( 2008 ). Event-related potentials (ERPs) in the study if bilingual language processing . Journal of Neurolinguistics 21 : 477 – 508 .
- Neville , H.J. , Kutas , M. , Chesney , G. , and Schmidt , A.L. ( 1986 ). Event-related brain potentials during initial encoding and recognition memory of congruous and incongruous words . Journal of Memory and Language 25 ( 1 ): 75 – 92 .
- Nippold , M. and Rudzinski , M. ( 1993 ). Familiarity and transparency in idiom explanation: a developmental study of children and adolescents . Journal of Speech and Hearing Research 36 : 728 – 737 .
- Nunberg , G. , Sag , I.A. , and Wasow , T. ( 1994 ). Idioms . Language 70 ( 3 ): 491 – 538 .
- Osterhout , L. and Holcomb , P.J. ( 1992 ). Event-related brain potentials elicited by syntactic anomaly . Journal of Memory and Language 31 ( 6 ): 785 – 806 .
- Osterhout , L. and Holcomb , P.J. ( 1995 ). Event-related potentials and language comprehension . In: Electrophysiology of Mind: Event-Related Brain Potentials and Cognition (ed. M.D. Rugg and M.G.H. Coles ), 171 – 215 . Oxford, UK : Oxford University Press .
-
Paulmann , S.
,
Ghareeb-Ali , Z.
, and
Felser , C.
(
2015
).
Neurophysiological markers of phrasal verb processing: evidence from L1 and L2 speakers
. In:
Bilingual Figurative Language Processing
(ed.
R.R. Heredia
and
A.B. Cieślicka
),
245
–
267
.
New York, NY
:
Cambridge University Press
.
10.1017/CBO9781139342100.013 Google Scholar
- Phillips , N.A. , Segalowitz , N. , O'Brien , I. , and Yamasaki , N. ( 2004 ). Semantic priming in a first and second language: evidence from reaction time variability and event-related brain potentials . Journal of Neurolinguistics 17 : 237 – 262 .
- Pynte , J. , Besson , M. , Robichon , F.-H. , and Poli , J. ( 1996 ). The time-course of metaphor comprehension: an event-related potential study . Brain and Language 55 ( 3 ): 293 – 316 .
- Regel , S. , Gunter , T.C. , and Friederici , A.D. ( 2011 ). Isn't it ironic? An electrophysiological exploration of figurative language processing . Journal of Cognitive Neuroscience 23 ( 2 ): 277 – 293 .
- Regel , S. , Meyer , L. , & Gunter , T. C. ( 2014 ). Distinguishing neurocognitive processes reflected by P600 effects: Evidence from ERPs and neural oscillations . Retrieved from http://dx.plos.org/10.1371/journal.pone.0096840
- Roehm , D. , Bornkessel-Schlesewsky , I. , Rösler , F. , and Schlesewsky , M. ( 2007 ). To predict or not to predict: influences of task and strategy on the processing of semantic relations . Journal of Cognitive Neuroscience 19 : 1259 – 1274 .
- Rommers , J. , Dijkstra , T. , and Bastiaansen , M. ( 2013 ). Context-dependent semantic processing in the human brain: evidence from idiom comprehension . Journal of Cognitive Neuroscience 25 ( 5 ): 762 – 776 .
- Rugg , M.D. and Coles , M.G. ( 1995 ). Electrophysiology of Mind: Event-Related Brain Potentials and Cognition . Oxford, UK : Oxford University Press .
-
Searle , J.R.
(
1979
).
Intentionality and the use of language
. In:
Meaning and Use
(ed.
A. Margalit
),
181
–
197
.
New York, NY
:
Springer
.
10.1007/978-1-4020-4104-4_15 Google Scholar
- Siyanova-Chanturia , A. , Conklin , K. , Caffarra , S. et al. ( 2017 ). Representation and processing of multi-word expressions in the brain . Brain and Language 175 : 111 – 122 .
- Siyanova-Chanturia , A. , Conklin , K. , and Schmitt , N. ( 2011 ). Adding more fuel to the fire: an eye-tracking study of idiom processing by native and nonnative speakers . Second Language Research 27 : 251 – 272 .
- Sperber , D. and Wilson , D. ( 1985 ). Loose talk . In: Proceedings of the Aristotelian Society , vol. 86 , 153 – 171 . Oxford, UK : Oxford University Press on behalf of The Aristotelian Society .
- Spotorno , N. , Cheylus , A. , Van Der Henst , J.B. , and Noveck , I.A. ( 2013 ). What's behind a P600? Integration operations during irony processing . PLoS One 8 ( 6 ): e66839 .
- Sprenger , S. , Levelt , W. , and Kempen , G. ( 2006 ). Lexical access during the production of idiomatic phrases . Journal of Memory and Language 54 : 161 – 184 .
- Strandburg , R. , Marsh , J. , Brown , W. et al. ( 1993 ). Event-related potentials in high-functioning adult autistics . Neuropsychologia 31 : 413 – 434 .
- Swinney , D. and Cutler , A. ( 1979 ). The access and processing of idiomatic expressions . Journal of Verbal Learning and Verbal Behaviour 18 : 523 – 534 .
- Tabossi , P. , Fanari , R. , and Wolf , K. ( 2009 ). Why are idioms recognized fast? Memory & Cognition 37 ( 4 ): 529 – 540 .
-
Titone , D.
,
Columbus , G.
,
Whitford , V.
et al. (
2015
).
Contrasting bilingual and monolingual idiom processing
. In:
Bilingual Figurative Language
(ed.
R.R. Heredia
and
A.B. Cieślicka
),
71
–
207
.
Cambridge, UK
:
Cambridge University Press
.
10.1017/CBO9781139342100.011 Google Scholar
- Van Lancker , D. and Kempler , D. ( 1987 ). Comprehension of familiar phrases by left- but not by right-hemisphere damaged patients . Brain and Language 32 : 265 – 277 .
- Van Lancker-Sidtis , D. , Postman , W. , and Glosser , G. ( 2004 ). Feast or famine: fixed expressions in the spontaneous speech of left hemisphere- and right hemisphere-damaged participants . Brain and Language 91 : 47 – 48 .
- Van Petten , C. and Kutas , M. ( 1990 ). Interactions between sentence context and word frequency in event-related brain potentials . Memory & Cognition 18 : 380 – 393 .
- Van Petten , C. and Luka , B.J. ( 2012 ). Prediction during language comprehension: benefits, costs, and ERP components . International Journal of Psychophysiology 83 ( 2 ): 176 – 190 .
- Vega-Moreno , R.E. ( 2001 ). Representing and processing idioms . UCL Working Papers in Linguistics 13 : 73 – 109 .
- Verleger , R. ( 1988 ). Event-related potentials and cognition: a critique of the context-updating hypothesis and an alternative interpretation of the P300 . Behavioral and Brain Sciences 11 : 343 – 427 .
- Vespignani , F. , Canal , P. , Molinaro , N. et al. ( 2010 ). Predictive mechanisms in idiom comprehension . Journal of Cognitive Neuroscience 22 ( 8 ): 1682 – 1700 .
- Weiland , H. , Bambini , V. , and Schumacher , P.B. ( 2014 ). The role of literal meaning in figurative language comprehension: evidence from masked priming ERP . Frontiers in Human Neuroscience 8 : 583 .
- Yang , F.-P.G. , Bradeley , K. , Huq , M. et al. ( 2013 ). Contextual effects on conceptual blending in metaphors: an event-related potential study . Journal of Neurolinguistics 26 : 312 – 326 .
- Zhang , H. , Yang , Y. , Gu , J. , and Ji , F. ( 2013 ). ERP correlates of compositionality in Chinese idiom comprehension . Journal of Neurolinguistics 26 ( 1 ): 89 – 112 .
- Zhou , S. , Zhou , W. , and Chen , X. ( 2004 ). Spatiotemporal analysis of ERP during Chinese idiom comprehension . Brain Topography 17 ( 1 ): 27 – 37 .