Separate amygdala subregions signal surprise and predictiveness during associative fear learning in humans
Corresponding Author
Sabrina Boll
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Correspondence: Sabrina Boll, as above.
E-mail: [email protected]
Search for more papers by this authorMatthias Gamer
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorSebastian Gluth
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorJürgen Finsterbusch
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorChristian Büchel
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorCorresponding Author
Sabrina Boll
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Correspondence: Sabrina Boll, as above.
E-mail: [email protected]
Search for more papers by this authorMatthias Gamer
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorSebastian Gluth
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorJürgen Finsterbusch
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorChristian Büchel
Department of Systems Neuroscience, University Medical Center Hamburg–Eppendorf, Martinistrasse 52, Building W34, D-20246 Hamburg, Germany
Search for more papers by this authorAbstract
It has recently been suggested that learning signals in the amygdala might be best characterized by attentional theories of associative learning [such as Pearce–Hall (PH)] and more recent hybrid variants that combine Rescorla–Wagner and PH learning models. In these models, unsigned prediction errors (PEs) determine the associability of a cue, which is used in turn to control learning of outcome expectations dynamically and reflects a function of the reliability of prior outcome predictions. Here, we employed an aversive Pavlovian reversal-learning task to investigate computational signals derived from such a hybrid model. Unlike previous accounts, our paradigm allowed for the separate assessment of associability at the time of cue presentation and PEs at the time of outcome. We combined this approach with high-resolution functional magnetic resonance imaging to understand how different subregions of the human amygdala contribute to associative learning. Signal changes in the corticomedial amygdala and in the midbrain represented unsigned PEs at the time of outcome showing increased responses irrespective of whether a shock was unexpectedly administered or omitted. In contrast, activity in basolateral amygdala regions correlated negatively with associability at the time of cue presentation. Thus, whereas the corticomedial amygdala and the midbrain reflected immediate surprise, the basolateral amygdala represented predictiveness and displayed increased responses when outcome predictions became more reliable. These results extend previous findings on PH-like mechanisms in the amygdala and provide unique insights into human amygdala circuits during associative learning.
References
- Amunts, K., Kedo, O., Kindler, M., Pieperhoff, P., Mohlberg, H., Shah, N.J., Habel, U., Schneider, F. & Zilles, K. (2005) Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps. Anat. Embryol., 210, 343–352.
- Bach, D.R., Weiskopf, N. & Dolan, R.J. (2011) A stable sparse fear memory trace in human amygdala. J. Neurosci., 31, 9383–9389.
- Barot, S.K., Kyono, Y., Clark, E.W. & Bernstein, I.L. (2008) Visualizing stimulus convergence in amygdala neurons during associative learning. Proc. Natl. Acad. Sci. USA, 105, 20959–20963.
- Belova, M.A., Paton, J.J., Morrison, S.E. & Salzman, C.D. (2007) Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron, 55, 970–984.
- Boll, S., Gamer, M., Kalisch, R. & Buchel, C. (2011) Processing of facial expressions and their significance for the observer in subregions of the human amygdala. Neuroimage, 56, 299–306.
- Cahill, L. (2010) Sex influences on brain and emotional memory: the burden of proof has shifted. Prog. Brain Res., 186, 29–40.
- Calu, D.J., Roesch, M.R., Haney, R.Z., Holland, P.C. & Schoenbaum, G. (2010) Neural correlates of variations in event processing during learning in central nucleus of amygdala. Neuron, 68, 991–1001.
- Davis, M. & Whalen, P.J. (2001) The amygdala: vigilance and emotion. Mol. Psychiatry, 6, 13–34.
- Davis, F.C., Johnstone, T., Mazzulla, E.C., Oler, J.A. & Whalen, P.J. (2010) Regional response differences across the human amygdaloid complex during social conditioning. Cereb. Cortex, 20, 612–621.
- Ehrlich, I., Humeau, Y., Grenier, F., Ciocchi, S., Herry, C. & Luthi, A. (2009) Amygdala inhibitory circuits and the control of fear memory. Neuron, 62, 757–771.
- Eickhoff, S.B., Stephan, K.E., Mohlberg, H., Grefkes, C., Fink, G.R., Amunts, K. & Zilles, K. (2005) A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage, 25, 1325–1335.
- Eippert, F., Gamer, M. & Buchel, C. (2012) Neurobiological mechanisms underlying the blocking effect in aversive learning. J. Neurosci., 32, 13164–13176.
- Gamer, M., Zurowski, B. & Buchel, C. (2010) Different amygdala subregions mediate valence-related and attentional effects of oxytocin in humans. Proc. Natl. Acad. Sci. USA, 107, 9400–9405.
- Glascher, J. & Buchel, C. (2005) Formal learning theory dissociates brain regions with different temporal integration. Neuron, 47, 295–306.
- Glascher, J., Daw, N., Dayan, P. & O'Doherty, J.P. (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66, 585–595.
- Herry, C., Bach, D.R., Esposito, F., Di Salle, F., Perrig, W.J., Scheffler, K., Luthi, A. & Seifritz, E. (2007) Processing of temporal unpredictability in human and animal amygdala. J. Neurosci., 27, 5958–5966.
- Holland, P.C. & Gallagher, M. (1993) Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing. Behav. Neurosci., 107, 246–253.
- Holland, P.C. & Gallagher, M. (1999) Amygdala circuitry in attentional and representational processes. Trends Cogn. Sci., 3, 65–73.
- Holland, P.C. & Gallagher, M. (2006) Different roles for amygdala central nucleus and substantia innominata in the surprise-induced enhancement of learning. J. Neurosci., 26, 3791–3797.
- Johnson, A.W., Gallagher, M. & Holland, P.C. (2009) The basolateral amygdala is critical to the expression of pavlovian and instrumental outcome-specific reinforcer devaluation effects. J. Neurosci., 29, 696–704.
- Le Pelley, M.E. (2004) The role of associative history in models of associative learning: a selective review and a hybrid model. Q. J. Exp. Psychol. B, 57, 193–243.
- LeDoux, J. (2007) The amygdala. Curr. Biol., 17, R868–R874.
- Lee, H.J., Youn, J.M., O, M.J., Gallagher, M. & Holland, P.C. (2006) Role of substantia nigra-amygdala connections in surprise-induced enhancement of attention. J. Neurosci., 26, 6077–6081.
- Lee, H.J., Youn, J.M., Gallagher, M. & Holland, P.C. (2008) Temporally limited role of substantia nigra-central amygdala connections in surprise-induced enhancement of learning. Eur. J. Neurosci., 27, 3043–3049.
- Lee, H.J., Gallagher, M. & Holland, P.C. (2010) The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning. Learn. Mem., 17, 531–538.
- Lewandowsky, S. & Farrell, S. (2011) Computational Modeling in Cognition: Principles and Practice. Sage Publications, Thousand Oaks.
10.4135/9781483349428 Google Scholar
- Li, J., Schiller, D., Schoenbaum, G., Phelps, E.A. & Daw, N.D. (2011) Differential roles of human striatum and amygdala in associative learning. Nat. Neurosci., 14, 1250–1252.
- Lindgren, J.L., Gallagher, M. & Holland, P.C. (2003) Lesions of basolateral amygdala impair extinction of CS motivational value, but not of explicit conditioned responses, in Pavlovian appetitive second-order conditioning. Eur. J. Neurosci., 17, 160–166.
- Mackintosh, N. (1975) A theory of attention: variations in the associability of stimulus with reinforcement. Psychol. Rev., 82, 276–298.
- Mai, J.K., Paxinos, G. & Voss, T. (2008) Atlas of the Human Brain. Elsevier, New York.
- Maldjian, J.A., Laurienti, P.J., Kraft, R.A. & Burdette, J.H. (2003) An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage, 19, 1233–1239.
- Maren, S. & Quirk, G.J. (2004) Neuronal signalling of fear memory. Nat. Rev. Neurosci., 5, 844–852.
- Matsumoto, M. & Hikosaka, O. (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature, 459, 837–841.
- Metereau, E. & Dreher, J.C. (2012) Cerebral correlates of salient prediction error for different rewards and punishments. Cereb. Cortex, doi: 10.1093/cercor/bhs037 [Epub ahead of print].
- Milad, M.R., Goldstein, J.M., Orr, S.P., Wedig, M.M., Klibanski, A., Pitman, R.K. & Rauch, S.L. (2006) Fear conditioning and extinction: influence of sex and menstrual cycle in healthy humans. Behav. Neurosci., 120, 1196–1203.
- Mohr, P.N., Biele, G. & Heekeren, H.R. (2010) Neural processing of risk. J. Neurosci., 30, 6613–6619.
- Nelder, J. & Mead, R. (1965) A simplex method for function minimization. Comput. J., 7, 308–313.
- Pape, H.C. & Pare, D. (2010) Plastic synaptic networks of the amygdala for the acquisition, expression, and extinction of conditioned fear. Physiol. Rev., 90, 419–463.
- Pearce, J.M. & Hall, G. (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev., 87, 532–552.
- Prevost, C., McCabe, J.A., Jessup, R.K., Bossaerts, P. & O'Doherty, J.P. (2011) Differentiable contributions of human amygdalar subregions in the computations underlying reward and avoidance learning. Eur. J. Neurosci., 34, 134–145.
- Raio, C.M., Carmel, D., Carrasco, M. & Phelps, E.A. (2012) Nonconscious fear is quickly acquired but swiftly forgotten. Curr. Biol., 22, R477–R479.
- Reijmers, L.G., Perkins, B.L., Matsuo, N. & Mayford, M. (2007) Localization of a stable neural correlate of associative memory. Science, 317, 1230–1233.
- Rescorla, R. & Wagner, A. (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In A. Black & W. Prokasy (Eds), Classical Conditioning II: Current Research and Theory. Appelton Century Crofts, New York, pp. 64–99.
- Roesch, M.R., Calu, D.J., Esber, G.R. & Schoenbaum, G. (2010) Neural correlates of variations in event processing during learning in basolateral amygdala. J. Neurosci., 30, 2464–2471.
- Schiller, D., Levy, I., Niv, Y., LeDoux, J.E. & Phelps, E.A. (2008) From fear to safety and back: reversal of fear in the human brain. J. Neurosci., 28, 11517–11525.
- Schiller, D., Monfils, M.H., Raio, C.M., Johnson, D.C., LeDoux, J.E. & Phelps, E.A. (2010) Preventing the return of fear using reconsolidation update mechanisms. Nature, 463, 49–53.
- Schoenbaum, G., Setlow, B., Saddoris, M.P. & Gallagher, M. (2003) Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron, 39, 855–867.
- Schultz, W. & Dickinson, A. (2000) Neuronal coding of prediction errors. Annu. Rev. Neurosci., 23, 473–500.
- Seymour, B., O'Doherty, J.P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K. & Dolan, R. (2005) Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat. Neurosci., 8, 1234–1240.