INTEGRATING FUNCTIONAL NEUROIMAGING AND HUMAN OPERANT RESEARCH: BRAIN ACTIVATION CORRELATED WITH PRESENTATION OF DISCRIMINATIVE STIMULI
Corresponding Author
Michael W. Schlund
KENNEDY KRIEGER INSTITUTE, JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, AND THE UNIVERSITY OF PITTSBURGH
Kennedy Krieger Institute, Johns Hopkins University, and the University of Pittsburgh
Department of Psychology, University of Pittsburgh, Learning Research and Development Center, 3939 O'Hara Street., Pittsburgh, Pennsylvania 15260 (e-mail: [email protected] or [email protected]).Search for more papers by this authorMichael F. Cataldo
KENNEDY KRIEGER INSTITUTE, JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, AND THE UNIVERSITY OF PITTSBURGH
Kennedy Krieger Institute and Johns Hopkins University.
Search for more papers by this authorCorresponding Author
Michael W. Schlund
KENNEDY KRIEGER INSTITUTE, JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, AND THE UNIVERSITY OF PITTSBURGH
Kennedy Krieger Institute, Johns Hopkins University, and the University of Pittsburgh
Department of Psychology, University of Pittsburgh, Learning Research and Development Center, 3939 O'Hara Street., Pittsburgh, Pennsylvania 15260 (e-mail: [email protected] or [email protected]).Search for more papers by this authorMichael F. Cataldo
KENNEDY KRIEGER INSTITUTE, JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE, AND THE UNIVERSITY OF PITTSBURGH
Kennedy Krieger Institute and Johns Hopkins University.
Search for more papers by this authorAbstract
Results of numerous human imaging studies and nonhuman neurophysiological studies on “reward” highlight a role for frontal, striatal, and thalamic regions in operant learning. By integrating operant and functional neuroimaging methodologies, the present investigation examined brain activation to two types of discriminative stimuli correlated with different contingencies. Prior to neuroimaging, 10 adult human subjects completed operant discrimination training in which money was delivered following button pressing (press-money contingency) in the presence of one set of discriminative stimuli, and termination of trials followed not responding (no response-next trial contingency) in the presence of a second set of discriminative stimuli. After operant training, subjects were instructed to memorize a third set of control stimuli unassociated with contingencies. Several hours after training, functional magnetic resonance imaging was performed while subjects viewed discriminative and control stimuli that were presented individually for 1,500 ms per trial, with stimulus presentations occurring, on average, every 6 s. Activation was found in frontal and striatal brain regions to both sets of discriminative stimuli relative to control stimuli. In addition, exploratory analyses highlighted activation differences between discriminative stimuli. The results demonstrate the utility of coupling operant and imaging technologies for investigating the neural substrates of operant learning in humans.
REFERENCES
- Apicella, P., Ljungberg, T., Scarnati, E., & Schultz, W. (1991). Responses to reward in monkey dorsal and ventral striatum. Experimental Brain Research, 85, 491–500.
- Becerra, L., Brieter, H. C., Wise, R., Gonzalez, R. G., & Borsook, D. (2001). Reward circuitry activation by noxious thermal stimuli. Neuron, 32, 927–946.
- Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7–15.
- Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30, 619–639.
- Brett, M. (2002). Retrieved from http:www.mrc-cbu.cam.ac.ukImagingcommonmnispace.shtml.
- Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of Neurophysiology, 6, 3072–3077.
- Elliott, R., Friston, K. J., & Dolan, R. J. (2000). Dissociable neural responses in human reward systems. Journal of Neuroscience, 20, 6159–6165.
- Elliott, R., Newman, J., Longe, O., & Deakin, J. (2004). Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. Neurolmage, 21, 984–990.
- Friston, K. J., Ashburner, J., Frith, C. D., Poline, J. B., Heather, J. D., & Frackowiak, R. S. J. (1995). Spatial registration and normalization of images. Human Brain Mapping, 3, 165–189.
- Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. B., Frith, C. D., & Frackowiak, R. S. J. (1995). Statistical parametric maps in functional imaging: A general linear approach. Human Brain Mapping, 2, 189–210.
- Groenewegen, H. J., Wright, C. I., Beijer, A. V., & Voorn, P. (1999). Convergence and segregation of ventral striatal inputs and outputs. Annals of the New York Academy of Sciences, 877, 49–63.
- Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004). A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance imaging study of a stochastic decision task. Journal of Neuroscience, 24, 1660–1665.
- Hikosaka, O., Sakamoto, M., & Usui, S. (1989). Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. Journal of Neurophysiology, 61, 814–832.
-
Holmes, A. P., &
Friston, K. J. (1998). Generalisability, random effects and population inference.
NeuroImage, 7, S754.
10.1016/S1053-8119(18)31587-8 Google Scholar
- Horvitz, J. C. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience, 96, 651–656.
- Jackson, G. M., Jackson, S. R., Harrison, J., Henderson, L., & Kennard, C. (1995). Serial reaction time learning and Parkinson's disease: Evidence for a procedural learning deficit. Neuropsychologia, 33, 577–593.
- Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron, 40, 1251–1257.
- Kapur, S. (2003). Psychosis as a state of aberrant salience: A framework linking biology, phenomenology, and pharmacology in schizophrenia. American Journal of Psychiatry, 160, 13–23.
- Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998). Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neuroscience, 1, 411–416.
- Knopman, D., & Nissen, M. J. (1991). Procedural learning is impaired in Huntington's disease: Evidence from the serial reaction time task. Neuropsychologia, 29, 245–254.
- Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000). FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage, 12, 20–27.
- Lynd-Balta, E., & Haber, S. N. (1994). The organization of midbrain projections to the ventral striatum in the primate. Neuroscience, 59, 609–623.
- Maldjian, J. A., Laurienti, P. J., Burdette, J. H., & Kraft, R. A. (2003). An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. NeuroImage, 19, 1233–1239.
- O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nature Neuroscience, 4, 95–102.
- Ongur, D., & Price, J. L. (2000). Intrinsic and extrinsic connections of networks within the orbital and medial prefrontal cortex. Cerebral Cortex, 10, 206–219.
- Robbins, T. W., & Everitt, B. J. (1996). Neurobehavioural mechanisms of reward and motivation. Current Opinion in Neurobiology, 6, 228–236.
- Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E. J., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999). Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. The Journal of Neuroscience, 20, 9029–9038.
- Rogers, R. D., Ramnani, N., Mackay, C., Wilson, J. L., Jezzard, P., Carter, C. S., & Smith, S. M. (2004). Distinct portions of the anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biological Psychiatry, 55, 594–602.
- Schlund, M. (2002). Effects of acquired brain injury on adaptive choice and the role of reduced sensitivity to contingencies. Brain Injury, 16, 527–535.
- Schlund, M. W., & Pace, G. (2000). The effects of traumatic brain injury on reporting and responding to causal relations: An investigation of sensitivity to reinforcement contingencies. Brain Injury, 14, 573–583.
- Schultz, W., Tremblay, L., & Hollerman, J. R. (1998). Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology, 37, 421–429.
- Swenson, M., & Butters, N. (1996). Dissociations within nondeclarative memory in Huntington's disease. Neuropsychology, 10, 538–548.
- Talairach Daemon. (2003). Talairach Daemon Client Download. Retrieved from http:ric.uthscsa.eduprojectstalairachdaemon.html.
- Tremblay, L., & Schultz, W. (2000a). Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. Journal of Neurophysiology, 83, 1864–1876.
- Tremblay, L., & Schultz, W. (2000b). Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. Journal of Neurophysiology, 83, 1877–1885.
- Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004). Modulation of caudate activity by action contingency. Neuron, 41, 281–292.
- Wise, S. P., Murray, E. A., & Gerfew, C. R. (1996). The frontal cortex—basal ganglia system in primates. Critical Reviews in Neurobiology, 10, 317–356.
- Zald, D. H., & Pardo, J. V. (2002). The neural correlates of aversive auditory stimulation. NeuroImage, 16, 746–753.
- Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., & Berns, G. S. (2003). Human striatal response to salient nonrewarding stimuli. Journal of Neuroscience, 23, 8092–8097.
