THE ROLE OF DOPAMINE IN REINFORCEMENT: CHANGES IN REINFORCEMENT SENSITIVITY INDUCED BY D1-TYPE, D2-TYPE, AND NONSELECTIVE DOPAMINE RECEPTOR AGONISTS
Natalie A. Bratcher
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorCorresponding Author
Valeri Farmer-Dougan Ph.D.
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Department of Psychology 4620, Illinois State University, Normal, Illinois 61790-4620 (e-mail: [email protected]).Search for more papers by this authorJames D. Dougan
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Illinois Wesleyan University.
Search for more papers by this authorByron A. Heidenreich
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorPaul A. Garris
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorNatalie A. Bratcher
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorCorresponding Author
Valeri Farmer-Dougan Ph.D.
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Department of Psychology 4620, Illinois State University, Normal, Illinois 61790-4620 (e-mail: [email protected]).Search for more papers by this authorJames D. Dougan
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Illinois Wesleyan University.
Search for more papers by this authorByron A. Heidenreich
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorPaul A. Garris
ILLINOIS STATE UNIVERSITY AND ILLINOIS WESLEYAN UNIVERSITY
Illinois State University
Search for more papers by this authorAbstract
Dose-dependent changes in sensitivity to reinforcement were found when rats were treated with low, moderate, and high doses of the partial dopamine D1-type receptor agonist SKF38393 and with the nonselective dopamine agonist apomorphine, but did not change when rats were treated with similar doses of the selective dopamine D2-type receptor agonist quinpirole. Estimates of bias did not differ significantly across exposure to SKF38393 or quinpirole, but did change significantly at the high dose of apomorphine. Estimates of goodness of fit (r2) did not change significantly during quinpirole exposure. Poor goodness of fit was obtained for the high doses of SKF38393 and apomorphine. Decrements in absolute rates of responding were observed at the high dose of quinpirole and at the moderate and high doses of SKF38393 and apomorphine. Changes in r2 and absolute responding may be due to increases in stereotyped behavior during SKF38393 and apomorphine exposure that, in contrast to quinpirole, were distant from the response lever. The present data provide evidence that sensitivity to reward is affected more strongly by dopamine D1-like receptors rather than D2-like receptors, consistent with evidence from other studies investigating consummatory dopamine behavior and the tonic/phasic dopamine hypothesis.
REFERENCES
- Anderson, K. G., & Woolverton, W. L. (2000). Concurrent variable-interval drug self-administration and the generalized matching law: A drug-class comparison. Behavioural Pharmacology, 11, 413–420.
- Baum, W. M. (1974). On two types of deviations from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231–242.
- Belke, T. W., & Neubauer, J. (1997). A matching law analysis of the effect of amphetamine on responding reinforced by the opportunity to run. Psychological Record, 47, 483–498.
- Bindra, D. (1978). How adaptive behavior is produced: A perceptual-motivational alternative to response-reinforcement. Behavioral and Brain Sciences, 1, 41–91.
- Egli, M., Schaal, D. W., Thompson, T., & Clearly, J. (1992). Opiod-induced response rate decrements in pigeons responding under variable-interval schedules: Reinforcement mechanisms. Behavioural Pharmacology, 3, 581–591.
- Eilam, D., Clements, K. V., & Szechtman, H. (1991). Differential effects of D1 and D2 dopamine agonists on stereotyped locomotion in rats. Behavioural Brain Research, 45, 117–124.
- Eilam, D., Talangbayan, H., Canaran, G., & Szechtman, H. (1992). Dopaminergic control of locomotion, mouthing, snout contact, and grooming: Opposing roles of D-sub-1 and D-sub-2 receptors. Pharmacology, 106, 447–454.
- Farmer-Dougan, V. A., Dougan, J. D., Rokosik, S., Lewis, J., & Garris, P. A. (2004). Locomotion induced by non-contingent intracranial stimulation: Comparison to psychomotor stimulant. Behavioural Processes, 67, 245–261.
- Gao, B., & Cutler, M. G. (1993). Effects of quinpirole on the behaviour shown by mice in the light-dark box and during social interactions. Neuropharmacology, 32, 93–100.
- Garris, P. A., Kilpatrick, M., Bunin, M. A., Walker, Q. D., & Wightman, R. M. (1999). Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature, 398, 67–69.
- Heidenreich, B. A., Mailman, R. B., Nichols, D. E., & Napier, T. C. (1995). Partial and full dopamine D1 agonists produce comparable increases in ventral pallidal neuronal activity: Contribution of endogenous dopamine. Journal of Pharmacology and Experimental Therapeutics, 273, 516–525.
- Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267–272.
- Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–266.
- Ikemoto, S., & Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward seeking. Brain Research Reviews, 31, 6–41.
- Johansen, P. A., Hu, X. T., & White, F. J. (1991). Relationship between D1 dopamine receptors, adenylate cyclase, and the electrophysiological responses of rat nucleus accumbens neurons. Journal of Neural Transmission General Section, 86, 97–113.
- Katz, J. L., & Witkin, J. M. (1992). Effects of quinpirole and SKF38393 alone and in combination in squirrel monkeys trained to discriminate cocaine. Psychopharmacology, 107, 217–220.
- Kelley, A. E., Gauthier, A. M., & Lang, C. G. (1989). Amphetamine microinjections into distinct striatal sub regions cause dissociable effects on motor and ingestive behavior. Behavioural Brain Research, 35, 27–39.
- Kelley, A. E., & Stinus, L. (1985). Disappearance of hoarding behavior after 6-hyrdoxydopamine lesions of the mesolimbic dopamine neurons and its reinstatement with L-dopa. Behavioral Neuroscience, 99, 531–545.
- Kurylo, D. D. (2004). Effects of quinpirole on operant conditioning: Perseveration of behavioral components. Behavioural Brain Research, 155, 117–124.
- Martin, J. C., Dougan, J. D., Wu, Q., Stanisz, L. A., Martyn, S., Rokosik, S., Garris, P. A., & Farmer-Dougan, V. A. (2004). Locomotion induced by non-contingent intracranial electrical stimulation: Dopamine dependence and general characteristics. Behavioral Processes, 67, 131–146.
- Martinetti, M. P., Andrzejewski, M. E., Hineline, P. N., & Lewis, M. J. (2000). Ethanol consumption and the matching law: A choice analysis using a limited-access paradigm. Experimental and Clinical Psychopharmacology, 8, 395–403.
- McMillan, D. E., & Hardwick, W. C. (2000). Drug discrimination in rats under concurrent variable interval variable interval schedules. Journal of the Experimental Analysis of Behavior, 73, 103–120.
- McMillan, D. E., Li, M., & Snodgrass, S. H. (1998). Effects of drugs on concurrent variable interval schedule performance. Behavioral Pharmacology, 9, 663–670.
- Missale, C., Nash, S. R., Robinson, S. W., Jaber, M., & Caron, M. G. (1998). Dopamine receptors: From structure to function. Physiological Reviews, 78, 189–225.
- Phillips, P. E. M., Stuber, G. D., Helen, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature, 422, 614–618.
- Pitts, S. M., & Horvitz, J. C. (2000). Similar effects of D-sub-1/D-sub-2 receptor blockade on feeding and locomotor behavior. Pharmacology, Biochemistry and Behavior, 65, 433–438.
- Rebec, G. V., Christensen, J. R., Guerra, C., & Bardo, M. T. (1997). Regional and temporal differences in real-time dopamine efflux in the nucleus accumbens during free-choice novelty. Brain Research, 776, 61–67.
- Redgrave, P., Prescott, T. J., & Gurney, K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in Neuroscience, 22, 146–151.
- Salamone, J. D., Aberman, J. E., Sokolowski, J. D., & Cousins, M. S. (1999). Nucleus accumbens dopamine and rate of responding: Neurochemical and behavioral studies. Psychobiology, 27, 236–247.
- Salamone, J. D., Cousins, M. S., McCullough, L. D., Carriero, D. L., & Berkowitz, R. J. (1994). Nucleus accumbens dopamine release increases during instrumental lever pressing for food but not free food consumption. Pharmacology, Biochemistry & Behavior, 49, 25–31.
- Salamone, J. D., Cousins, M. S., & Snyder, B. J. (1997). Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis. Neuroscience and Biobehavioral Reviews, 21, 341–359.
- Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1–27.
- Schultz, W. (1999). The reward signal of midbrain dopamine neurons. News in Physiological Science, 14, 249–255.
- Schultz, W., Apicella, P., & Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience, 13, 900–913.
- Schultz, W., Dayan, P., & Montague, P. R. (1997, March 14). A neural substrate of prediction and reward. Science, 275, 1593–1599.
- Schultz, W., Romo, R., Ljungberg, T., Mirenowicz, J., Hollerman, J. R., & Dickinson, A. (1995). Reward-related signals carried by dopamine neurons. In J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 233–248). Cambridge, MA: The MIT Press.
- Schultz, W., Tremblay, L., & Hollerman, J. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10, 272–283.
- Sokolowski, J. D., & Salamone, J. D. (1998). The role of accumbens dopamine in lever pressing and response allocation: Effects of 6-OHDA injected into core and dorsomedial shell. Pharmacology, Biochemistry & Behavior, 59, 557–566.
- Spanagel, R., & Weiss, F. (1999). The dopamine hypothesis of reward: Past and current status. Trends in Neuroscience, 22, 521–527.
- Szechtman, H., Sulis, W., & Eilam, D. (1998). Quinpirole induces compulsive checking behavior in rats: A potential animal model of obsessive-compulsive disorder. Behavioral Neuroscience, 112, 1475–1485.
- Timberlake, W. (2001). Motivational modes in behavior systems. In R. R. Mowrer & B. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 155–209). Mahwah, NJ: Erlbaum.
- Tinsley, M. R., Rebec, G., & Timberlake, W. (2000). Facilitation of preparatory behavior: An artificial prey paradigm by D1-subfamily dopamine receptor activation. Behavioral Brain Research, 114, 23–30.
- Wachtel, S. R., Brooderson, R. J., & White, F. J. (1992). Parametric and pharmacological analyses of enhanced grooming response elicited by the D1 receptor agonist SKF38393 in the rat. Psychopharmacology, 109, 41–48.
- Woolverton, W. L., & Alling, K. (1999). Choice under concurrent VI schedules: Comparison of behavior maintained by cocaine or food. Psychopharmacology, 141, 47–56.