Home LiteratureArticle Details
PMID: 17913879 Published · ppublish English Journal Article Research Support, N.I.H., Extramural

Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning.

Frank MJ, Moustafa AA, Haughey HM, Curran T, Hutchison KE

Abstract

What are the genetic and neural components that support adaptive learning from positive and negative outcomes? Here, we show with genetic analyses that three independent dopaminergic mechanisms contribute to reward and avoidance learning in humans. A polymorphism in the DARPP-32 gene, associated with striatal dopamine function, predicted relatively better probabilistic reward learning. Conversely, the C957T polymorphism of the DRD2 gene, associated with striatal D2 receptor function, predicted the degree to which participants learned to avoid choices that had been probabilistically associated with negative outcomes. The Val/Met polymorphism of the COMT gene, associated with prefrontal cortical dopamine function, predicted participants' ability to rapidly adapt behavior on a trial-to-trial basis. These findings support a neurocomputational dissociation between striatal and prefrontal dopaminergic mechanisms in reinforcement learning. Computational maximum likelihood analyses reveal independent gene effects on three reinforcement learning parameters that can explain the observed dissociations.

MeSH Terms
Adolescent Adult Algorithms Brain/physiology Catechol O-Methyltransferase/genetics Dopamine/genetics,physiology Dopamine and cAMP-Regulated Phosphoprotein 32/genetics Female Genetics, Behavioral Humans Male Models, Genetic Models, Psychological Polymorphism, Genetic Receptors, Dopamine D2/genetics Reinforcement, Psychology
Chemicals
Dopamine and cAMP-Regulated Phosphoprotein 32 PPP1R1B protein, human Receptors, Dopamine D2 Catechol O-Methyltransferase Dopamine
Authors & Affiliations
5 authors, click to expand affiliations / ORCID
Frank Michael J
Department of Psychology and Program in Neuroscience, University of Arizona, Tucson, AZ 85721, USA. [email protected]
Moustafa Ahmed A
Haughey Heather M
Curran Tim
Hutchison Kent E
References (44)
44 references, click to expand
  1. D1 and D2 dopamine receptors differentially regulate c-fos expression in striatonigral and striatopallidal neurons.
    Neuroscience. 1992 Jul;49(2):285-96 PMID: 1359451
  2. Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum.
    J Neurosci. 2006 Aug 23;26(34):8810-8 PMID: 16928870
  3. Cortical substrates for exploratory decisions in humans.
    Nature. 2006 Jun 15;441(7095):876-9 PMID: 16778890
  4. Reversal learning in Parkinson's disease depends on medication status and outcome valence.
    Neuropsychologia. 2006;44(10):1663-73 PMID: 16730032
  5. Representation of action-specific reward values in the striatum.
    Science. 2005 Nov 25;310(5752):1337-40 PMID: 16311337
  6. Individual differences in extraversion and dopamine genetics predict neural reward responses.
    Brain Res Cogn Brain Res. 2005 Dec;25(3):851-61 PMID: 16289773
  7. Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models.
    Nature. 2007 Feb 8;445(7128):643-7 PMID: 17287809
  8. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal.
    Psychol Rev. 2006 Apr;113(2):300-326 PMID: 16637763
  9. Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits.
    Psychol Sci. 2005 Dec;16(12):973-8 PMID: 16313662
  10. Midbrain dopamine neurons encode a quantitative reward prediction error signal.
    Neuron. 2005 Jul 7;47(1):129-41 PMID: 15996553
  11. Stimulus-specific plasticity of prefrontal cortex dopamine neurotransmission.
    J Neurochem. 2004 Mar;88(6):1327-34 PMID: 15009632
  12. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning.
    Eur J Neurosci. 2004 Jan;19(1):181-9 PMID: 14750976
  13. Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition.
    J Clin Invest. 2007 Mar;117(3):672-82 PMID: 17290303
  14. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.
    Psychol Rev. 1995 Jul;102(3):419-457 PMID: 7624455
  15. Collection of genomic DNA by buccal swabs for polymerase chain reaction-based biomarker assays.
    Environ Health Perspect. 1999 Jul;107(7):517-20 PMID: 10378997
  16. Chronic haloperidol promotes corticostriatal long-term potentiation by targeting dopamine D2L receptors.
    J Neurosci. 2004 Sep 22;24(38):8214-22 PMID: 15385604
  17. Different time courses of learning-related activity in the prefrontal cortex and striatum.
    Nature. 2005 Feb 24;433(7028):873-6 PMID: 15729344
  18. Catechol-o-methyltransferase inhibition improves set-shifting performance and elevates stimulated dopamine release in the rat prefrontal cortex.
    J Neurosci. 2004 Jun 9;24(23):5331-5 PMID: 15190105
  19. Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism.
    J Cogn Neurosci. 2005 Jan;17(1):51-72 PMID: 15701239
  20. Correlated coding of motivation and outcome of decision by dopamine neurons.
    J Neurosci. 2003 Oct 29;23(30):9913-23 PMID: 14586021
  21. Reciprocal changes in prefrontal and limbic dopamine responsiveness to aversive and rewarding stimuli after chronic mild stress: implications for the psychobiology of depression.
    Biol Psychiatry. 1999 Dec 15;46(12):1624-33 PMID: 10624543
  22. Dopamine and cAMP-regulated phosphoprotein 32 kDa controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity.
    J Neurosci. 2000 Nov 15;20(22):8443-51 PMID: 11069952
  23. Building neural representations of habits.
    Science. 1999 Nov 26;286(5445):1745-9 PMID: 10576743
  24. Beyond heritability: neurotransmitter genes differentially modulate visuospatial attention and working memory.
    Psychol Sci. 2005 Mar;16(3):200-7 PMID: 15733200
  25. Role of dopamine in the primate caudate nucleus in reward modulation of saccades.
    J Neurosci. 2006 May 17;26(20):5360-9 PMID: 16707788
  26. Error-related negativity predicts reinforcement learning and conflict biases.
    Neuron. 2005 Aug 18;47(4):495-501 PMID: 16102533
  27. Catechol-O-methyltransferase-deficient mice exhibit sexually dimorphic changes in catecholamine levels and behavior.
    Proc Natl Acad Sci U S A. 1998 Aug 18;95(17):9991-6 PMID: 9707588
  28. How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades.
    Neural Netw. 2004 May;17(4):471-510 PMID: 15109680
  29. Synonymous mutations in the human dopamine receptor D2 (DRD2) affect mRNA stability and synthesis of the receptor.
    Hum Mol Genet. 2003 Feb 1;12(3):205-16 PMID: 12554675
  30. Prefrontal cortex and flexible cognitive control: rules without symbols.
    Proc Natl Acad Sci U S A. 2005 May 17;102(20):7338-43 PMID: 15883365
  31. Effect of COMT Val108/158 Met genotype on frontal lobe function and risk for schizophrenia.
    Proc Natl Acad Sci U S A. 2001 Jun 5;98(12):6917-22 PMID: 11381111
  32. A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol.
    Behav Neurosci. 2006 Jun;120(3):497-517 PMID: 16768602
  33. An integrative theory of prefrontal cortex function.
    Annu Rev Neurosci. 2001;24:167-202 PMID: 11283309
  34. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.
    Nat Neurosci. 2005 Dec;8(12):1704-11 PMID: 16286932
  35. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction.
    Biol Psychiatry. 2007 Oct 1;62(7):756-64 PMID: 17300757
  36. A dopamine- and cyclic AMP-regulated phosphoprotein enriched in dopamine-innervated brain regions.
    Nature. 1983 Jan 6;301(5895):69-71 PMID: 6296685
  37. Computational perspectives on dopamine function in prefrontal cortex.
    Curr Opin Neurobiol. 2002 Apr;12(2):223-9 PMID: 12015241
  38. DARPP-32, a dopamine- and adenosine 3':5'-monophosphate-regulated phosphoprotein enriched in dopamine-innervated brain regions. III. Immunocytochemical localization.
    J Neurosci. 1984 Jan;4(1):111-24 PMID: 6319625
  39. By carrot or by stick: cognitive reinforcement learning in parkinsonism.
    Science. 2004 Dec 10;306(5703):1940-3 PMID: 15528409
  40. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex.
    J Neurophysiol. 2000 Mar;83(3):1733-50 PMID: 10712493
  41. Getting formal with dopamine and reward.
    Neuron. 2002 Oct 10;36(2):241-63 PMID: 12383780
  42. The classification of dopamine receptors: relationship to radioligand binding.
    Annu Rev Neurosci. 1983;6:43-71 PMID: 6220666
  43. The A1 allele of the human D2 dopamine receptor gene is associated with increased activity of striatal L-amino acid decarboxylase in healthy subjects.
    Pharmacogenet Genomics. 2005 Jun;15(6):387-91 PMID: 15900211
  44. Opponent interactions between serotonin and dopamine.
    Neural Netw. 2002 Jun-Jul;15(4-6):603-16 PMID: 12371515
Article Info
Journal
Proceedings of the National Academy of Sciences of the United States of America
Abbr.
Proc Natl Acad Sci U S A
ISSN
0027-8424
Published
2007-10-09
Epub
2007-00-03
Pages
16311-6
Language
English
Region
United States
NLM ID
7505876
PMCID
PMC2042203
Subset
IM
Grants
NIDA NIH HHS · R21 DA022630 · United States
NIAAA NIH HHS · R29 AA012238 · United States
NIAAA NIH HHS · R01 AA012238 · United States
NIAAA NIH HHS · AA012238 · United States
NIDA NIH HHS · DA022630 · United States
Analysis Services
Analysis Services

Contact

No. 2 Wenbo Road, Zhangqiu District, Jinan, Shandong

Qilu Normal University · Genelibs Bioinformatics Lab

750 Shunhua Rd, Jinan

2F, Bldg F, University Science Park

Tel: 0531-88819269

WeChat Official Account

Follow our WeChat subscription account for real-time updates and the latest in medical and biological research.


Business Email

E-mail: [email protected]