Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-02-06T22:52:57.977Z Has data issue: false hasContentIssue false

Beyond dopamine: The noradrenergic system and mental effort

Published online by Cambridge University Press:  04 December 2013

Nicholas J. Malecek
Affiliation:
Imaging Research Center, University of Texas at Austin, Austin, TX 78712. malecek@utexas.edupoldrack@utexas.eduwww.poldracklab.org
Russell A. Poldrack
Affiliation:
Imaging Research Center, University of Texas at Austin, Austin, TX 78712. malecek@utexas.edupoldrack@utexas.eduwww.poldracklab.org

Abstract

An opportunity cost model of effort requires flexible integration of valuation and self-control systems. Reciprocal connections between these networks and brainstem neuromodulatory systems are likely to provide the signals that affect subsequent persistence or failure when faced with effort challenges. The interaction of these systems should be taken into account to strengthen a normative neural model of effort.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2013 

Understanding how individuals respond to mental challenges and why mental effort evokes fatigue and aversion remains a challenge for cognitive science. In the 1960s, attentional resource theories were proposed to account for dual-task interference and linked resources to physiology through the use of measures such as pupillometry (Kahneman & Beatty Reference Kahneman and Beatty1966). These theories fell into disfavor in the 1980s when recognized as largely circular and unable to provide testable hypotheses (Navon Reference Navon1984). Although resource theories continued to play a role in applied psychology (e.g., Wickens Reference Wickens, Parasuraman and Davies1984), cognitive researchers focused on structural explanations for dual-task interference (e.g., Pashler Reference Pashler1994) and largely ignored the subjective aspects of mental effort. At the same time, social psychologists began to develop resource theories to describe “ego depletion” effects on self-control, which ultimately led to the notion that glucose serves as a physical resource for mental effort (Baumeister et al. Reference Baumeister, Bratslavsky, Muraven and Tice1998). However, the physical-resource theory has also turned out to be problematic (Kurzban Reference Kurzban2010a).

Kurzban et al.'s account of subjective effort as an adaptive signal of the opportunity cost of using limited executive control mechanisms offers a new way forward for understanding the psychological and neural mechanisms underlying mental effort. Importantly, the framework proposed in their account does not require depletion of a single resource (physical or attentional) to explain performance declines and subjective effort. The conflicting evidence for a single physical resource, most notably glucose, and consistent neurophysiological evidence for estimation of value and cost in prefrontal networks makes an opportunity cost model of effort particularly compelling. A critical challenge for this account of effort is to formally express how signals for value and cost interact, particularly in choosing to adaptively persist or withdraw effortful behavior. While Kurzban et al. focus on the role of dopamine, we propose that a successful normative account of effort persistence and aversion will require consideration of other brainstem neurotransmitter systems.

Recent proposals of the function of brainstem neurotransmitter systems advocate for their role in signaling useful decision variables. Leading examples include Niv's (Reference Niv2007) proposal that tonic dopamine in the striatum signals average reward rate and Yu and Dayan's (Reference Yu and Dayan2005) proposal that norepinephrine and acetylcholine signal different estimates of uncertainty. Behavioral and neural evidence supports the ability of interconnected brainstem nuclei and executive structures to influence decision-making processes (Aston-Jones & Cohen Reference Aston-Jones and Cohen2005; Kurniawan et al. Reference Kurniawan, Guitart-Masip and Dolan2011). In particular, the pattern of activity and connections of the locus coeruleus-norepinephrine (LC-NE) system suggests a causal role in effortful behavior (Aston-Jones & Cohen Reference Aston-Jones and Cohen2005).

An organism that utilizes an opportunity cost model of effort expenditure requires the ability to rapidly adjust task engagement in response to information from the environment and internal homeostasis monitors. The locus coeruleus (LC) receives input from the anterior cingulate cortex and orbital frontal cortex, structures implicated in the evaluation of cost/benefit trade-offs and valuation, as well as arousal-related inputs from the autonomic nervous system (Aston-Jones & Cohen Reference Aston-Jones and Cohen2005). Additionally, human and animal studies demonstrate that prefrontal networks are sensitive to norepinephrine concentration (Robbins & Arnsten Reference Robbins and Arnsten2009), with optimal levels necessary for successful task performance. This literature advocates for continuous feedback between the LC and cortical structures estimating the utility of maintaining the current effort-allocation policy. Critically, top-down cortical signals and peripheral autonomic input may shift the activity of the LC-NE system in a temporally relevant manner (Aston-Jones & Cohen Reference Aston-Jones and Cohen2005). For example, projections from the anterior cingulate cortex may shift the firing rate of the noradrenergic neuron population, in turn altering the level of norepinephrine in the cortex, which decreases stability of the current effort policy and promotes disengagement and selection of a new action plan (Aston-Jones & Cohen Reference Aston-Jones and Cohen2005; Sara & Bouret Reference Sara and Bouret2012).

A system that adaptively shifts among action contingencies, as proposed in prominent theories of LC-NE system function, is central to an opportunity cost model of effort. Theories of LC-NE function broadly conceptualize its activity as shifting the balance of exploratory versus exploitative behavior or mediating a global signal to reset brain networks involved in action selection (Aston-Jones & Cohen; Sara & Bouret Reference Sara and Bouret2012). Examining LC-NE system activity in humans is difficult, due to the small size of the nucleus, its brainstem location and the feasibility of assessing cortical levels of norepinephrine in vivo. However, several functional neuroimaging studies have described patterns of activity in LC. An early study described patterns of activation in a putative LC region and right lateralized prefrontal regions that appear to respond parametrically to task difficulty (Raizada & Poldrack, Reference Raizada and Poldrack2007). Although consistent with a connection between LC and lateral prefrontal self-control networks, the study lacked the spatial specificity necessary to attribute a specific role to the LC. A subsequent study claimed to pharmacologically modulate LC activity (Minzenberg et al. Reference Minzenberg, Watrous, Yoon, Ursu and Carter2008) but faced similar scrutiny about the precision of LC localization (Astafiev et al. Reference Astafiev, Snyder, Shulman and Corbetta2010). Recently, a group applied improved brainstem spatial alignment to conclude that activity in LC correlates with unexpected uncertainty in a decision-making task (Payzan-LeNestour et al. Reference Payzan-LeNestour, Dunne, Bossaerts and O'Doherty2013), consistent with a theoretical model (Yu & Dayan Reference Yu and Dayan2005).

Assessing the LC-NE system in humans remains a challenge, but recent studies point to a possible alternative solution. Several groups have demonstrated the utility of peripheral neurophysiological measurements, notably changes in pupil diameter, as an index of LC-NE system activity. As classically described by Kahneman (Reference Kahneman1973) and revived by Jepma and Nieuwenhuis (Reference Jepma and Nieuwenhuis2011), Nassar et al. (Reference Nassar, Rumsey, Wilson, Parikh, Heasly and Gold2012), Eldar et al. (Reference Eldar, Cohen and Niv2013) and others, changes in pupil size appear linked to the noradrenergic arousal system and related to decision variables such as novelty and uncertainty that are useful for a system estimating opportunity costs to control effort-allocation policy. As Kurzban and colleagues note, a normative account of effort will benefit from unification of executive and self-control literature. We propose that validation of peripheral measurements of LC-NE activity and their integration with effortful tasks constitutes a worthwhile approach to test Kurzban et al.'s opportunity cost model. Evaluation of LC-NE activity in effort contingency, trade-off, and performance tasks will provide key evidence to support or refute particular mechanisms by which valuation and control systems interact to shift behavior in accordance with an opportunity cost model. Together with parallel investigations of other neuromodulatory systems, this work will provide the quantitative framework that a normative model of effort requires.

References

Astafiev, S. V., Snyder, A. Z., Shulman, G. L. & Corbetta, M. (2010) Comment on “Modafinil shifts human locus coeruleus to low-tonic, high-phasic activity during functional MRI” and “Homeostatic sleep pressure and responses to sustained attention in the suprachiasmatic area.” Science 328(5976):309.CrossRefGoogle Scholar
Aston-Jones, G. & Cohen, J. D. (2005) An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience 28:403–50.Google Scholar
Baumeister, R. F., Bratslavsky, E., Muraven, M. & Tice, D. M. (1998) Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology 74(5):1252–65. doi:10.1037/0022-3514.74.5.1252.Google Scholar
Eldar, E., Cohen, J.D., & Niv, Y. (2013) The effects of neural gain on attention and learning. Nature Neuroscience 16: 1146–53.CrossRefGoogle ScholarPubMed
Jepma, M. & Nieuwenhuis, S. (2011) Pupil diameter predicts changes in the exploration-exploitation trade-off: Evidence for the adaptive gain theory. Journal of Cognitive Neuroscience 23(7):1587–96.CrossRefGoogle ScholarPubMed
Kahneman, D. (1973) Attention and effort. Prentice-Hall.Google Scholar
Kahneman, D. & Beatty, J. (1966) Pupil diameter and load on memory. Science 154(3756):1583–85.Google Scholar
Kurniawan, I. T., Guitart-Masip, M. & Dolan, R. J. (2011) Dopamine and effort-based decision making. Frontiers in Neuroscience 5:81.Google Scholar
Kurzban, R. (2010a) Does the brain consume additional glucose during self-control tasks? Evolutionary Psychology 8(2):244–59.Google Scholar
Minzenberg, M. J., Watrous, A. J., Yoon, J. H., Ursu, S. & Carter, C. S. (2008) Modafinil shifts human locus coeruleus to low-tonic, high-phasic activity during functional MRI. Science 322(5908):1700–702.Google Scholar
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B. & Gold, J. I. (2012) Rational regulation of learning dynamics by pupil-linked arousal systems. Nature Neuroscience 15:1040–46.Google Scholar
Navon, D. (1984) Resources – A theoretical soup stone? Psychological Review 91(2):216–34.Google Scholar
Niv, Y. (2007) Cost, benefit, tonic, phasic: What do response rates tell us about dopamine and motivation? Annals of the New York Academy of Sciences 1104:357–76.Google Scholar
Pashler, H. (1994) Dual task interference in simple tasks: Data and theory. Psychological Bulletin 116:220–44.Google Scholar
Payzan-LeNestour, E., Dunne, S., Bossaerts, P. & O'Doherty, J.P. (2013) The neural representation of unexpected uncertainty during value-based decision making. Neuron 79(1):191201.Google Scholar
Raizada, R. D. S. & Poldrack, R. A. (2007) Challenge-driven attention: Interacting frontal and brainstem systems. Frontiers in Human Neuroscience 1:3.Google Scholar
Robbins, T. W. & Arnsten, A. F. T. (2009) The neuropsychopharmacology of fronto-executive function: Monoaminergic modulation. Annual Review of Neuroscience 32(1):267–87.Google Scholar
Sara, S. J. & Bouret, S. (2012) Orienting and reorienting: The locus coeruleus mediates cognition through arousal. Neuron 76(1):130–41.Google Scholar
Wickens, C. D. (1984) Processing resources in attention. In: Varieties of attention, ed. Parasuraman, R. & Davies, D. R., pp. 63102. Academic Press.Google Scholar
Yu, A. J. & Dayan, P. (2005) Uncertainty, neuromodulation, and attention. Neuron 46(4):681–92.Google Scholar