Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-02-06T21:53:49.768Z Has data issue: false hasContentIssue false

Persisting through subjective effort: A key role for the anterior cingulate cortex?

Published online by Cambridge University Press:  04 December 2013

Kristin L. Hillman
Affiliation:
Department of Psychology, University of Otago, PO Box 56, Dunedin 9054, New Zealand. khillman@psy.otago.ac.nzhttp://www.otago.ac.nz/psychology/staff/kristinhillman.htmldbilkey@psy.otago.ac.nzhttp://www.otago.ac.nz/psychology/staff/davidbilkey.html
David K. Bilkey
Affiliation:
Department of Psychology, University of Otago, PO Box 56, Dunedin 9054, New Zealand. khillman@psy.otago.ac.nzhttp://www.otago.ac.nz/psychology/staff/kristinhillman.htmldbilkey@psy.otago.ac.nzhttp://www.otago.ac.nz/psychology/staff/davidbilkey.html

Abstract

One shortcoming of Kurzban et al.'s model is that it is not clear how animals persist through subjectively effortful tasks, particularly over a long time course. We suggest that the anterior cingulate cortex plays a critical role by encoding the utility of an action, and signalling where efforts should be best directed based on previous and prospected experience.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2013 

Kurzban et al.'s model aligns well with emerging metacognitive proposals of fatigue and effort, and provides a useful account of why task switching occurs. However, under many circumstances individuals continue to persist in a primary task where the immediate costs are considerable and where alternative options present significant benefits. As an example, in academia the tangible rewards of funding, publication, and tenure are far removed from the months of executive-function–demanding writing, research, and teaching required to reach these goals. The level of persistence needed in such scenarios is not well accounted for in the proposed model, which predicts that the large opportunity costs associated with long-term goals should prompt a high mental-effort signal and subsequent re-prioritization of behavior. So how do we sometimes “stay the course” in the face of subjective effort?

Several potential mechanisms could be involved in persistence. While the fatigue signal could be directly attenuated, say, by reward receipt, other mechanisms could operate upstream of this point. For example, the discounting of the primary goal that normally occurs under conditions of temporal distance, uncertainty, or exertion, could be attenuated during the cost/benefit evaluation. Alternatively, the degree of discounting of competing tasks could be increased. Kurzban et al. suggest that the key to task persistence involves attenuating the effort signal through reward, although they are not specific about the underlying brain mechanisms. Here we propose that activity in the anterior cingulate cortex (ACC) is critical, functioning to integrate cost/benefit ratios to provide a relative utility signal that may work directly to suppress subjective effort.

As the target article notes, as ACC activity decreases, so does task performance. One interpretation of this effect is that as long as activity in this region of the prefrontal cortex (PFC) remains high, vigilance and persistence are maintained. We and others have examined single-unit ACC activity during decision tasks and found that heightened firing appears to indicate a worthwhile course of action; however, a sufficiently strong signal may be required to drive pursuit and persistence (Amiez et al. Reference Amiez, Joseph and Procyk2005; Hillman & Bilkey Reference Hillman and Bilkey2010; Quilodran et al. Reference Quilodran, Rothe and Procyk2008; Sallet et al. Reference Sallet, Quilodran, Rothe, Vezoli, Joseph and Procyk2007; Shidara & Richmond Reference Shidara and Richmond2002). Importantly, this ACC signal appears only when significant cost/benefit analysis is required; furthermore, heightened firing does not always correspond to the most costly action, but rather seems to indicate the most worthwhile choice in terms of relative cost/benefit computed utility (Hillman & Bilkey Reference Hillman and Bilkey2010; Kennerley et al. Reference Kennerley, Walton, Behrens, Buckley and Rushworth2006; Rudebeck et al. Reference Rudebeck, Behrens, Kennerley, Baxter, Buckley, Walton and Rushworth2008). Moreover, the ACC is recruited regardless of the actual type of effort involved – be it physical exertion, competitive fighting, or mental taxation – suggesting that the region may be responding to generalized opportunity cost calculations inherent in cost/benefit decision tasks.

These encoding characteristics of ACC match the descriptions of several of the opportunity cost model components illustrated in Figure 1 of the target article: The ACC's experience-based encoding of cost/benefit computations provides an output signal that drives allocation of cognitive processes towards completion of tasks with optimal utility. Viewing the ACC in this way – as a dynamic utility encoder versus a cost encoder – represents a minor but important shift in thinking, one that could account for the persistence signal missing from the current model. Strong ACC signals could drive task persistence; however, as the ACC output signal wavers (“utility decreasing”), the phenomenology of effort begins, leading to reductions in persistence. Hence, the subjective experience of effort is, we propose, neither the result of the initial ACC recruitment nor the result of low levels of ACC activity, but rather, it results from a decrement in ACC activity from some prior, higher level. When tasks require cost/benefit computations, the ACC is recruited but subjective effort is usually not immediately reported. As a course of action is pursued, the expectation of high or imminent reward – which behaviorally serves to promote motivation and task engagement – also keeps ACC activity high (Croxson et al. Reference Croxson, Walton, O'Reilly, Behrens and Rushworth2009; Shidara & Richmond Reference Shidara and Richmond2002). However, if rewards are not anticipated (e.g., in randomized tasks or repetitive practice conditions), then ACC activity decreases (Raichle et al. Reference Raichle, Fiez, Videen, MacLeod, Pardo, Fox and Petersen1994; Shidara & Richmond Reference Shidara and Richmond2002), cingulate motor area activity increases (Shima & Tanji Reference Shima and Tanji1998) and task switching is likely to occur in response to the subjective effort experienced.

In our adaptation of the model, maintaining ACC activity at a high level is the key to persisting. We know that extrinsic incentives help ameliorate decrements in ACC activity over time; however, frequent tangible rewards are not always present in day-to-day life. What other mechanisms might work to maintain heightened ACC activity? We propose that experience also modifies ACC functionality over time such that in future tasks, higher ACC activity (and subsequent lateral PFC engagement) can be sustained in the absence of immediate rewards. This might be due to one of the mechanisms mentioned earlier – for example, reduced discounting of potential rewards available through the primary task or increased discounting of rewards associated with alternative actions – and ties into the learning process highlighted in the target article (sect. 3.3, para. 9). As one example of how this might occur, recent work has shown that individuals who are better able to visualize the future rewarded outcome of a choice tend to pursue long-term, over short-term, goals (Berns et al. Reference Berns, Laibson and Loewenstein2007; Boyer Reference Boyer2008). Thus, the discounting of reward value that normally occurs for temporally distant rewards is attenuated. Interestingly, scanning data indicate that that when this effect occurs, the hippocampus and PFC, including the ACC, co-activate in a coordinated manner (Benoit et al. Reference Benoit, Gilbert and Burgess2011; Peters & Buchel Reference Peters and Büchel2010). The exact nature of any communication that occurs between these regions is unclear, but it is possible that “future thinking” mediated through the hippocampus has a critical role. Future studies will help determine exactly how such systems enable us to persist in the face of subjective effort, further clarifying the neurophysiological framework that underlies the opportunity cost model.

References

Amiez, C., Joseph, J. P. & Procyk, E. (2005) Anterior cingulate error-related activity is modulated by predicted reward. European Journal of Neuroscience 21(12):3447–52.CrossRefGoogle ScholarPubMed
Benoit, R. G., Gilbert, S. J. & Burgess, P. W. (2011) A neural mechanism mediating the impact of episodic prospection on farsighted decisions. Journal of Neuroscience 31(18):6771–79.CrossRefGoogle ScholarPubMed
Berns, G. S., Laibson, D. & Loewenstein, G. (2007) Intertemporal choice – Toward an integrative framework. Trends in Cognitive Science 11(11):482–88.CrossRefGoogle ScholarPubMed
Boyer, P. (2008) Evolutionary economics of mental time travel? Trends in Cognitive Science 12(6):219–24.CrossRefGoogle ScholarPubMed
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. & Rushworth, M. F. (2009) Effort-based cost-benefit valuation and the human brain. Journal of Neuroscience 29(14):4531–41.CrossRefGoogle ScholarPubMed
Hillman, K. L. & Bilkey, D. K. (2010) Neurons in the rat anterior cingulate cortex dynamically encode cost-benefit in a spatial decision-making task. Journal of Neuroscience 30(22):7705–13.CrossRefGoogle Scholar
Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J. & Rushworth, M. F. (2006) Optimal decision making and the anterior cingulate cortex. Nature Neuroscience 9(7):940–47.CrossRefGoogle ScholarPubMed
Peters, J. & Büchel, C. (2010) Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66(1):138–48.CrossRefGoogle ScholarPubMed
Quilodran, R., Rothe, M. & Procyk, E. (2008) Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57(2):314–25.CrossRefGoogle ScholarPubMed
Raichle, M. E., Fiez, J. A., Videen, T. O., MacLeod, A. M., Pardo, J. V., Fox, P. T. & Petersen, S. E. (1994) Practice-related changes in human brain functional anatomy during nonmotor learning. Cerebral Cortex 4(1):826.CrossRefGoogle ScholarPubMed
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E. & Rushworth, F. S. (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. The Journal of Neuroscience 28(51):13775–85.CrossRefGoogle ScholarPubMed
Sallet, J., Quilodran, R., Rothe, M., Vezoli, J., Joseph, J. P. & Procyk, E. (2007) Expectations, gains, and losses in the anterior cingulate cortex. Cognitive Affective Behavioral Neuroscience 7(4):327–36.CrossRefGoogle ScholarPubMed
Shidara, M. & Richmond, B. J. (2002) Anterior cingulate: Single neuronal signals related to degree of reward expectancy. Science 296(5573):1709–11.CrossRefGoogle ScholarPubMed
Shima, K. & Tanji, J. (1998) Both supplementary and presupplementary motor areas are crucial for the temporal organization of multiple movements. Journal of Neurophysiology 80(6):3247–60.CrossRefGoogle ScholarPubMed