Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-02-05T21:51:52.208Z Has data issue: false hasContentIssue false

The ins and outs of unpacking the black box: Understanding motivation using a multi-level approach

Published online by Cambridge University Press:  31 January 2025

F. Wurm
Affiliation:
Health, Medical & Neuropsychology, Leiden University, Leiden, The Netherlands f.r.wurm@fsw.leidenuniv.nl c.j.m.van.der.ham@fsw.leidenuniv.nl j.schomaker@fsw.leidenuniv.nl https://www.universiteitleiden.nl/en/staffmembers/franz-wurm#tab-1 https://www.universiteitleiden.nl/en/staffmembers/ineke-van-der-ham#tab-1 https://www.universiteitleiden.nl/en/staffmembers/judith-schomaker/publications#tab-1 Leiden Institute for Brain and Cognition, Leiden, The Netherlands
I. J. M. van der Ham
Affiliation:
Health, Medical & Neuropsychology, Leiden University, Leiden, The Netherlands f.r.wurm@fsw.leidenuniv.nl c.j.m.van.der.ham@fsw.leidenuniv.nl j.schomaker@fsw.leidenuniv.nl https://www.universiteitleiden.nl/en/staffmembers/franz-wurm#tab-1 https://www.universiteitleiden.nl/en/staffmembers/ineke-van-der-ham#tab-1 https://www.universiteitleiden.nl/en/staffmembers/judith-schomaker/publications#tab-1 Leiden Institute for Brain and Cognition, Leiden, The Netherlands
J. Schomaker*
Affiliation:
Health, Medical & Neuropsychology, Leiden University, Leiden, The Netherlands f.r.wurm@fsw.leidenuniv.nl c.j.m.van.der.ham@fsw.leidenuniv.nl j.schomaker@fsw.leidenuniv.nl https://www.universiteitleiden.nl/en/staffmembers/franz-wurm#tab-1 https://www.universiteitleiden.nl/en/staffmembers/ineke-van-der-ham#tab-1 https://www.universiteitleiden.nl/en/staffmembers/judith-schomaker/publications#tab-1 Leiden Institute for Brain and Cognition, Leiden, The Netherlands
*
*Corresponding author.

Abstract

Although higher-level constructs often fail to explain the mechanisms underlying motivation, we argue that purely mechanistic approaches have limitations. Lower-level neural data help us identify “biologically plausible” mechanisms, while higher-level constructs are critical to formulate measurable behavioral outcomes when constructing computational models. Therefore, we propose that a multi-level, multi-measure approach is required to fully unpack the black box of motivated behavior.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2025. Published by Cambridge University Press

Murayama and Jach (M&J) suggest that high-level constructs of motivation are often used to explain behavioral findings, but that the use of this abstract terminology jeopardizes our understanding of the actual mechanisms underlying these effects. The authors suggest that we should unpack the black box and look at motivated behavior as the outcome of mental computational processes. We agree that computational models are paramount for our understanding of motivation and other cognitive processes. However, we believe that a focus restricted to the mechanistic aspects is too limited, and that such a narrow focus poses a threat to (theoretical) advancements in the broader field of cognitive (neuro)science. Here, we identify crucial limitations of a purely mechanistic approach and propose ways to reconcile these.

We will discuss the limitations of the approach put forward by M&J by relying on a level-of-analysis approach (e.g., Bechtel & Richardson, Reference Bechtel and Richardson2010; Marr & Poggio, Reference Marr and Poggio1976; Sun, Reference Sun2009). Notably, we will follow Marr's (Reference Marr1982) framework for explaining complex information processing systems that involves three levels of explanation, suggesting that we need all three levels to gain a comprehensive understanding. These levels include: (1) A computational level addressing what the system does (i.e., what is the goal of the system), (2) the algorithmic level, relating to how the system achieves this, and (3) the implementation level relates to the physical realization. Although Marr formulated this framework in the context of visual processing, these levels have been applied over and above the originally intended domain. For example, the theory of reinforcement learning (RL) has been termed the “poster child” of Marr's framework as it spans all three levels from the computational goal of reward maximization to multiple algorithmic solutions and robust neural implementations in the brain (e.g., Niv & Langdon, Reference Niv and Langdon2016).

Following the rationale of a level-of-analysis approach, M&J criticize that current research on motivation is overly concerned with high-level computational accounts, while neglecting the algorithmic realization (i.e., “mental computational processes”). In line with Marr, we want to highlight the importance of describing a complex information system on all three levels to attain a comprehensive and complete understanding of how such a system works. Naturally, this also includes the implementation level.

One missing link in the proposed approach by M&J is the biological plausibility of the proposed mechanisms. Although claims of biological plausibility are often (rightly) labeled as “empty” and “inconsistent” (e.g., Love, Reference Love2021), we use the term to emphasize the need to test any proposed mechanisms against reality using appropriate behavioral and neural measures. Instead of limiting ourselves to just one level, a multi-level and multi-measure approach is required to provide a full perspective in order to not send us astray. We agree that if your aim is to mimic problem solving or mimic behavior – for example, as a computer scientist or robotics engineer – a purely algorithmic approach may be fruitful, as implementation can be achieved in various ways. However, as cognitive neuroscientists, we are actually strongly concerned with the exact implementation and neural mechanisms underlying cognitive, affective, and behavioral functions. Therefore, we must be careful in selecting computational models (Mars, Shea, Kolling, & Rushworth, Reference Mars, Shea, Kolling and Rushworth2012; Nassar & Frank, Reference Nassar and Frank2016; Nassar & Gold, Reference Nassar and Gold2013).

Noteworthily, an important method in our toolkit to support claims about cognitive functions is the falsification of computational models by testing specific predictions and identifying evidence that contradicts them (Palminteri, Wyart, & Koechlin, Reference Palminteri, Wyart and Koechlin2017). With algorithmic accounts of high-level concepts on the rise (e.g., Brielmann & Dayan, Reference Brielmann and Dayan2022; Gershman & Cikara, Reference Gershman and Cikara2021; Shenhav et al., Reference Shenhav, Musslick, Lieder, Kool, Griffiths, Cohen and Botvinick2017) we propose such a falsification approach on the implementation to be extremely important. Again, the theory of RL provides a poignant example of where a purely mechanistic approach revealed its limitations. First, the representation of value is a central aspect in most RL models. Based on a plethora of model-driven neuroimaging studies, it was concluded that specific neurons or brain regions implement value-based RL algorithms. However, more recent and scrutinizing investigations suggest that behavioral and neural patterns are better explained by so-called policy-based RL algorithms (Hayden & Niv, Reference Hayden and Niv2021). The difference between these algorithms may seem subtle but has strong implications for theoretical accounts. Second, recent work even challenges the implementation of RL in the brain as such and proposes a model that can explain dopaminergic activity more readily (Jeong et al., Reference Jeong, Taylor, Floeder, Lohmann, Mihalas, Wu and Namboodiri2022). This demonstrates that in order to make progress in the field of cognitive neuroscience, there is a necessity to link mechanistic algorithms to neural substrates, or else we may be explaining behavior, while failing to understand how the brain implements the solutions.

M&J acknowledge that other levels of explanation have merit, but they do not provide a framework on how to bridge and integrate these levels. We propose that for a mechanistic approach to be valuable, our models need be tested against empirical data. High-level constructs can act as tools to shape our thinking, to communicate our ideas to others, and define relevant input and output measures for our algorithms. Consistent with the suggestion of the authors, behavioral data are a first important step from high-level concepts to low-level mechanisms. However, we should not stop there and continue to evaluate algorithms in light of neural measures. To reconcile the limitations of a purely mechanistic approach, we propose a multi-level, multi-measure approach. Lower-level information can help us identify “biologically plausible” models, and higher-level constructs can help us formulate measurable behavioral and neural outcomes when constructing computational models.

Financial support

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Competing interest

None.

References

Bechtel, W., & Richardson, R. C. (2010). Discovering complexity: Decomposition and localization as strategies in scientific research. MIT Press.CrossRefGoogle Scholar
Brielmann, A. A., & Dayan, P. (2022). A computational model of aesthetic value. Psychological Review, 129(6), 13191337. https://doi.org/10.1037/rev0000337CrossRefGoogle ScholarPubMed
Gershman, S. J., & Cikara, M. (2021). Structure learning principles of stereotype change. PsyArXiv, 2(1954), 127. https://psyarxiv.com/52f9c/Google Scholar
Hayden, B. Y., & Niv, Y. (2021). The case against economic values in the orbitofrontal cortex (or anywhere else in the brain). Behavioral Neuroscience, 135(2), 192201. https://doi.org/10.1037/bne0000448CrossRefGoogle ScholarPubMed
Jeong, H., Taylor, A., Floeder, J. R., Lohmann, M., Mihalas, S., Wu, B., … Namboodiri, V. M. K. (2022). Mesolimbic dopamine release conveys causal associations. Science, 378(6626), eabq6740. https://doi.org/10.1126/science.abq6740CrossRefGoogle ScholarPubMed
Love, B. C. (2021). Levels of biological plausibility: Levels. Philosophical Transactions of the Royal Society B: Biological Sciences, 376(1815), 02. https://doi.org/10.1098/rstb.2019.0632CrossRefGoogle ScholarPubMed
Marr, D. (1982). Vision: A computational approach. Freeman & Co.Google Scholar
Marr, D. C., & Poggio, T. (1976). From understanding computation to understanding neural circuitry. Massachusetts Institute of Technology, A.I. Memo 357.Google Scholar
Mars, R. B., Shea, N. J., Kolling, N., & Rushworth, M. F. (2012). Model-based analyses: Promises, pitfalls, and example applications to the study of cognitive control. Quarterly Journal of Experimental Psychology, 65(2), 252267. https://doi.org/10.1080/17470211003668272CrossRefGoogle Scholar
Nassar, M. R., & Frank, M. J. (2016). Taming the beast: Extracting generalizable knowledge from computational models of cognition. Current Opinion in Behavioral Sciences, 11, 4954. https://doi.org/10.1016/j.cobeha.2016.04.003CrossRefGoogle ScholarPubMed
Nassar, M. R., & Gold, J. I. (2013). A healthy fear of the unknown: Perspectives on the interpretation of parameter fits from computational models in neuroscience. PLoS Computational Biology, 9(4), 16. https://doi.org/10.1371/journal.pcbi.1003015CrossRefGoogle ScholarPubMed
Niv, Y., & Langdon, A. J. (2016). Reinforcement learning with Marr. Current Opinion in Behavioral Sciences, 11(3), 6773. https://doi.org/10.1016/j.cobeha.2016.04.005CrossRefGoogle ScholarPubMed
Palminteri, S., Wyart, V., & Koechlin, E. (2017). The importance of falsification in computational cognitive modeling. Trends in Cognitive Sciences, 21(6), 425433. https://doi.org/10.1016/j.tics.2017.03.011CrossRefGoogle ScholarPubMed
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017). Toward a rational and mechanistic account of mental effort. Annual Review of Neuroscience, 40(1), 99124. https://doi.org/10.1146/annurev-neuro-072116-031526CrossRefGoogle Scholar
Sun, R. (2009). Theoretical status of computational cognitive modeling. Cognitive Systems Research, 10(2), 124140. https://doi.org/10.1016/j.cogsys.2008.07.002CrossRefGoogle Scholar