Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-02-05T03:06:27.325Z Has data issue: false hasContentIssue false

Adopt process-oriented models (if they're more useful)

Published online by Cambridge University Press:  31 January 2025

Brendan A. Schuetze*
Affiliation:
Department of Education Science, University of Potsdam, Potsdam, Germany brendan.schuetze@gmail.com https://schu.etze.co Department of Educational Psychology, University of Utah, Salt Lake City, UT, USA
Luke D. Rutten
Affiliation:
Department of Educational Psychology, The University of Texas at Austin, Austin, TX, USA luke_rutten@utexas.edu
*
*Corresponding author.

Abstract

Though we see the potential for benefits from the development of process-oriented approaches, we argue that it falls prey to many of the same critiques raised about the existing construct level of analysis. The construct-level approach will likely dominate motivation research until we develop computational models that are not only accurate, but also broadly usable.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2025. Published by Cambridge University Press

Tradeoffs between accuracy and parsimony are inherent in most scientific endeavors. Murayama and Jach (M&J) argue that contemporary motivation theories, which operate nearly exclusively at the construct level, are making the wrong tradeoffs between accuracy and parsimony. They challenge the idea that motivation constructs directly cause behavior. Instead, they argue (1) constructs are essentially epiphenomenal byproducts, and (2) process-oriented computational models are necessary to unpack mechanisms of motivated behavior and advance the field of motivation science.

We agree with the first premise. Motivation constructs are not literal causes of behavior; researchers will never find a need-for-competence dial in the brain (at least, not in the way that latent variable models assume). Rather, the need-for-competence and other motivational constructs act as labels that summarize patterns emerging from yet to be defined processes. M&J argue that the best path forward is to begin attempting to “unpack the black box” and define these processes. Their proposed solution of computational modeling, however, shares many of the same faults as the construct-level approach they critique; they simply trade one black box for another. Where construct-focused approaches assume a need-for-competence drives behavior, their exemplar knowledge acquisition model assumes an intrinsic-reward-for-knowledge drives behavior. Importantly, we could ask the same question of the reward-for-knowledge as M&J ask of the need-for-competence: What process creates this drive? As acknowledged by the authors themselves, their suggestion to move down a level of analysis does not solve the black-box problem. It merely changes the black boxes we use.

Because neither construct nor computational models address the black-box problem, we need an alternative way to evaluate between them. One might even argue that the black-box language obfuscates the real point: That the best measure of a model is its accuracy and that process-oriented models provide a way toward greater accuracy. We disagree with the former notion. The question of which level of mental process is best to model is not a question of “Which level is most accurate?” Of course, the answer to that will always be the next level down.

Rather, we believe it better to ask “Which level is most useful?” Given our background in applied psychology, and specifically our experiences training pre-service teachers, we know that one of the ultimate goals of motivation theory is to generate insights with practical importance for teachers, students, bosses, workers, and so on. These experiences have led us to adopt a more pragmatist philosophy of science, wherein a key feature of any worthwhile theory is that it can be used to make an impact (Elder-Vass, Reference Elder-Vass2022; James, Reference James and Delbanco1907/2001). History tells us this is where computational models struggle.

For example, educational researchers including Carroll (Reference Carroll1963) and Bloom (Reference Bloom1976) made a strong push for computational and process-oriented “models of school learning” in the mid-twentieth century (see also Bjork, Reference Bjork1973). However, those models were difficult to understand, even for researchers. Consequently, these theories received minimal adoption and faded in importance (Harnischfeger & Wiley, Reference Harnischfeger and Wiley1978). More recently, researchers in self-regulated learning – ourselves included (Schuetze, Reference Schuetze2024) – have put forth a number of non-construct-focused models based on discrepancy reduction (e.g., Ackerman, Reference Ackerman2014; Carver & Scheier, Reference Carver and Scheier1990; Thiede & Dunlosky, Reference Thiede and Dunlosky1999). Many researchers have testified to the benefits of building these sorts of models for the purpose of theory development (e.g., Aubé, Reference Aubé1997; Guest & Martin, Reference Guest and Martin2021; van Rooij & Blokpoel, Reference van Rooij and Blokpoel2020). However, due to their complexity and relatively narrow areas of focus, these process-oriented models have struggled to make the same impact on school systems and business leaders as construct-focused understandings of human behavior, such as self-efficacy and growth mindset.

Our contention here is that even if we create highly accurate theories of motivated behavior, if they are not usable or interpretable by those who are in positions to apply them, more needs to be done. Applied to M&J's proposal, we believe that computational models of motivation can be useful to the world at large – but this will require additional work. Part of this work may mean finding creative places to implement motivational theories, such as in intelligent tutors, where theoretical complexity is managed by a technical system, as opposed to by teachers or managers (Yan, Sana, & Carvalho, Reference Yan, Sana and Carvalho2024). Other parts of this work may mean creating a hierarchy of mutually compatible theories operating at different levels of analysis. Insights derived from lower levels can be distilled and moved up to higher (perhaps construct) levels that require less time and expertise to put into practice (Anderson, Reference Anderson2002; Donoghue & Horvath, Reference Donoghue and Horvath2016). In essence, the researcher's theory of motivation doesn't necessarily need to be the same as the practitioner's. Different groups can understand the same phenomenon in distinct levels of detail. Indeed, divisions of this sort help molecular biologists, pharmacists, and medical doctors create and administer medical treatments that work despite having very different levels of focus. Similarly, the average driver does not need to understand how their car's engine functions. The mechanic, however, must. Again, theories at different levels should aim not for the utmost accuracy, but for the utmost utility to those who are using it.

With this in mind, we find ourselves agreeing with M&J's second premise as well: That computational and process-oriented models can help us better understand motivation. Not because they help us solve the black-box problem, but because they show promise in helping us make more useful and applicable theories of motivated behavior. However, pitfalls accompany this promise, and they must be kept in mind. Given the history of computational modeling and the associated increases in time, effort, and expertise required to use these models, we believe that great care will be needed to translate them into practically applicable formats. Until we achieve broadly usable computational models, we cannot fault motivation researchers or practitioners for sticking to tried-and-true construct-oriented models. Pending that development, the construct level of analysis will continue to be the primary lever of change outside the lab.

Acknowledgement

The authors thank Veronica Yan for comments on a draft of this commentary.

Financial support

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Competing interests

None.

References

Ackerman, R. (2014). The diminishing criterion model for metacognitive regulation of time investment. Journal of Experimental Psychology: General, 143(3), 13491368. https://doi.org/10.1037/a0035098CrossRefGoogle ScholarPubMed
Anderson, J. R. (2002). Spanning seven orders of magnitude: A challenge for cognitive modeling. Cognitive Science, 26(1), 85112. https://doi.org/10.1207/s15516709cog2601_3CrossRefGoogle Scholar
Aubé, M. (1997). Toward computational models of motivation: A much needed foundation for social sciences and education. Journal of Artificial Intelligence in Learning, 8(1), 4375.Google Scholar
Bjork, R. A. (1973). Why mathematical models? American Psychologist, 28(5), 426433. https://doi.org/10.1037/h0034623CrossRefGoogle Scholar
Bloom, B. S. (1976). Human characteristics and school learning. McGraw-Hill.Google Scholar
Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64(8), 19. https://doi.org/10.1177/0161468163064008CrossRefGoogle Scholar
Carver, C. S., & Scheier, M. F. (1990). Origins and functions of positive and negative affect: A control-process view. Psychological Review, 97(1), 1935. https://doi.org/10.1037/0033-295X.97.1.19CrossRefGoogle Scholar
Donoghue, G. M., & Horvath, J. C. (2016). Translating neuroscience, psychology and education: An abstracted conceptual framework for the learning sciences. Cogent Education, 3(1), 1267422. https://doi.org/10.1080/2331186X.2016.1267422CrossRefGoogle Scholar
Elder-Vass, D. (2022). Pragmatism, critical realism and the study of value. Journal of Critical Realism, 21(3), 261287. https://doi.org/10.1080/14767430.2022.2049088CrossRefGoogle Scholar
Guest, O., & Martin, A. E. (2021). How computational modeling can force theory building in psychological science. Perspectives on Psychological Science, 16(4), 789802. https://doi.org/10.1177/1745691620970585CrossRefGoogle ScholarPubMed
Harnischfeger, A., & Wiley, D. E. (1978). Conceptual issues in models of school learning. Journal of Curriculum Studies, 10(3), 215231. https://doi.org/10.1080/0022027780100304CrossRefGoogle Scholar
James, W. (1907/2001). What pragmatism means. In Delbanco, A. (Ed.), Writing new England (pp. 8093). Harvard University Press. https://doi.org/10.4159/harvard.9780674335486.c18.Google Scholar
Schuetze, B. A. (2024). A computational model of school achievement. Educational Psychology Review, 36, 18. https://doi.org/10.1007/s10648-024-09853-6CrossRefGoogle Scholar
Thiede, K. W., & Dunlosky, J. (1999). Toward a general model of self-regulated study: An analysis of selection of items for study and self-paced study time. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25(4), 10241037. https://doi.org/10.1037/0278-7393.25.4.1024Google Scholar
van Rooij, I., & Blokpoel, M. (2020). Formalizing verbal theories: A tutorial by dialogue. Social Psychology, 51(5), 285298. https://doi.org/10.1027/1864-9335/a000428CrossRefGoogle Scholar
Yan, V. X., Sana, F., & Carvalho, P. F. (2024). No simple solutions to complex problems: Cognitive science principles can guide but not prescribe educational decisions. Policy Insights from the Behavioral and Brain Sciences, 11(1), 5966. https://doi.org/10.1177/23727322231218906CrossRefGoogle Scholar