Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-02-11T02:22:47.508Z Has data issue: false hasContentIssue false

Uncovering cognitive constraints is the bottleneck in resource-rational analysis

Published online by Cambridge University Press:  11 March 2020

Cvetomir Dimov*
Affiliation:
Department of Psychology, Carnegie Mellon University, Pittsburgh, PA15213. cdimov@andrew.cmu.edu

Abstract

A major constraint in resource-rational analysis is cognitive resources. Yet, uncovering the nature of individual components of the human mind has progressed slowly, because even the simplest behavior is a function of most (if not all) of the mind. Accelerating our understanding of the mind's structure requires more efforts in developing cognitive architectures.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2020

Rational analysis has found multiple applications in generating behavioral predictions based on task structure (e.g., Oaksford & Chater Reference Oaksford and Chater1994; Sims et al. Reference Sims, Neth, Jacobs and Gray2013). Yet, the initial two uses of this method have demonstrated its potential for more. First, the rational analysis of memory (Anderson & Milson Reference Anderson and Milson1989; Anderson & Schooler Reference Anderson and Schooler1991) did not only predict behavior, but, in fact, developed a theory of that cognitive capacity. This theory has been successfully applied to many memory (e.g., Anderson et al. Reference Anderson, Bothell, Lebiere and Matessa1998; Schneider & Anderson Reference Schneider and Anderson2012) and decision-making tasks (e.g., Dimov & Link Reference Dimov and Link2017; Fechner et al. Reference Fechner, Pachur, Schooler, Mehlhorn, Battal, Volz and Borst2016). Second, the rational analysis of categorization (Anderson Reference Anderson1991) also achieved more than predict behavior: Keeping considerations of cognitive plausibility in mind, an algorithm was developed that sequentially assigns stimuli to categories. To summarize, in addition to predicting behavior, rational analysis can be used to develop theories of cognitive capacities given environmental constraints and, second, it also penetrates the algorithmic level when necessary to explain experimental data.

With their resource-rational analysis, Lieder and Griffiths extend rational analysis by including cognitive constraints into the optimization function. The viability and explanatory power of resource-rational analysis is well supported by many successful applications. However, many of these applications have one thing in common: They are relatively independent of the underlying cognitive capacities. Thus, one major constraint of resource-rational analysis – computational resources – is often avoided, in many cases reducing the approach to that of finding the optimal algorithm under task constraints – a procedure strikingly similar to rational analysis. The reason, also acknowledged by the authors themselves, is that measuring cognitive constraints has progressed slowly.

Behind this slow progress lies a fundamental difficulty in reverse-engineering the nature of the cognitive system's components. As argued by Newell (Reference Newell1990), each psychological experiment produces output that is the joint product of several cognitive processes. Consequently, data collected to advance our understanding of one cognitive process is marred with unexplained variance from several others, which renders determining the exact structure of the process under investigation problematic. To address this issue, Newell proposed iteratively developing and refining a model of the entire cognitive system – a unified theory of the mind – that provides a unified account of an ever-increasing number of psychological tasks. By jointly carving away unexplained variance from all components of the mind, such a theory would enable each subsequent experiment to ask more specific questions about the psychological process it investigates.

Newell's behest was followed by several cognitive architectures, the most developed among which is likely ACT-R (Anderson Reference Anderson2007). This architecture has incorporated the rational analysis of memory into the earlier ACT* (Anderson Reference Anderson1983), added the perceptual and motor processes, meticulously developed for the EPIC cognitive architecture (Meyer & Kieras Reference Meyer and Kieras1997a; Reference Meyer and Kieras1997b), and linked its components to regions in the brain (Anderson et al. Reference Anderson, Zhang, Borst and Walsh2016; Borst & Anderson Reference Borst and Anderson2017). Currently, it is able to account for behavior in hundreds of tasks in various fields, which include language learning and comprehension (Budiu & Anderson Reference Budiu and Anderson2004; Taatgen & Anderson Reference Taatgen and Anderson2002), decision making (Marewski & Schooler Reference Marewski and Schooler2011), driving (Salvucci & Taatgen Reference Salvucci and Taatgen2010), and many others (see http://act-r.psy.cmu.edu/publication/ for a list of publications categorized by field). This likely makes ACT-R the best source of cognitive constraints for resource-rational analysis.

Whether ACT-R is the cognitive theory of choice or not, Newell's arguments remain valid today: addressing the identifiability problem (Anderson Reference Anderson1990), the irrelevant specification problem (Newell Reference Newell1990), or the problem of amortization of theoretical constructs (Newell Reference Newell1990) is likely to be most successful with a unified theory of the mind that progressively incorporates multiple constraints from experiments, evolutionary arguments, and functional considerations. In my opinion, we should be devoting more efforts to develop such theories to accelerate our understanding of the mind as even the leader, ACT-R, despite its many successes, is still far from complete: It lacks theories of some fundamental components of the mind, such as emotions and tactile and other sensations, whereas many of the currently included components will likely be subjected to multiple refinements and extensions as this architecture is put to the test in new tasks.

Advancing a unified theory of the mind will naturally benefit approaches such as resource-relational analysis. Moreover, I believe that this approach might play a role in unveiling the structure of the mind similar to the role rational analysis played in developing a theory of memory. Specifically, if we maintain the assumption of optimality, we can ask under what cognitive and task constraints the empirically observed algorithms would be optimal, which could allow us to narrow down the plausible region in the space of possible computational resources. Such synergies between optimization approaches and cognitive architectures coupled with growing efforts in developing the latter will likely lead to considerable advancements in our understanding of human cognition and behavior.

References

Anderson, J. R. (1983) The architecture of cognition. Psychology Press.Google Scholar
Anderson, J. R. (1990) The adaptive character of thought. Psychology Press.Google Scholar
Anderson, J. R. (1991) The adaptive nature of human categorization. Psychological Review 98:409–29.CrossRefGoogle Scholar
Anderson, J. R. (2007) How can the human mind occur in the physical universe? Oxford University Press.CrossRefGoogle Scholar
Anderson, J. R., Bothell, D., Lebiere, C. & Matessa, M. (1998) An integrated theory of list memory. Journal of Memory and Language 38:341–80.CrossRefGoogle Scholar
Anderson, J. R. & Milson, R. (1989) Human memory: An adaptive perspective. Psychological Review 96(4):703–19. doi:10.1037/0033-295X.96.4.703.CrossRefGoogle Scholar
Anderson, J. R. & Schooler, L. J. (1991) Reflections of the environment in memory. Psychological Science 2(6):396408. doi:10.1111/j.1467-9280.1991.tb00174.x.CrossRefGoogle Scholar
Anderson, J. R., Zhang, Q., Borst, J. P. & Walsh, M. M. (2016) The discovery of processing stages: Extension of Sternberg's method. Psychological Review 123:481509.CrossRefGoogle ScholarPubMed
Borst, J. P. & Anderson, J. R. (2017) A step-by-step tutorial on using the cognitive architecture ACT-R in combination with fMRI data. Journal of Mathematical Psychology 76:94103.CrossRefGoogle Scholar
Budiu, R. & Anderson, J. R. (2004) Interpretation-based processing: A unified theory of semantic sentence comprehension. Cognitive Science 28:144.CrossRefGoogle Scholar
Dimov, C. M. & Link, D. (2017) Do people order cues by retrieval fluency when making probabilistic inferences? Journal of Behavioral Decision Making 30:843–54.CrossRefGoogle Scholar
Fechner, H. B., Pachur, T., Schooler, L. J., Mehlhorn, K., Battal, C., Volz, K. G. & Borst, J. P. (2016) Strategies for memory-based decision making: Modeling behavioral and neural signatures within a cognitive architecture. Cognition 157:7799.CrossRefGoogle ScholarPubMed
Marewski, J. N. & Schooler, L. J. (2011) Cognitive niches: An ecological model of strategy selection. Psychological Review 118:393437.CrossRefGoogle ScholarPubMed
Meyer, D. E. & Kieras, D. E. (1997a) A computational theory of executive cognitive processes and multiple-task performance: Part I. Basic mechanisms. Psychological Review 104(1):365. doi:10.1037/0033-295X.104.1.3.CrossRefGoogle Scholar
Meyer, D. E. & Kieras, D. E. (1997b) A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. Psychological Review 104(4):749–91. doi:10.1037//0033-295X.104.4.749.CrossRefGoogle Scholar
Newell, A. (1990) Unified theories of cognition. Harvard University Press.Google Scholar
Oaksford, M. & Chater, N. (1994) A rational analysis of the selection task as optimal data selection. Psychological Review 101(4):608–31. doi:10.1037/0033-295X.101.4.608.CrossRefGoogle Scholar
Salvucci, D. D. & Taatgen, N. A. (2010) The multitasking mind. Oxford University Press.Google Scholar
Schneider, D. W. & Anderson, J. R. (2012) Modeling fan effects on the time course of associative recognition. Cognitive Psychology 64:127–60.CrossRefGoogle ScholarPubMed
Sims, C. R., Neth, H., Jacobs, R. A. & Gray, W. D. (2013) Melioration as rational choice: Sequential decision making in uncertain environments. Psychological Review 120:139–54.CrossRefGoogle ScholarPubMed
Taatgen, N. A. & Anderson, J. R. (2002) Why do children learn to say “broke”? A model of learning the past tense without feedback. Cognition 86:123–55.CrossRefGoogle Scholar