Hostname: page-component-745bb68f8f-lrblm Total loading time: 0 Render date: 2025-02-12T00:48:12.273Z Has data issue: false hasContentIssue false

Attention and memory-driven effects in action studies

Published online by Cambridge University Press:  05 January 2017

Philip Tseng
Affiliation:
Institute of Humanities in Medicine, Taipei Medical University, Taipei City 11031, Taiwan. philip@tmu.edu.twhttp://medhuman1.tmu.edu.tw/philip/ Brain & Consciousness Research Center, Shuang-Ho Hospital, Taipei Medical University, New Taipei City 23561, Taiwan. timlane@tmu.edu.twhttp://chss.tmu.edu.tw/intro/super_pages.php?ID=intro3
Timothy Lane
Affiliation:
Institute of Humanities in Medicine, Taipei Medical University, Taipei City 11031, Taiwan. philip@tmu.edu.twhttp://medhuman1.tmu.edu.tw/philip/ Brain & Consciousness Research Center, Shuang-Ho Hospital, Taipei Medical University, New Taipei City 23561, Taiwan. timlane@tmu.edu.twhttp://chss.tmu.edu.tw/intro/super_pages.php?ID=intro3 Institute of European and American Studies, Academia Sinica, Taipei City 11529, Taiwan Research Center for Mind, Brain, and Learning, National Chengchi University, Taipei City 11605, Taiwan
Bruce Bridgeman
Affiliation:
Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA 95064. bruceb@ucsc.eduhttp://people.ucsc.edu/~bruceb/

Abstract

We provide empirical examples to conceptually clarify some items on Firestone & Scholl's (F&S's) checklist, and to explain perceptual effects from an attentional and memory perspective. We also note that action and embodied cognition studies seem to be most susceptible to misattributing attentional and memory effects as perceptual, and identify four characteristics unique to action studies and possibly responsible for misattributions.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2016 

Firestone & Scholl (F&S) make a strong case against the effect of top-down beliefs on perception. The argument for the cognitive impenetrability and modular nature of (visual) perception is reminiscent of the historic debate between Fodor and Turvey (Fodor & Pylyshyn Reference Fodor and Pylyshyn1981; Turvey et al. Reference Turvey, Shaw, Reed and Mace1981), especially when most of the top-down modulation literature can find its roots in Gibson's (Reference Gibson1966; Reference Gibson1979) ecological psychology. However, several aspects make F&S's article theoretically unique and important: (1) taking a logical approach such as with the El Greco fallacy, (2) speaking to a wider range of researchers beyond the action or embodied cognition literature, and (3) perhaps most important, providing a checklist of criteria for future studies against the six pitfalls they have cogently identified.

One common pitfall among studies that mistake top-down effects in judgment for perceptual effect is the use of subjective report in measuring percepts (e.g., light and darkness, reachability, distance). Not only is subjective report highly susceptible to task demand (e.g., Durgin et al. Reference Durgin, DeWald, Lechich, Li and Ontiveros2011a), but also it is problematic because it provides no additional information that would enable researchers to trace the source of the top-down effect. Accordingly, in order to dissociate perception and judgment, it is advisable to use performance-based measures that supply additional information (e.g., spatial, temporal), thereby making it possible to infer the stage of processing over which top-down cognition exerts its influence. One of our previous studies (Tseng & Bridgeman Reference Tseng and Bridgeman2011) demonstrates this point: To test whether hands near a visual stimulus would enhance processing of the stimulus (as opposed to hands far; see Tseng et al. Reference Tseng, Bridgeman and Juan2012 for a review), participants performed a forced-choice visual memory change detection task that provides accuracy and reaction time data, as opposed to subjective report. The rationale was that if hand proximity could really change the way visual stimuli are processed in a positive way, then hand proximity would predict enhanced visual processing, which would lead to better change detection performance. This would effectively rule out the judgment component; the participants cannot fake better performance.

Here it is important to clarify F&S's conceptual distinction between “perception and judgment”: The two are not mutually exclusive, nor do they exhaust all alternatives (e.g., attention). Therefore, even if the judgment factor is accounted for by performance-based measures, such a result would not necessarily guarantee an effect in perception, especially because the effects on attention – which can modulate perception – can often disguise themselves as effects on perception (F&S's “periphery effect of attention”). To revisit the example above, although it is tempting to conclude that perception was directly modulated by hand proximity, it is equally plausible that the effect stemmed from biased attention near the hands. Indeed, analyzing participants' hit rates region by region on the screen showed a shift of correct responses toward the right-hand side, suggesting that the effect was mediated by biased spatial attention, not visual perception. This conclusion not only reemphasizes the importance of having a performance-based measure that can be analyzed differently to provide additional information, but also it is consistent with Pitfall 5, “peripheral attentional effects” (sect. 4.5), on F&S's checklist. The same rationale is also true for Pitfall 6, “memory and recognition” (sect. 4.6), and we attacked this problem by turning a potential artifact into an independent variable. Throwing a marble into a hole makes the thrower judge the hole as bigger following success than failure, but only if the hole is obscured after throwing. If the hole remains visible, the effect disappears (Blaesi & Bridgeman Reference Blaesi and Bridgeman2015; Cooper et al. Reference Cooper, Sterling, Bacon and Bridgeman2012). The logic of this experiment is analogous to many efforts to demonstrate effects of action on perception, and it shows those results to affect memory, not perception. Modifying memory on the basis of experience is useful; modifying perception is not. Taken together, we recommend that future studies should consider Pitfalls 2, 5, and 6 together by controlling for judgment and memory effects and then moving on to tease apart the effects in perception versus attention.

Lastly, it is intriguing to us that a majority of the studies reporting top-down effects on perception are related to action (e.g., affordance, reachability). Might action studies be more susceptible to misattributing attentional or memory effects to perception? We speculate four possible reasons unique to the action literature for why this may be the case:

  1. 1. Universality: Due to motor action's depth in evolutionary time, action's effects on perception or attention are likely very widespread. This differs from the way in which ruminating about things, such as a sordid past, would make the room seem darker (e.g., Banerjee et al. Reference Banerjee, Chatterjee and Sinha2012; Meier et al. Reference Meier, Robinson, Crawford and Ahlvers2007). Because ruminations about the past involve parts of the cognitive economy that are evolutionarily recent, and because darkness metaphors of this type depend largely upon cultural interpretations that might be unique to humans, effects on perception are not as likely as actions and affordances.

  2. 2. Implicitness: Unlike certain, consciously accessible, top-down beliefs, information regarding action possibilities, or affordances, is often implicit properties that subjects may not be consciously aware of. Thus, the implicit nature of affordance information is assumed to be processed below consciousness threshold, and likely at the perceptual stage.

  3. 3. Well-established neurophysiology: The neuronal mechanisms for processing affordance or other action-relevant information (e.g., space, distance, graspability) have been well investigated in monkeys (e.g., Graziano & Botvinick Reference Graziano, Botvinick, Prinz and Hommel2002). Visual–tactile neurons in premotor and parietal cortices move their receptive fields with the hands instead of eyes, and they respond to objects that are within reach, even when “reachable” means “reachable with a tool.”

  4. 4. Perception–action loop: The idea of perception–action coupling has been important in ecological psychology, and still is today in the embodied cognition literature. We suspect an overly literal interpretation of the idea can sometimes mislead researchers to mistake attentional effects as perceptual.

In summary, the effect of action on perception or attention is clearly quite different from other types of top-down beliefs. Although it is unfortunate that most action studies have mistaken attentional effects as perceptual, one can at least see why these studies may be more vulnerable to an inclination towards perceptual interpretations. Therefore, we recommend researchers in the field of perception and action and embodied cognition to especially consider F&S's arguments in the context of action when making conclusions.

ACKNOWLEDGMENT

This work is partially supported by a Taipei Medical University R&D Start-up Grant provided to Lane, and by Taiwan Ministry of Science & Technology Grants (104-2420-H-038-001-MY3, 105-2811-H-038-001, 105-2410-H-038-004, and 105-2632-H-038-001) also provided to Lane. It is as well supported by several grants to Tseng from Taiwan's Ministry of Science and Technology (104-2410-H-038-013-MY3), Taipei Medical University (TMU104-AE1-B07), and Shuang-Ho Hospital (105TMU-SHH-20).

References

Banerjee, P., Chatterjee, P. & Sinha, J. (2012) Is it light or dark? Recalling moral behavior changes perception of brightness. Psychological Science 23:407409.CrossRefGoogle ScholarPubMed
Blaesi, S. & Bridgeman, B. (2015) Perceived difficulty of a motor task affects memory but not action. Attention, Perception, and Psychophysics 77(3):972–77.Google Scholar
Cooper, A. D., Sterling, C. P., Bacon, M. P. & Bridgeman, B. (2012) Does action affect perception or memory? Vision Research 62:235–40.Google Scholar
Durgin, F. H., DeWald, D., Lechich, S., Li, Z. & Ontiveros, Z. (2011a) Action and motivation: Measuring perception or strategies? Psychonomic Bulletin and Review 18(6):1077–82.CrossRefGoogle ScholarPubMed
Fodor, J. A. & Pylyshyn, Z. W. (1981) How direct is visual perception? Some reflections on Gibson's “ecological approach.Cognition 9(2):139–96.Google Scholar
Gibson, J. J. (1966) The senses considered as perceptual systems. Houghton Mifflin.Google Scholar
Gibson, J. J. (1979) The ecological approach to perception and action. Houghton Mifflin.Google Scholar
Graziano, M. S. A. & Botvinick, M. (2002) How the brain represents the body: Insights from neurophysiology and psychology. In: Common mechanisms in perception and action: Attention and performance XIX, ed. Prinz, W. & Hommel, B., pp. 136–57. Oxford University Press.Google Scholar
Meier, B. P., Robinson, M. D., Crawford, L. E. & Ahlvers, W. J. (2007) When “light” and “dark” thoughts become light and dark responses: Affect biases brightness judgments. Emotion 7(2):366–76. Available at: http://doi.org/10.1037/1528-3542.7.2.366.Google Scholar
Tseng, P. & Bridgeman, B. (2011) Improved change detection with nearby hands. Experimental Brain Research 209:257–69.CrossRefGoogle Scholar
Tseng, P., Bridgeman, B. & Juan, C. H. (2012) Take the matter into your own hands: A brief review of the effect of nearby-hands on visual processing. Vision Research 72:7477.Google Scholar
Turvey, M. T., Shaw, R. E., Reed, E. S. & Mace, W. M. (1981) Ecological laws of perceiving and acting: In reply to Fodor and Pylyshyn (1981). Cognition 9(3):237304.CrossRefGoogle ScholarPubMed