Hostname: page-component-745bb68f8f-lrblm Total loading time: 0 Render date: 2025-02-07T03:56:56.180Z Has data issue: false hasContentIssue false

Beyond perceptual judgment: Categorization and emotion shape what we see

Published online by Cambridge University Press:  05 January 2017

Steven B. Most*
Affiliation:
School of Psychology, UNSW, Australia, NSW 2052, Australia. s.most@unsw.edu.au

Abstract

By limiting their review largely to studies measuring perceptual judgment, Firestone & Scholl (F&S) overstate their case. Evidence from inattentional blindness and emotion-induced blindness suggests that categorization and emotion shape what we perceive in the first place, not just the qualities that we judge them to have. The role of attention in such cases is not easily dismissed as “peripheral.”

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2016 

Firestone & Scholl (F&S) parry recently resurgent suggestions that higher-order aspects of the mind – such as motivation, emotion, and categorization – alter perception, and they highlight several pitfalls endemic to such claims. Their paper is a valuable contribution to the literature.

However, in staking out territory beyond the bounds of early vision, F&S make the overly sweeping claim that no studies have provided evidence for top-down effects on “what we see as a whole visual processing and the conscious percepts it produces” (sect. 1.2, para. 2; emphasis theirs). A sweeping claim requires a sweeping survey of the literature, but unfortunately the authors largely limit their review to studies claiming that higher-order factors make things look closer, bigger, steeper, darker, or wider. In other words, they focus largely on studies that measure perceptual judgments.

What of studies that measure whether people see a stimulus at all?

The inattentional blindness and emotion-induced blindness literatures respectively suggest that categorization and emotion mold our ability to see things in the first place. Although the authors appear to dismiss such phenomena as “peripheral” effects of attention (sect. 4.5), attention guides perception at multiple points in visual processing, and it is likely incorrect to relegate its role only to the gating of input into early vision. (The authors vaguely concede that attention is not always so peripheral, but ultimately, they gloss over this point.) Evidence indeed suggests that these effects cannot be waved away as merely a result of peripheral selection (nor to memory, which the authors identify as another potential pitfall).

Inattentional blindness

The ability to see that something is present at all depends on more than where we direct our eyes. Nowhere is this more apparent than in the phenomenon of inattentional blindness: the failure to see obvious and salient stimuli that people look directly at while their attention is preoccupied (Mack & Rock Reference Mack and Rock1998; Most Reference Most2010; Most et al. Reference Most, Simons, Scholl, Jimenez, Clifford and Chabris2001; Reference Most, Chun, Widders and Zald2005a; Reference Most, Scholl, Clifford and Simons2005b; Simons & Chabris Reference Simons and Chabris1999).

Inattentional blindness experiments suggest that categorization shapes perception in ways that cannot be attributed to selection for visual input. In one study, participants either tracked four moving digits and ignored four moving letters or tracked the letters while ignoring the digits (Most Reference Most2013). When an unexpected E traveled across the screen, those tracking the letters were more likely to notice it than those tracking the digits, and this pattern reversed when the unexpected object was its mirror image, a block-letter 3. Because this effect was driven by the categorization of the unexpected object, it must have stemmed from selection after a degree of visual processing had already occurred. Evidence further suggests that the role of categorization in inattentional blindness is unlikely caused by confusions between the unexpected object and other members of the nontarget set (Koivisto & Revonsuo Reference Koivisto and Revonsuo2007). Nor do inattentional blindness effects appear to be wholly attributable to failures of memory (Ward & Scholl Reference Ward and Scholl2015).

Emotion-induced blindness

In emotion-induced blindness (EIB), people view rapid serial visual presentations of items and search for a single target within each stream. When the target is preceded by an emotionally powerful picture, people are unable to report the target (Most et al. Reference Most, Chun, Widders and Zald2005a).

At first glance, EIB seems like something that could fall within one of two categories of F&S's pitfalls. First, because emotional stimuli capture attention (MacLeod et al. Reference MacLeod, Mathews and Tata1986), attention could simply be too preoccupied to guide input of the target into the visual system (sect. 4.5). Second, it could be that EIB is more a phenomenon of memory than of perception (sect. 4.6), either because the measure is typically retrospective (people are usually asked to report the target at least half a second after its appearance; see Wolfe Reference Wolfe and Coltheart1999) or because it seems phenomenally related to the attentional blink, which itself has been attributed to failures to consolidate information into visual working memory (e.g., Chun & Potter Reference Chun and Potter1995). However, there are reasons to suspect that neither peripheral aspects of attention nor memory are accountable.

Specifically, in contrast to studies demonstrating that emotional stimuli capture attention to their location, in EIB target perception is worse at the location of the emotional distractor (e.g., Most & Wang Reference Most and Wang2011). This pattern has led to suggestions that emotional distractors compete for neural representation with targets that appear in the same receptive field (Wang et al. Reference Wang, Kennedy and Most2012; also see Keysers & Perrett Reference Keysers and Perrett2002), a suggestion consistent with findings that neural responses to targets and emotional distractors exhibit a trading relationship (Kennedy et al. Reference Kennedy, Rawding, Most and Hoffman2014). Because people tend to prioritize emotional information, it is the emotional distractors that win, an effect that seems to be modulated by mood (Most et al. Reference Most, Laurenceau, Graber, Belcher and Smith2010).

As with inattentional blindness, EIB appears to be a perceptual phenomenon rather than a memorial one. When participants were instructed to respond to targets immediately upon seeing them rather than at the end of each trial, the effect was undiminished (Kennedy & Most Reference Kennedy and Most2012). In addition, the spatially localized nature of the effect suggests that it arises from competition at a stage prior to consolidation into working memory.

In sum, F&S provide an incisive critique of the literature on top-down effects on perception. But they overstate their case when claiming that evidence for such effects is nonexistent. Surveying the literature on what people do or don't see rather than on their perceptual judgments reveals instances that don't easily fall within the categories of pitfall F&S outline. Of course, the authors may argue that such effects still fall outside the bounds of “perception,” strictly defined, and that they fall prey to other misconceptions about the relationship between perception and cognition. So far, however, while stating that perception extends beyond the computations involved in “early vision,” they have left the placement of the line between perception and cognition ambiguous. Good fences make good neighbors; as the target article's authors no doubt consider perception and cognition to be neighboring – if not encroaching – domains of the mind, it would be neighborly to provide a better map of where they think that fence stands.

References

Chun, M. M. & Potter, M. C. (1995) A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance 21(1):109–27.Google ScholarPubMed
Kennedy, B. L. & Most, S. B. (2012) Perceptual, not memorial, disruption underlies emotion-induced blindness. Emotion 12(2):199202.CrossRefGoogle Scholar
Kennedy, B. L., Rawding, J., Most, S. B. & Hoffman, J. E. (2014) Emotion-induced blindness reflects competition for early and late processing stages: An ERP study. Cognitive, Affective, and Behavioral Neuroscience 14:1485–98.CrossRefGoogle ScholarPubMed
Keysers, C. & Perrett, D. I. (2002) Visual masking and RSVP reveal neural competition. Trends in Cognitive Sciences 6:120–25.CrossRefGoogle ScholarPubMed
Koivisto, M. & Revonsuo, A. (2007) How meaning shapes seeing. Psychological Science 18:845–49.CrossRefGoogle ScholarPubMed
Mack, A. & Rock, I. (1998) Inattentional blindness. MIT Press.CrossRefGoogle Scholar
MacLeod, C., Mathews, A. & Tata, P. (1986) Attentional bias in emotional disorders. Journal of Abnormal Psychology 95(1):15.CrossRefGoogle ScholarPubMed
Most, S. B. (2010) What's “inattentional” about inattentional blindness? Consciousness and Cognition 19:1102–104.CrossRefGoogle ScholarPubMed
Most, S. B. (2013) Setting sights higher: Category-level attentional set modulates sustained inattentional blindness. Psychological Research 77:139–46.CrossRefGoogle ScholarPubMed
Most, S. B., Simons, D. J., Scholl, B. J., Jimenez, R., Clifford, E. & Chabris, C. F. (2001) How not to be seen: The contribution of similarity and selective ignoring to sustained inattentional blindness. Psychological Science 12(1):917.CrossRefGoogle ScholarPubMed
Most, S. B., Chun, M. M., Widders, D. M. & Zald, D. H. (2005a) Attentional rubbernecking: Cognitive control and personality in emotion-induced blindness. Psychonomic Bulletin and Review 12:654–61.CrossRefGoogle ScholarPubMed
Most, S. B., Laurenceau, J.-P., Graber, E., Belcher, A. & Smith, C. V. (2010) Blind jealousy: Romantic insecurity increases emotion-induced failures of visual perception. Emotion 10:250–56.CrossRefGoogle ScholarPubMed
Most, S. B., Scholl, B. J., Clifford, E. R. & Simons, D. J. (2005b) What you see is what you set: Sustained inattentional blindness and the capture of awareness. Psychological Review 112:217–42.CrossRefGoogle ScholarPubMed
Most, S. B. & Wang, L. (2011) Dissociating spatial attention and awareness in emotion-induced blindness. Psychological Science 22:300305.CrossRefGoogle ScholarPubMed
Simons, D. J. & Chabris, C. F. (1999) Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception 28:1059–74.CrossRefGoogle ScholarPubMed
Wang, L., Kennedy, B. L. & Most, S. B. (2012) When emotion blinds: A spatiotemporal competition account of emotion-induced blindness. Frontiers in Psychology: Special Topic on Emotion and Cognition 3:438.CrossRefGoogle ScholarPubMed
Ward, E. J. & Scholl, B. J. (2015) Inattentional blindness reflects limitations on perception, not memory: Evidence from repeated failures of awareness. Psychonomic Bulletin and Review 22:722–27.CrossRefGoogle Scholar
Wolfe, J. M. (1999) Inattentional amnesia. In: Fleeting memories: Cognition of brief visual stimuli, ed. Coltheart, V., pp. 7194. MIT Press.Google Scholar