Hostname: page-component-745bb68f8f-grxwn Total loading time: 0 Render date: 2025-02-11T06:47:52.110Z Has data issue: false hasContentIssue false

What can the implicit social cognition literature teach us about implicit social cognition?

Published online by Cambridge University Press:  13 May 2022

Benedek Kurdi
Affiliation:
Department of Psychology, Yale University New Haven, CT 06511. benedek.kurdi@yale.edu; http://www.benedekkurdi.com yarrow.dunham@yale.edu; http://www.socialcogdev.com
Yarrow Dunham
Affiliation:
Department of Psychology, Yale University New Haven, CT 06511. benedek.kurdi@yale.edu; http://www.benedekkurdi.com yarrow.dunham@yale.edu; http://www.socialcogdev.com

Abstract

We highlight several sets of findings from the past decade elucidating the relationship between implicit social cognition and real-world inequality: Studies focusing on practical ramifications of implicit social cognition in applied contexts, the relationship between implicit social cognition and consequential real-world outcomes at the level of individuals and geographic units, and convergence between individual-level and corpus-based measures of implicit bias.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

The target article calls for “systematically dismantling” the “fundamentally flawed” practice of using implicit social cognition research to inform our understanding of real-world inequality. Sweeping conclusions and comprehensive recommendations of this kind, published in a leading journal of our discipline, should be supported by powerful arguments reflecting the latest state of the literature. Instead, the target article mischaracterizes the methods, goals, and state of implicit social cognition research while referencing a mere eight empirical papers, the most recent of which was published over a decade ago.

According to the target article, the “standard research cycle” begins with the observation that groups differ on some real-world outcome and has the goal of explaining, and eventually eliminating, such differences. This statement is misleadingly narrow. Not all memory research seeks to cure dementia; not all phonological awareness research tries to eradicate dyslexia; and not all auditory perception research contributes to the development of hearing aids. Similarly, much implicit social cognition research explores basic aspects of thought and behavior, including learning and representation (Kurdi & Dunham, Reference Kurdi and Dunham2020), social cognitive development (Dunham, Baron, & Banaji, Reference Dunham, Baron and Banaji2008), and cultural change (Charlesworth & Banaji, Reference Charlesworth and Banaji2019), without making any claim of immediate applicability to real-world problems. Thus, whether implicit social cognition research can explain real-world inequality should not be treated as its sole measure of success.

Of course, some of this literature does speak to real-world outcomes and behaviors. But here too the target article misses the mark. Specifically, according to the target article, researchers establish some experimental effect of social category knowledge in a small sample of naïve undergraduate participants in the lab and, without any further ado, conclude that the processes observed in the lab directly explain real-world disparities. In fact, as discussed below, much recent implicit social cognition research does not bear much resemblance to this description.

One relevant line of research has documented practical ramifications of basic implicit cognitive processes. For instance, transgender and cisgender children have been shown not to meaningfully differ from each other in implicit gender identity (Olson, Key, & Eaton, Reference Olson, Key and Eaton2015), thus providing a counterweight to prior claims of “psychological deviance.” In other cases, changes in implicit social cognition have been shown to track meaningful experiences in field settings: For example, exposure to female college professors in science, technology, engineering, and mathematics (STEM) fields can produce long-term effects on implicit gender stereotypes and self-concept (Dasgupta & Asgari, Reference Dasgupta and Asgari2004), implying that the social structures in which we are embedded shape the ways in which we envision our future possibilities.

Other research has investigated the relationship between implicit measures and ecologically meaningful measures of intergroup behavior (Kurdi et al., Reference Kurdi, Seitchik, Axt, Carroll, Karapetyan and Kaushik2019b). For example, implicit math–gender stereotypes predict actual academic achievement among high school students (Steffens, Jelenec, & Noack, Reference Steffens, Jelenec and Noack2010); implicit weight stereotypes predict actual callbacks of job applicants among human resources professionals (Agerström & Rooth, Reference Agerström and Rooth2011); managers' implicit competence stereotypes predict actual job performance of their minority employees (Glover, Pallais, & Pariente, Reference Glover, Pallais and Pariente2017); and doctors' implicit evaluations predict actual rapport, satisfaction, and treatment adherence among Black patients (Hagiwara et al., Reference Hagiwara, Penner, Gonzalez, Eggly, Dovidio and Gaertner2013; Penner et al., Reference Penner, Dovidio, Gonzalez, Albrecht, Chapman, Foster and Eggly2016, Reference Penner, Dovidio, West, Gaertner, Albrecht, Dailey and Markova2010).

Echoing an oft-repeated argument, the target article hastens to underscore that studies of predictive validity produce small correlations between implicit attitudes and intergroup behavior. The finding that the relationship between explicit attitudes and intergroup behavior is almost exactly the same size (Kurdi et al., Reference Kurdi, Seitchik, Axt, Carroll, Karapetyan and Kaushik2019b) receives no mention. What's more, the mean implicit–behavior correlation sits right around the 25th percentile of all effect sizes in social psychology, with the largest implicit–behavior correlations at the individual level approaching the 70th percentile of that distribution (Lovakov & Agadullina, Reference Lovakov and Agadullina2021).

Equally absent is any discussion of studies that investigate the association between implicit cognition and real-world inequality at the level of geographic units, which have produced large effects in multiple domains (Hehman, Calanchini, Flake, & Leitner, Reference Hehman, Calanchini, Flake and Leitner2019; Payne, Vuletich, & Lundberg, Reference Payne, Vuletich and Lundberg2017). For example, this work has demonstrated that regions with higher levels of implicit race bias are characterized by more frequent police killings of Black Americans (Hehman, Flake, & Calanchini, Reference Hehman, Flake and Calanchini2018), as well as more racial disparity in school disciplinary actions (Riddle & Sinclair, Reference Riddle and Sinclair2019) and upward mobility (Chetty, Hendren, Jones, & Porter, Reference Chetty, Hendren, Jones and Porter2020).

Finally, remarkable correspondence has also been found between individual-level conceptual associations indexed by implicit measures and cultural-level conceptual associations computationally derived from vast amounts of text produced spontaneously and outside any experimental setting (Caliskan & Lewis, Reference Caliskan and Lewis2020). Evidence for such alignment has been provided across different contexts, including a comprehensive examination of social group attitudes and stereotypes (Caliskan, Bryson, & Narayanan, Reference Caliskan, Bryson and Narayanan2017), the relationship between implicit beliefs and evaluations (Kurdi, Mann, Charlesworth, & Banaji, Reference Kurdi, Mann, Charlesworth and Banaji2019a), and the development of gender biases over the lifespan (Charlesworth, Yang, Mann, Kurdi, & Banaji, Reference Charlesworth, Yang, Mann, Kurdi and Banaji2021).

Little, if any, of the criticism formulated in the target article seems applicable to methodologically sound implicit social cognition research conducted over the past decade. Far from simply assuming a one-to-one correspondence between findings obtained with small undergraduate samples in artificial lab settings and real-world inequality, an increasingly large group of investigators have made serious efforts to establish connections between implicit measures of social cognition and group-based disparities. Specifically, all of the studies discussed above include at least one (but typically all) of the following elements: samples consisting of experts or members of the general public; real behaviors of consequence observed under ecologically realistic conditions; and the availability of ample individuating information during the decision-making process.

Implicit social cognition research has obviously not been immune to some of the same methodological missteps that have troubled much of psychology and the behavioral sciences over the past few decades. However, as should be clear based on even this brief review, there is considerable reason for optimism. Most importantly, further improvement and innovation won't be fueled by throwing out the baby with the bathwater. Instead, whether the goal is basic science or uncovering the antecedents, mechanisms, and consequences of real-world inequality, we urge renewed focus on theory building, study design, and statistical inference. And accurately characterizing the field that one critiques.

Financial support

This research received no specific grant from any funding agency, commercial, or not-for-profit sectors.

Conflict of interest

Benedek Kurdi is a member of the Scientific Advisory Board of Project Implicit, a 501(c)(3) non-profit organization and international collaborative of researchers who are interested in implicit social cognition.

References

Agerström, J., & Rooth, D.-O. (2011). The role of automatic obesity stereotypes in real hiring discrimination. Journal of Applied Psychology, 96(4), 790805. http://doi.org/10.1037/a0021594.CrossRefGoogle ScholarPubMed
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017). Semantics derived automatically from language corpora contain human-like biases. Science, 356(6334), 183186. http://doi.org/10.1126/science.aal4230.CrossRefGoogle ScholarPubMed
Caliskan, A., & Lewis, M. (2020). Social biases in word embeddings and their relation to human cognition. PsyArXiv. http://doi.org/10.31234/osf.io/d84kg.Google Scholar
Charlesworth, T. E. S., & Banaji, M. R. (2019). Patterns of implicit and explicit attitudes: I. Long-term change and stability from 2007 to 2016. Psychological Science, 30(2), 174192. http://doi.org/10.1177/0956797618813087.CrossRefGoogle ScholarPubMed
Charlesworth, T. E. S., Yang, V., Mann, T. C., Kurdi, B., & Banaji, M. R. (2021). Gender stereotypes in natural language: Word embeddings show robust consistency across child and adult language corpora of more than 65 million words. Psychological Science, Psychological Science, 32(2), 218–240. http://doi.org/10.1177/0956797620963619.CrossRefGoogle ScholarPubMed
Chetty, R., Hendren, N., Jones, M. R., & Porter, S. R. (2020). Race and economic opportunity in the United States: An intergenerational perspective. The Quarterly Journal of Economics, 135(2), 711783. http://doi.org/10.1093/qje/qjz042.CrossRefGoogle Scholar
Dasgupta, N., & Asgari, S. (2004). Seeing is believing: Exposure to counterstereotypic women leaders and its effect on the malleability of automatic gender stereotyping. Journal of Experimental Social Psychology, 40(5), 642658. http://doi.org/10.1016/j.jesp.2004.02.003.CrossRefGoogle Scholar
Dunham, Y., Baron, A. S., & Banaji, M. R. (2008). The development of implicit intergroup cognition. Trends in Cognitive Sciences, 12(7), 248253. http://doi.org/10.1016/j.tics.2008.04.006.CrossRefGoogle ScholarPubMed
Glover, D., Pallais, A., & Pariente, W. (2017). Discrimination as a self-fulfilling prophecy: Evidence from French grocery stores. The Quarterly Journal of Economics, 132(3), 12191260. http://doi.org/10.1093/qje/qjx006.CrossRefGoogle Scholar
Hagiwara, N., Penner, L. A., Gonzalez, R., Eggly, S., Dovidio, J. F., Gaertner, S. L. (2013). Racial attitudes, physician-patient talk time ratio, and adherence in racially discordant medical interactions. Social Science & Medicine, 87(C), 123131. http://doi.org/10.1016/j.socscimed.2013.03.016.CrossRefGoogle ScholarPubMed
Hehman, E., Calanchini, J., Flake, J. K., & Leitner, J. B. (2019). Establishing construct validity evidence for regional measures of explicit and implicit racial bias. Journal of Experimental Psychology: General, 148(6), 10221040. http://doi.org/10.1037/xge0000623.CrossRefGoogle ScholarPubMed
Hehman, E., Flake, J. K., & Calanchini, J. (2018). Disproportionate use of lethal force in policing is associated with regional racial biases of residents. Social Psychological and Personality Science, 9(4), 393401. http://doi.org/10.1177/1948550617711229.CrossRefGoogle Scholar
Kurdi, B., & Dunham, Y. (2020). Propositional accounts of implicit evaluation: Taking stock and looking ahead. Social Cognition, 38(Supplement), s42s67. http://doi.org/10.1521/soco.2020.38.supp.s42.CrossRefGoogle Scholar
Kurdi, B., Mann, T. C., Charlesworth, T. E. S., & Banaji, M. R. (2019a). The relationship between implicit intergroup attitudes and beliefs. Proceedings of the National Academy of Sciences, 21, 201820240–10. http://doi.org/10.1073/pnas.1820240116.Google Scholar
Kurdi, B., Seitchik, A. E., Axt, J. R., Carroll, T. J., Karapetyan, A., Kaushik, N. (2019b). Relationship between the implicit association test and intergroup behavior: A meta-analysis. American Psychologist, 74(5), 569586. http://doi.org/10.1037/amp0000364.CrossRefGoogle Scholar
Lovakov, A., & Agadullina, E. R. (2021). Empirically derived guidelines for effect size interpretation in social psychology. European Journal of Social Psychology, 51(3), 485–504. http://doi.org/10.1002/ejsp.2752.CrossRefGoogle Scholar
Olson, K. R., Key, A. C., & Eaton, N. R. (2015). Gender cognition in transgender children. Psychological Science, 26(4), 467474. http://doi.org/10.1177/0956797614568156.CrossRefGoogle ScholarPubMed
Payne, B. K., Vuletich, H. A., & Lundberg, K. B. (2017). The bias of crowds: How implicit bias bridges personal and systemic prejudice. Psychological Inquiry, 28(4), 233248. http://doi.org/10.1080/1047840X.2017.1335568.CrossRefGoogle Scholar
Penner, L. A., Dovidio, J. F., Gonzalez, R., Albrecht, T. L., Chapman, R., Foster, T.Eggly, S. (2016). The effects of oncologist implicit racial bias in racially discordant oncology interactions. Journal of Clinical Oncology, 34(24), 28742880. http://doi.org/10.1200/JCO.2015.66.3658.CrossRefGoogle ScholarPubMed
Penner, L. A., Dovidio, J. F., West, T. V., Gaertner, S. L., Albrecht, T. L., Dailey, R. K., & Markova, T. (2010). Aversive racism and medical interactions with black patients: A field study. Journal of Experimental Social Psychology, 46(2), 436440. http://doi.org/10.1016/j.jesp.2009.11.004.CrossRefGoogle ScholarPubMed
Riddle, T., & Sinclair, S. (2019). Racial disparities in school-based disciplinary actions are associated with county-level rates of racial bias. Proceedings of the National Academy of Sciences, 116(17), 82558260. http://doi.org/10.1073/pnas.1808307116.CrossRefGoogle ScholarPubMed
Steffens, M. C., Jelenec, P., & Noack, P. (2010). On the leaky math pipeline: Comparing implicit math–gender stereotypes and math withdrawal in female and male children and adolescents. Journal of Educational Psychology, 102(4), 947963. http://doi.org/10.1037/a0019920.CrossRefGoogle Scholar