Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-02-06T07:44:07.912Z Has data issue: false hasContentIssue false

The role of generalizability in moral and political psychology

Published online by Cambridge University Press:  10 February 2022

Elizabeth A. Harris
Affiliation:
Department of Psychology, New York University, New York, NY10003, USAeah561@nyu.edu; cer493@nyu.edu; jay.vanbavel@nyu.edu
Philip Pärnamets
Affiliation:
Department of Clinical Neuroscience, Karolinska Institutet, Stockholm7165, Swedenphilip.parnamets@ki.se
William J. Brady
Affiliation:
Department of Psychology, Yale University, New Haven, CT06250, USAwilliam.brady@yale.edu
Claire E. Robertson
Affiliation:
Department of Psychology, New York University, New York, NY10003, USAeah561@nyu.edu; cer493@nyu.edu; jay.vanbavel@nyu.edu
Jay J. Van Bavel
Affiliation:
Department of Psychology, New York University, New York, NY10003, USAeah561@nyu.edu; cer493@nyu.edu; jay.vanbavel@nyu.edu

Abstract

The aim of the social and behavioral sciences is to understand human behavior across a wide array of contexts. Our theories often make sweeping claims about human nature, assuming that our ancestors or offspring will be prone to the same biases and preferences. Yet we gloss over the fact that our research is often based in a single temporal context with a limited set of stimuli. Political and moral psychology are domains in which the context and stimuli are likely to matter a great deal (Van Bavel, Mende-Siedlecki, Brady, & Reinero, 2016). In response to Yarkoni (see BBS issue), we delve into topics related to political and moral psychology that likely depend on features of the research. These topics include understanding differences between liberals and conservatives, when people are willing to sacrifice someone to save others, the behavior of political leaders, and the dynamics of intergroup conflict.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

The aim of the social and behavioral sciences is to understand human behavior across a wide array of contexts. Our theories often make sweeping claims about human nature, assuming that our ancestors or offspring will be prone to the same biases and preferences. Yet we gloss over the fact that our research is often based on a single temporal context with a limited set of stimuli. Political and moral psychology are domains in which the context and stimuli are likely to matter a great deal (Brandt & Wagemans, Reference Brandt and Wagemans2017; Van Bavel et al., Reference Van Bavel, Mende-Siedlecki, Brady and Reinero2016). Understand differences between liberals and conservatives, when people are willing to sacrifice someone to save others, the behavior of political leaders, and the dynamics of intergroup conflict, all likely depend on the features of the research.

One of the major challenges of political psychology is understanding the generalizability of stimuli (see Yarkoni, this issue). Political psychologists often make broad claims about the differences (or lack thereof) between conservatives and liberals. However, the field's findings can vary widely depending on the specific stimuli used (e.g., topics, policies, etc.). Whether American Democrats or Republicans, for example, report higher belief superiority depends on the political issue researchers asked about (Toner, Leary, Asher, & Jongman-Sereno, Reference Toner, Leary, Asher and Jongman-Sereno2013). Scientists can therefore select different issues to show, alternatively, that people on the left or right of the political spectrum are more prone to a sense of superiority about their beliefs. It is only when looking across multiple topics that the overall quadratic relationship emerges (Harris & Van Bavel, Reference Harris and Van Bavel2021), suggesting the people on both ends of the spectrum are similarly prone to feelings of superiority when their attitudes are extreme.

This issue of non-generalizable stimuli extends to research on moral psychology as well. For instance, the victims of harm are often described using vague terminology, such as five nondescript workers on a track about to be run over by a trolley. In many studies, the victims are genderless, raceless, etc. (Hester & Gray, Reference Hester and Gray2020), which makes it difficult to generalize the findings to more vivid or real-world judgments (FeldmanHall et al., Reference FeldmanHall, Mobbs, Evans, Hiscox, Navrady and Dalgleish2012). Yet the research suggests that moral judgments are heavily influenced by contextual information and stimuli.

Another often-overlooked aspect of generalizability in both political and moral psychology is the changing temporal dynamics. Historical evidence demonstrates that core concepts studied by political psychologists, such as partisanship and polarization, are changing across time (Abramowitz & Webster, Reference Abramowitz and Webster2016; Baldassarri & Gelman, Reference Baldassarri and Gelman2008; Bartels, Reference Bartels2000; Kozlowski & Murphy, Reference Kozlowski and Murphy2020). Furthermore, the stimuli used to study these phenomena often include specific policies or politicians who are well known at a given time and elicit a host of associations related to that period of time.

Temporal factors occurring “outside the lab” may also influence the interactions between moral and political psychology. For instance, “political elites” in the United States use more moral language when their party is not in power (Wang & Inbar, Reference Wang and Inbar2020), demonstrating the changing nature of moral language usage due to external (and typically unacknowledged) factors (see Brady, Wills, Burkart, Jost, & Van Bavel, Reference Brady, Wills, Burkart, Jost and Van Bavel2019). Similarly, moral language changes over time (cf. Wheeler, McGrath, & Haslam, Reference Wheeler, McGrath and Haslam2019). The question of temporal generalizability is a foundational question of the historical versus lawlike nature of psychological findings (Gergen, Reference Gergen1973). A critical next step in psychological research must be examining whether trends related to political or moral reasoning are robust across time.

It is also important to avoid the assumption that reactions to political and moral stimuli in one cultural context reveal insights into individuals in another cultural context. For example, claims about growing rates of political polarization are often made based on US samples, with participants embedded within a two-party political system (Finkel et al., Reference Finkel, Bail, Cikara, Ditto, IIyengar, Klar and Druckman2020). Recent evidence suggests that other countries show varying trajectories of political polarization likely based on context-specific characteristics of their political system (Boxell, Gentzkow, & Shapiro, Reference Boxell, Gentzkow and Shapiro2020). Future work should include international samples or else constrain their claims to reflect the current sample.

In moral psychology, foundational research on moral intuitions largely ignored the prospect of cultural variation. For example, dual-processing theories developed by studying trolley problem dilemmas exclusively used evidence from WEIRD [western, educated, industrialized, rich, and democratic] samples (Greene, Sommerville, Nystrom, Darley, & Cohen, Reference Greene, Sommerville, Nystrom, Darley and Cohen2001), yet recent cross-cultural work demonstrates that participants' intuitions about trolly problem dilemmas are notably different in eastern cultures (Rehman & Dzionek-Kozłowska, Reference Rehman and Dzionek-Kozłowska2020) and non-industrialized cultures (Sorokowski, Marczak, Misiak, & Białek, Reference Sorokowski, Marczak, Misiak and Białek2020). Moral and political psychologists should be aware of the type of evidence required to make claims of strong or weak universality (Norenzayan & Heine, Reference Norenzayan and Heine2005), and make explicit reference to cultural generalizability when drawing broad conclusions from a small number of studies or restricted samples (Bago et al., Reference Bago, Aczel, Kekecs, Protzko, Kovacs, Nagy and Dutra2021).

Moral and political psychology face major generalizability challenges with regard to the content of research materials, temporal variability, and cultural differences. To address these challenges, part of the solution involves methodological and analytic changes (target article by Yarkoni). While important, these changes alone cannot fully address questions of generalizability. Here we join many recent observers in calling for better theory development and employment of formal tools to make more precise theoretical claims (Guest & Martin, Reference Guest and Martin2020; Muthukrishna & Henrich, Reference Muthukrishna and Henrich2019; van Rooij & Baggio, Reference van Rooij and Baggio2021). Improved theory will not only help close the distance between theoretical claims and empirical tests, but guide and facilitate interdisciplinary research. The latter may be particularly important in moral and political psychology, as its subject matter clearly intersects with explanatory efforts in many adjacent disciplines.

One hope is that, with changes to our empirical and theoretical practices, future researchers will be better placed to assess the generalizability of research in moral and political psychology. One potential future for this work is for researchers to organize themselves not only in cross-disciplinary and cross-cultural consortia but also cross-temporally. This would mean planning for research projects to investigate fundamental questions over longer time periods that span entire grant cycles or even individual careers. Conducting research with more diverse samples of participants and stimuli, across social and political contexts, will provide an exciting foundation for the future of the field.

Financial support

This publication was made possible through the support of: John Templeton Foundation (#61378; PP and JVB), Swedish Research Council (2016-06793; PP), and the Social Science and Humanities Research Council of Canada (752-2018-0213; EH).

Conflict of interest

None.

References

Abramowitz, A. I., & Webster, S. (2016). The rise of negative partisanship and the nationalization of US elections in the 21st century. Electoral Studies, 41, 1222. https://doi.org/10.1016/J.ELECTSTUD.2015.11.001.CrossRefGoogle Scholar
Bago, B., Aczel, B., Kekecs, Z., Protzko, J., Kovacs, M., Nagy, T., … Dutra, N. B. (2021). Moral thinking across the world: Exploring the influence of personal force and intention in moral dilemma judgments. https://doi.org/10.31234/osf.io/9uaqm.CrossRefGoogle Scholar
Baldassarri, D., & Gelman, A. (2008). Partisans without constraint: Political polarization and trends in American public opinion. American Journal of Sociology, 114(2), 408446. https://dx.doi.org/10.2139%2Fssrn.1010098.CrossRefGoogle ScholarPubMed
Bartels, L. M. (2000). Partisanship and voting behavior, 1952–1996. American Journal of Political Science, 44(1), 3550.CrossRefGoogle Scholar
Boxell, L., Gentzkow, M., & Shapiro, J. M. (2020). Cross-country trends in affective polarization (No. w26669). National Bureau of Economic Research. http://www.nber.org/papers/w26669.CrossRefGoogle Scholar
Brady, W. J., Wills, J. A., Burkart, D., Jost, J. T., & Van Bavel, J. J. (2019). An ideological asymmetry in the diffusion of moralized content on social media among political leaders. Journal of Experimental Psychology: General, 148(10), 18021813. https://doi.org/10.1037/xge0000532.CrossRefGoogle ScholarPubMed
Brandt, M. J., & Wagemans, F. (2017). From the political here and now to generalizable knowledge. Translational Issues in Psychological Science, 3(3), 317320. https://doi.org/10.1037/tps0000126.CrossRefGoogle Scholar
FeldmanHall, O., Mobbs, D., Evans, D., Hiscox, L., Navrady, L., & Dalgleish, T. (2012). What we say and what we do: The relationship between real and hypothetical moral choices. Cognition, 123(3), 434441. http://dx.doi.org/10.1016/j.cognition.2012.02.001.CrossRefGoogle ScholarPubMed
Finkel, E. J., Bail, C. A., Cikara, M., Ditto, P. H., IIyengar, S., Klar, S., … Druckman, J. N. (2020). Political sectarianism in America: A poisonous cocktail of othering, aversion, and moralization. Science, 370(6516), 533536. https://doi.org/10.1126/SCIENCE.ABE1715.CrossRefGoogle Scholar
Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26(2), 309320. https://doi.org/10.1037/h0034436.CrossRefGoogle Scholar
Greene, J. D., Sommerville, R. B., Nystrom, L. E., Darley, J. M., & Cohen, J. D. (2001). An fMRI investigation of emotional engagement in moral judgment. Science, 293(5537), 21052108. https://doi.org/10.1126/science.1062872.CrossRefGoogle ScholarPubMed
Guest, O., & Martin, A. E. (2020). How computational modeling can force theory building in psychological science. https://doi.org/10.31234/osf.io/rybh9.CrossRefGoogle Scholar
Harris, E. A., & Van Bavel, J. J. (2021). Preregistered replication of “feeling superior is a bipartisan issue: Extremity (not direction) of political views predicts perceived belief superiority.” Psychological Science, 32(3), 451458. https://doi.org/10.1177/0956797620968792.CrossRefGoogle Scholar
Hester, N., & Gray, K. (2020). The moral psychology of raceless, genderless strangers. Perspectives on Psychological Science, 15(2), 216230. https://doi.org/10.1177%2F1745691619885840.CrossRefGoogle ScholarPubMed
Kozlowski, A. C., & Murphy, J. P. (2020). Issue alignment and partisanship in the American public: Revisiting the ‘partisans without constraint’ thesis. Social Science Research, 94, Article 102498.Google ScholarPubMed
Muthukrishna, M., & Henrich, J. (2019). A problem in theory. Nature Human Behaviour, 3(3), 221229. https://doi.org/10.1038/s41562-018-0522-1.CrossRefGoogle ScholarPubMed
Norenzayan, A., & Heine, S. J. (2005). Psychological universals: What are they and how can we know? Psychological Bulletin, 131(5), 763784. https://psycnet.apa.org/doi/10.1037/0033-2909.131.5.763.CrossRefGoogle ScholarPubMed
Rehman, S., & Dzionek-Kozłowska, J. (2020). The Chinese and American students and the trolley problem: A cross-cultural study. Journal of Intercultural Communication, 20(2), 3141.Google Scholar
Sorokowski, P., Marczak, M., Misiak, M., & Białek, M. (2020). Trolley dilemma in Papua. Yali horticulturalists refuse to pull the lever. Psychonomic Bulletin & Review, 27, 398403. https://doi.org/10.3758/s13423-019-01700-y.CrossRefGoogle ScholarPubMed
Toner, K., Leary, M. R., Asher, M. W., & Jongman-Sereno, K. P. (2013). Feeling superior is a bipartisan issue: Extremity (not direction) of political views predicts perceived belief superiority. Psychological Science, 24(12), 24542462. https://doi.org/10.1177/0956797613494848.CrossRefGoogle ScholarPubMed
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016). Contextual sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences, 113(23), 64546459. https://doi.org/10.1073/pnas.1521897113.CrossRefGoogle ScholarPubMed
van Rooij, I., & Baggio, G. (2021). Theory before the test: How to build high-verisimilitude explanatory theories in psychological science. Perspectives on Psychological Science, 16(4), 682697. https://doi.org/10.1177%2F1745691620970604.CrossRefGoogle ScholarPubMed
Wang, S. Y. N., & Inbar, Y. (2020). Moral-language use by US political elites. Psychological Science, 32(1), 1426. https://doi.org/10.1177%2F0956797620960397.CrossRefGoogle Scholar
Wheeler, M. A., McGrath, M. J., & Haslam, N. (2019). Twentieth century morality: The rise and fall of moral concepts from 1900 to 2007. PLoS ONE, 14(2), e0212267. https://doi.org/10.1371/journal.pone.0212267.CrossRefGoogle ScholarPubMed