Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-06T08:56:21.232Z Has data issue: false hasContentIssue false

Coffee and controversy: How applied psychology can revitalize sexual harassment and racial discrimination training

Published online by Cambridge University Press:  27 January 2020

Theodore L. Hayes*
Affiliation:
Federal Bureau of Investigation, Washington, DC, USA
Leah E. Kaylor
Affiliation:
Federal Bureau of Investigation, Washington, DC, USA
Kathleen A. Oltman
Affiliation:
Federal Bureau of Investigation, Washington, DC, USA
*
*Corresponding author. Email: tlh2006@gmail.com
Rights & Permissions [Opens in a new window]

Abstract

Training has shown little effectiveness in altering harassing or discriminatory behavior. Limitations of prior intervention efforts may reflect poor conceptualization of the problems involved, poor training intervention design, approaches that engender cynicism, or misunderstanding psychological principles of attitude and behavior change. Interventions should capitalize on behavioral science models and tools at multiple levels from a broad array of disciplines to explain harassment and bias, and then to defeat these behaviors. Measures to ensure fair treatment should focus on leadership socialization, organizational culture and climate, increased professional competence, and integration with organizational approaches to corporate social responsibility and performance.

Type
Focal Article
Copyright
© Society for Industrial and Organizational Psychology, Inc. 2020

In late May 2018, over 175,000 employees in more than 8,000 Starbucks-owned coffee and tea stores within the United States received training following an incident in a Philadelphia Starbucks store in which two African American men were arrested for no apparent behaviorally based reason (Starbucks, 2018). Starbucks founder and executive chairman, Howard Schultz, said the training would take place because the company’s founding values were based on “humanity and inclusion.” According to the same press release, the training was “designed to address implicit bias, promote conscious inclusion, prevent discrimination and ensure everyone inside a Starbucks store feels safe and welcome” (Starbucks, 2018).

Behavioral science researchers and observers were unimpressed by this announcement. Jefferson and Lewis (Reference Jefferson and Lewis2018) noted that while praiseworthy in intention, the Starbucks program was designed without a program evaluation component.Footnote 1 Chabris and Brown (Reference Chabris and Brown2018) suggested a randomized control design to study the training treatment intervention as compared to making the training a universal Starbucks imperative within its corporate-owned, US-based stores. Belluz’s (Reference Belluz2018) review of implicit bias training literature showed that training may not be a cure-all for Starbucks. Cumulated evidence has shown that implicit bias training has mixed results in reducing bias (Lai, Marini, et al., Reference Lai, Marini, Lehr, Cerruti, Shin, Joy-Gaba and Nosek2014), with “improvement” rarely lasting a week post-training. Furthermore, Forscher et al. (Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019) showed that implicit bias training could lead to more bias, a finding consistent in both sexual harassment training (Blakely, Blakely, & Moorman, Reference Blakely, Blakely and Moorman1998; Robb & Doverspike, Reference Robb and Doverspike2001) and racial bias training (Hussey & De Houwer, Reference Hussey and De Houwerunpublished manuscript).

This article summarizes eight practice topics and associated research questions for investigation and implementation from the scientist-practitioner perspective regarding how applied psychology could be useful to organizations seeking to mitigate or react to unlawful racial discrimination and sexual harassment. Contextual factors that could enhance the effectiveness of applied psychological interventions are discussed. Advances in training science and behavior change will be reviewed. Practice perspectives regarding applied psychological interventions will be reviewed at the individual and unit or organizational levels, to include organizational training commitment; increasing training impact; training content; training medium; organizational and individual behaviors along a continuum of harm; professional competence and beliefs about change; bystander programs; and incorporating corporate social responsibility and reputation management as part of an intervention strategy.

Unlawful racial discrimination and sexual harassment are well-publicized, cross-organizational problems that are possibly the most common and pernicious examples of counterproductive work behavior (Sackett, Reference Sackett2002). We emphasize that not all negative behavior exhibited toward individuals in identifiable or protected classes (i.e., women, Asian Americans, the LGBTQ community, faith communities, etc.) meets the legal definitions of discrimination or harassment, even if the behavior is provocative, and that these events must be dealt with within organizations themselves. The behavioral science databases for these issues are growing apace (e.g., Aksoy, Carpenter, Frank, & Huffman, Reference Aksoy, Carpenter, Frank and Huffman2018; Hebl, Bigazzi Foster, Mannix, & Dovidio, Reference Hebl, Bigazzi Foster, Mannix and Dovidio2002; Lai, Haidt, & Nosek, Reference Lai, Haidt and Nosek2014; U.S. Merit Systems Protection Board, 2014).

Importance

Unlawful racial discrimination

Fundamental to the nature of racism is the view that people can be sorted based on inherent and accidental characteristics such as ethnicity or regional origin, and that some groups are superior to others because of these between-group characteristics. Subjugation of the minority group by the majority group arises from this perceived superiority (Brewer, Reference Brewer1999; Leidner, Castano, Zaiser, & Giner-Sorolla, Reference Leidner, Castano, Zaiser and Giner-Sorolla2010). Countries vary in the extent to which racial discrimination is legally prohibited in terms of contractual matters, business practices, education, and service provision. In the United States, for example, the Civil Rights Act of 1964 (Pub. L. 88-352, 78 Stat. 241) prohibits discrimination based on race, color, religion, sex, or national origin regarding interstate commerce, voting, education, and employment, the latter under Title VII (42 U.S. Code Section 2000e-2; the Act outlines narrow exceptions to all these prohibitions). Private and public organizations may have their own prohibitions in their codes of conduct or ethical standards.

The implications of racial bias can be assessed across a broad range of outcomes. At the individual employee level, a meta-analysis by Triana, Jayasinghe, and Pieper (Reference Triana, Jayasinghe and Pieper2015) regarding the impact of perceived racial bias on organizational outcomes found that perceived racial bias had consistent negative correlation with individual-level job attitudes (rho = –.38), perceived support for diverse employees (diversity climate; rho = –.32), psychological health (rho = –.14), and organizational citizenship behaviors (rho = –.14). McKay et al. (Reference McKay, Avery, Tonidandel, Morris, Hernandez and Hebl2007) found that diversity climate perceptions were a significant correlate of the individual’s intent to quit the organization. At the organizational level, consequences of unlawful racial discrimination can range from legal action (e.g., the 1971 Griggs v. Duke Power Company decision; 401 U.S. 424) to social criticism and resultant public contrition (e.g., the Starbucks training situation). At the federal government level, the U.S. Equal Employment Opportunity Commission (EEOC, n.d.) reported that the number of Civil Rights Act claims brought under Title VII, which would primarily affect employers, has increased for claims of violations based on employee color from fiscal year 2010 (n = 2,780 claims) to fiscal year 2018 (n = 3,166 claims), decreased for claims based on national origin from fiscal year 2010 (n = 11,304 claims) to fiscal year 2018 (n = 7,106 claims), and decreased for claims of violations based on race from fiscal year 2010 (n = 35,890 claims) to fiscal year 2018 (n = 24,600 claims).

In line with increased reports of violations of Title VII based on race, there have been a variety of social movements reflecting a rising public awareness of issues around unlawful racial discrimination. From the Starbucks incident to recent shootings of unarmed African American men, the need for effective race-based bias interventions at all levels of society is clear. Nearly one-third (32.2%) of all complaints filed with the EEOC in fiscal year 2018 were based on race (EEOC, n.d.). Organizations may be particularly motivated to address illegal race discrimination, as there are multiple direct and indirect costs associated with such accusations. Attrition due to race discrimination costs institutions millions in lost profits and opportunities, as well as increased time for recruitment and training (e.g., Kapor Center for Social Impact, 2017). Many organizations rely on their good reputation both for new employees and for sales figures, which can be diminished by having a reputation for condoning apparently racist behaviors (Goldman, Gutek, Stein, & Lewis, Reference Goldman, Gutek, Stein and Lewis2006; Kapor Center for Social Impact, 2017; Sickler, Reference Sickler2018). Thus, there are short- and long-term consequences for not preventing and addressing unlawful racial discrimination in the workplace.

Sexual harassment

Although there are various forms of sexual discrimination, this article will focus specifically on sexual harassment in the workplace. Sexual harassment can involve intimidation or actions taken against a single individual based on gender characteristics. Sexual harassment does not require evidence that a practice, such as not promoting women, affects a certified class of affected individuals; this is covered in the United States by the Civil Rights Act. A classic formulation of sexual harassment (U.S. Code of Federal Regulation, Title 29) involves either a quid pro quo work arrangement (coercion to perform sexual acts in exchange for favorable organizational outcomes) or the existence of a hostile work environment that unreasonably interferes with an individual’s work performance. Johnson, Bidnall, and Benya (Reference Johnson, Bidnall and Benya2018, p. 2) differentiate the hostile workplace concept into gender harassment (e.g., derogatory comments about a gender) or unwanted sexual attention. It is notable that while coercion involves volitional behavior targeting a particular person, creation of a hostile work environment might not target anyone in particular. Alternatively, the person engaging in actions deemed by others as harassing may not be aware that others find the behaviors harassing.

Statistics regarding the incidence of sexual harassment and assault are dependent upon reporting comfort and definitions of harassment. Defining sexual harassment only in terms of coercion will result in a lower incidence rate than defining harassment in terms of the more extensive concept of gender harassment. Where or when the harassment or assault occurs—in an educational setting, at work, in the military—also enters into consideration. For example, Anderson (Reference Anderson2015; see also Burns, Eaton, Long, & Zapp, Reference Burns, Eaton, Long and Zapp2019) claimed that about 20% of women have been sexually assaulted based on studies of collegiate settings, but that the rates of unreported incidents are likely much higher. However, Fedina, Holmes, and Backes (Reference Fedina, Holmes and Backes2018) reviewed studies of college campus assault from 2000 through 2015 and found wide variation in assault incidence based on how these incidents were categorized, for example, as physical contact or coercion to engage in unwelcomed behavior. A comprehensive RAND study of sexual harassment in the U.S. military (Jaycox et al., Reference Jaycox, Schell, Morral, Street, Farris, Kilpatrick, Tanielian, Morral, Gore and Schell2015, table 3.11) found that prior to joining the military, 8.17% of female respondents to its survey had experienced a sexual assault while 0.91% of male respondents had experienced a sexual assault, but since joining the military those proportions had risen to 14.69% of women and 2.1% of men. Jaycox et al. (Reference Jaycox, Schell, Morral, Street, Farris, Kilpatrick, Tanielian, Morral, Gore and Schell2015, table 3.13) also studied reporting rates. They found that 24% of all respondents who had experienced a sexual assault while in the military indicated that they had not reported the event as a means to minimize its impact (e.g., they thought it was not serious enough to report), while another 29% feared retaliation or thought reporting it would make the reporting service member look bad, etc. Analyses of sexual harassment, gender discrimination, and quid pro quo prevalence were also included in the RAND study (Farris et al., Reference Farris, Jaycox, Schell, Street, Farris, Kilpatrick, Tanielian, Morral, Gore and Schell2015). In this analysis, 1.66% of female respondents and 0.35% of male respondents reported being the target of a quid pro quo attack (table 4.2); 21.57% of females and 6.61% of males reported experiencing sexual harassment (table 4.3); and 12.4% of females and 1.73% of males reported experiencing gender discrimination (table 4.4). At the federal government level, the EEOC (n.d.) reported that the number of Civil Rights Act harassment claims brought under Title VII, which would primarily affect employers, has varied in a small range over time from fiscal year 2010 (n = 7,944 claims) to fiscal year 2018 (n = 7,609 claims).Footnote 2

Finally, psychologists at the U.S. Merit Systems Protection Board (MSPB; 2018a, 2018b) aggregated U.S. government employee survey data from 1994 and 2016 regarding 12 discrete behaviors indicative of sexual harassment.Footnote 3 These behaviors can be categorized into one of three dimensions: sexual coercion, unwanted sexual attention, and gender harassment. In 1994, MSPB estimated that 44.3% of female U.S. government employees and 19.1% of male U.S. government employees reported having experienced any of these behaviors; in 2016, those figures had dropped to 20.9% of women experiencing any of these behaviors and 8.7% of men having experienced any of these behaviors.

Recent societal trends, such as #MeToo and #TimesUp, show that interventions for workplace sexual harassment and assault are timely and needed. Harassment and discrimination are costly for organizations (e.g., litigation, blemished company reputation, etc.; Brown, Sabat, Follmer, Jenkins, & Martinez, Reference Brown, Sabat, Follmer, Jenkins and Martinez2018) and victims (e.g., higher turnover, decreased job satisfaction, and increased absenteeism, etc.; Bergman, Langhout, Palmieri, Cortina, & Fitzgerald, Reference Bergman, Langhout, Palmieri, Cortina and Fitzgerald2002; Kaylor & Weaver, Reference Kaylor and Weaver2018; Offermann & Malamut, Reference Offermann and Malamut2002) alike. According to the EEOC (n.d.), approximately $56.6 million in fines was awarded in fiscal year 2018 for cases that were not resolved before trial, a nominal 78.2% increase on a per-resolved-case (reasonable cause, successful conciliations, unsuccessful conciliations, merit resolutions) basis since fiscal year 2010. This illustrates the financial importance of preventing and addressing workplace sexual harassment and assault for organizations.

Revitalizing sexual harassment and racial discrimination training

Training is a natural starting point for applied psychologists in organizations seeking to address unlawful racial discrimination and sexual harassment. Science-based analysis supports an organization’s investment in training while pointing to how an organization can enhance its own training investment. The question is whether training “works” effectively to address racial discrimination or sexual harassment behaviors.

What are the prerequisites for effective training?

Salas, Tannenbaum, Kraiger, and Smith-Jentsch (Reference Salas, Tannenbaum, Kraiger and Smith-Jentsch2012) published a systematic review of training research indicating five broad prerequisites of effective training programs: identifying workforce and organizational training needs, careful training content and program development, establishing leadership’s support of training, integration of technology into training without overreliance on technology, and promotion of ongoing integration of training and on-the-job functions.

Campbell, Kuncel, and Kostal (Reference Campbell, Kuncel, Kostal, Ones, Anderson, Viswesvaran and Kepir Sinangil2018) summarized their integrative review of the training literature by stating that four key issues (pp. 534–536) must be addressed for training to be effective in improving or altering behavior: (1) development of a model of training design, implementation, and evaluation; (2) the nature of the aptitude by training treatment interaction, which is presumed to exist for any human attribute; (3) a definition of the outcomes to be altered by training and assessed in training evaluation; and (4) instructional system design that is built on known models of how people learn. Medeiros and Griffith (Reference Medeiros and Griffith2019) elaborate on some of these topics and processes specifically within the context of training for sexual harassment and assault prevention. Campbell et al. (Reference Campbell, Kuncel, Kostal, Ones, Anderson, Viswesvaran and Kepir Sinangil2018) concluded that training evaluation science shows that while training “does work” (p. 590) from the perspective of overall measurable changes in outcomes pre-/post-training, there are many caveats and cautionary boundary conditions on this overall conclusion. For example, Salas et al. (Reference Salas, Tannenbaum, Kraiger and Smith-Jentsch2012), after Arthur, Bennett, Stanush, and McNelly (Reference Arthur, Bennett, Stanush and McNelly1998), noted that regardless of training program feature, training effects decay if the job does not afford the opportunity for practice. Lacerenza, Reyes, Marlow, Joseph, and Salas (Reference Lacerenza, Reyes, Marlow, Joseph and Salas2017, tables 3 and 4), in a review of manager training literature, found that while management-oriented training “works,” it is less effective when trainee participation is involuntary and when interpersonal, rather than intrapersonal or business skill, knowledge is trained.

Does anti-harassment or anti-racial discrimination training work?

Organizations that implement high performance work programs such as skills-oriented training may get return on investment by having better human resource practices overall (e.g., Huselid, Reference Huselid1995; Kim & Ployhart, Reference Kim and Ployhart2014). Arthur, Bennett, Edens, and Bell (Reference Arthur, Bennett, Edens and Bell2003) showed that training for interpersonal skills results in significant organizational outcomes (average d-prime of about .78), even though improvement in behavior for individual employees via transfer of training to the job is variable (average d-primes varying from .22 to .94; see also Lacerenza et al., Reference Lacerenza, Reyes, Marlow, Joseph and Salas2017, on training outcome definitions). Arthur et al. (Reference Arthur, Bennett, Edens and Bell2003, p. 242) concluded that this variability shows that the “favorability of the posttraining environment play[s] an important role in facilitating the transfer of trained skills to the job.” However, while harassment and discrimination might be signs of poor interpersonal skills, and while training might effectively improve skills in general, damage to the organization’s reputation (and the well-being of employees) arises from the behavior of individual employees irrespective of the organization’s liability protection from training.

One criterion of effective training (Campbell et al., Reference Campbell, Kuncel, Kostal, Ones, Anderson, Viswesvaran and Kepir Sinangil2018) is a definition of outcomes to be targeted through training. The criteria and concepts of typical antidiscrimination or antiharassment training may be ill-defined. Employees may be unaware of their tendencies to treat persons from minority communities unfairly, or that their attitudes toward people from distinct demographic backgrounds could be negative. Organizational decision-makers might harbor unconscious biases regarding individuals from identifiable subgroups or minority communities and thus potentially act negatively toward these individuals (e.g., Ghumman, Ryan, & Park, Reference Ghumman, Ryan and Park2016; Hebl et al., Reference Hebl, Bigazzi Foster, Mannix and Dovidio2002; State of New South Wales, Department of Premier and Cabinet, Behavioral Insights Unit, 2016). Unconscious biases among organizational decision-makers might limit promotion or participation of minority individuals in leadership roles. In terms of attitudes and beliefs about training, employees may not know or believe, or have realized, that certain behaviors or attitudes are harmful or illegal. They may believe that what matters at work is task performance, that some people are simply more prone to feeling harassed, or that some people file false harassment or discrimination claims. Finally, employees may believe that efforts designed to defeat discrimination and harassment a priori assume all majority group/nonprotected members are perpetrators, leading to a defensive or defiant attitude before training. Without assessing and addressing these beliefs and behaviors, training may focus on the wrong outcomes. For example, what would constitute “humanity and inclusion” as an outcome of Starbucks’s training?

Sexual harassment training

Empirical reviews of the efficacy of sexual harassment training have found limited to no positive behavioral effect. Williams, Fitzgerald, and Drasgow (Reference Williams, Fitzgerald and Drasgow1999) studied the relative influences of harassment consequence policy, making resources available to raise awareness of sexual harassment, as well as sexual harassment training on incidence of sexual harassment in a military context. Only implementation of consequences by managers significantly curtailed incidence of experience of sexual harassment; there was no effect of training on reduction of harassment. Antecol and Cobb-Clark (Reference Antecol and Cobb-Clark2003) assessed attitudes about what constituted sexual harassment using federal employee survey data gathered in 1995 by MSPB (2018a, 2018b). Antecol and Cobb-Clark (Reference Antecol and Cobb-Clark2003, p. 838) found that when survey respondents reported having ever attended sexual harassment training, “[S]exual harassment training is associated with between a four and five percentage point higher probability that women employed in the federal government have a definition of sexual harassment that includes co-worker initiated, unwanted sexual gestures, sexual remarks, and pressure for dates,” while men were more willing to label supervisor-initiated behaviors as harassing (unstated but presumably when directed toward women). However, 9.8% of women and 14% of men reported being more skeptical about the efficacy of sexual harassment training after being trained. Anderson and Whiston (Reference Anderson and Whiston2005) conducted a meta-analysis of university campus-based sexual assault prevention programs. These authors reported that assault-related attitudes and knowledge changed based on training, but there was little evidence of behavioral-related outcome changes such as decreases in sexual assault (a criterion few studies examined). Goldberg (Reference Goldberg and Paludi2011) reported no effect of sexual harassment training on cognitive outcomes (i.e., understanding that someone has done something wrong), attitudinal outcomes (changed attitudes about sexual harassment being injurious or wrong), or skill-based outcomes (change in prevalence of engaging in sexual harassment), though harassed women were more likely after training to have the skill to confront perpetrators after some types of harassment.

Pina, Gannon, and Saunders (Reference Pina, Gannon and Saunders2009) concluded that there is a lack of program evaluation evidence regarding the efficacy of sexual harassment training programs. Pina et al. (Reference Pina, Gannon and Saunders2009, p. 134) noted that sexual harassment training might be irrelevant because “[T]hese programs do not address the essential issues that surround the occurrence of the phenomenon, such as sexism at work, power misuse and abuse, hierarchical issues, gendered environments, and individual perpetrator characteristics.” (O’Leary-Kelly, Bowes-Sperry, Bates, & Lean, Reference O’Leary-Kelly, Bowes-Sperry, Bates and Lean2009, provide an integrative review of these construct and process issues.) This sentiment was echoed and reinforced by DeGue et al. (Reference DeGue, Valle, Holt, Massetti, Matjasko and Tharp2014) and by a systematic literature review from Marquis et al. (Reference Marquis, Farris, Hall, Kamarck, Lim, Shontz and Wong2017), who concluded that sexual harassment training has failed to meet criteria for effectiveness based on rigorous program evaluation standards. They concluded that the lack of effectiveness was likely due to the typical program’s focus on changing attitudes and knowledge rather than focusing on changes in behavior at either the individual or organization level.

Unlawful racial discrimination training

Marquis et al. (Reference Marquis, Farris, Hall, Kamarck, Lim, Shontz and Wong2017, p. 25) adopted the framework proposed by Pager and Shepherd (Reference Pager and Shepherd2008) to distinguish among organizational phenomena reflecting behavior (discrimination), attitudes (prejudice), beliefs about groups (stereotypes), and “ideologies that support the status quo between groups.” Marquis et al. (Reference Marquis, Farris, Hall, Kamarck, Lim, Shontz and Wong2017, p. 25) further noted that “[D]iscrimination can occur without prejudice, and prejudiced people do not always discriminate.” Finally, Marquis et al. (Reference Marquis, Farris, Hall, Kamarck, Lim, Shontz and Wong2017, p. 25) clarified the distinction between implicit prejudice, which reflects justification mechanisms but not necessarily overt behavior, and explicit prejudice, which reflects overt behavior. These differentiations do not include contextual or process factors. It is likely that interventions seeking to “train away” biases, such as that offered at Starbucks, blur these distinctions.

Organizational science and practice regarding racial, national origin, or ethnic group differences has taken a different path than work on gender, in part because of historical injustice (e.g., the violent legacies of slavery, colonialism, or ethnicity-oriented suspicion) and in part because industrial and organizational (I-O) psychology as a field has historically been more interested in selection-oriented issues than in the challenges minority individuals face in the workplace. Research regarding social perception and race-/national origin-/ethnicity-oriented bias assessment was taken on more quickly and fully by social psychologists. Meta-analyses have supported different perspectives on the efficacy of unlawful racial discrimination training from this social psychology tradition.

A meta-analysis by Forscher et al. (Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019) assessed the quantitative results of interventionsFootnote 4 designed to change implicit bias test scores. They found that implicit bias was reduced or eliminated when targeted interventions sought to weaken the associations between negative attributions and group membership. Interventions that instructed or motivated respondents to respond in a less-biased manner, what Forscher et al. termed “goals to weaken bias” such as making antiracism norms salient, also reduced implicit bias scores. The same approaches to reduce implicit bias also reduced explicit bias (responses to questions such as “How do you feel about Black people?”) somewhat. Unfortunately, Forscher et al. (Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019) reported that minimizing or eliminating implicit bias did not change explicit bias-related behaviors.

Systematic literature reviews arrive at conclusions consistent with Forscher et al. (Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019). Paluck and Green (Reference Paluck and Green2009) reported on efforts to battle explicit bias, not implicit bias. While some explicit bias debiasing training such as cross-cultural training and peer learning was successful, according to Paluck and Green (Reference Paluck and Green2009), approaches such as diversity training or intergroup conflict management were lacking in empirical support mostly due to lack of a theoretical basis as to why they should work or result in changed behavior. Paluck, Green, and Green (Reference Paluck, Green and Green2019) meta-analyzed recent studies of the “contact hypothesis,” which stipulates that having people from differing racial/ethnic groups collaborate should reduce prejudice. Their review found significant moderating conditions—no studies with people over 25 years of age, smaller effects for larger studies—that gave cause for considerable doubt about this approach to debiasing. Other quantitative studies about bias point to features and limitations of debiasing interventions. Forscher, Mitamura, Dix, Cox, and Devine (Reference Forscher, Mitamura, Dix, Cox and Devine2017) found that ethnic stereotyping could be countered by replacing biased opinions and habits with positive messages, thus creating a nonbiased habit of thinking about minority-group individuals.

Review of organizational diversity training intervention research

Several meta-analyses and systematic reviews have been published regarding diversity training interventions that might be used in organizations.

Systematic literature reviews

Kulik and Roberson (Reference Kulik and Roberson2008) noted that behavioral change was difficult to assess in diversity training because studies typically use self-report, and people are poor evaluators of their own behavior. Kulik and Roberson (Reference Kulik and Roberson2008, p. 314) concluded, “The research suggests that adult learners usually perceive themselves as having higher skills after diversity education, but there are few studies examining objective skills, and those studies have produced inconsistent results.” Curtis and Dreachslin (Reference Curtis and Dreachslin2008) also found lack of behavioral evidence. They noted (p. 121) that while training improves attitudes, “Evidence that training actually changes behavior in a significant way is lacking.” Phillips, Deiches, Morrison, Chan, and Bezyak (Reference Phillips, Deiches, Morrison, Chan and Bezyak2016) reviewed literature on training about disabilities in organizations and found only three publications; these authors reported a wide gap between practice and research on integrating those with differing levels of ability into the workplace. Alhejji, Garaban, Carbery, O’Brien, and McGuire (Reference Alhejji, Garavan, Carbery, O’Brien and McGuire2016) conducted a systematic literature review of diversity training theories, methods, and contexts, as well as outcome-oriented studies focused on learning, return on investment, and attitudes. They found a significant amount of variability in approaches to diversity training, leading them to conclude (p. 140) that available research was atheoretical and “methodologically flawed and fragmented.”

Meta-analyses

Kalinoski et al. (Reference Kalinoski, Steele-Johnson, Peyton, Leas, Steinke and Bowling2013) meta-analyzed studies using an outcome taxonomy of attitudinal outcomes, cognitive outcomes, and behavioral skill-based outcomes. While results indicated a robust result for the behavioral skill-based outcome category (sample-size weighted mean effect size = .47), there was no further fine-grained analysis of what behaviors had changed.

Bezrukova, Spell, Perry, and Jehn (Reference Bezrukova, Spell, Perry and Jehn2016) included studies with program evaluation components in the study’s intervention design in their meta-analysis. The goals of these studies included increasing awareness of minority racial/ethnic/national origin groups, knowledge of diversity principles, and training on appropriate/nondiscriminatory behaviors. Bezrukova et al.’s (Reference Bezrukova, Spell, Perry and Jehn2016) results show that training increased knowledge-based outcomes and positive reactions to training more, and for longer amounts of time, than did interventions targeting attitudes or stereotypes. Bezrukova et al. (Reference Bezrukova, Spell, Perry and Jehn2016) claimed that their results meant that diversity training improved trainee bias-related behavioral outcomes. However, their operationalization of behavioral outcomes (p. 1229 and p. 1233) mixed self-report of behavioral change, self-reported knowledge (e.g., measured by situational judgment tests; Hauenstein, Findlay, & McDonald, Reference Hauenstein, Findlay and McDonald2010), and independent observer behavioral ratings. Thus, Bezrukova et al. (Reference Bezrukova, Spell, Perry and Jehn2016) showed that diversity training could have positive cognitive outcomes in terms of understanding other people and in terms of knowing the right behavior to perform, and that trainees would not reject diversity training out of hand; both their meta-analysis and the meta-analysis by Kalinoski et al. (Reference Kalinoski, Steele-Johnson, Peyton, Leas, Steinke and Bowling2013) were not definitive in demonstrating that trainees acted differently toward minority group individuals post-training as opposed to, for example, knowing which behaviors were more appropriate.

Interventions in both lab and field settings to eliminate or weaken biased behaviors in organizations have been successful for short durations in improving attitudes toward target individuals, and in improving target trainee knowledge about bias and about less biased ways to act. A key moderator of the training or intervention was duration of training. Meta-analyses of interventions to address racial bias have found that longer training intervals (in Kalinoski et al., Reference Kalinoski, Steele-Johnson, Peyton, Leas, Steinke and Bowling2013, training that lasted more than 4 hours; Bezrukova et al., Reference Bezrukova, Spell, Perry and Jehn2016, p. 1238, also reported greater amount of change with longer training intervals) are more effective for outcomes such as attitudes and cognitions. However, Lai et al. (Reference Lai, Skinner, Cooley, Murrar, Brauer, Devos and Nosek2016) found that the change due to implicit bias interventions is short-lived, possibly lasting under 24 hours.

Knowledge of the impact of training duration on behavioral change is clouded by means of behavioral change measurement. Work by Forscher, Lai, and their colleagues (e.g., Forscher et al., Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019) suggests that wholesale attitude change is not a typical outcome of de-biasing training; that when de-biasing works, it is because one (positive) attribution or stereotype has been substituted for another; and that any effect even when training “works” may be fleeting.

We conclude that the diversity knowledge base and training meta-analysis literature shows that the lack of alignment between training content, goals, and effectiveness criteria has led to training that positively changes attitudes and knowledge, but not necessarily behavior.

How could applied psychology re-focus research agendas to help organizations seeking to mitigate discrimination and harassment?

Psychologically trained practitioners in organizations, including I-O psychologists, social psychologists, clinical psychologists, and consulting psychologists, are in positions to implement behavioral interventions designed to mitigate or eliminate unlawful racial discrimination and sexual harassment. Organizational goals and applied psychologist goals should be aligned for training to demonstrate effective outcomes. We introduce these approaches and propose key research questions.

Topic 1: Organizational training commitment

Training is the most obvious intervention option for addressing sexual harassment or unlawful racial discrimination: it is scalable from the work group to the organization, it is a face-valid process, and it is within the I-O and applied psychology skill set. We suggest that more attention is needed to align training goals, learning theory, and expectations.

Kath and Magley (Reference Kath, Magley, Chen and Cooper2014, p. 323) conceptualized sexual harassment training as a form of organizational socialization rather than skill building. While socialization conveys expectations of organizational values and normative behavior, skill-oriented training creates an expectation of attainment of minimum proficiency. Kath and Magley noted that trainee motivation depends in part on wanting to apply what was learned in training on the job. Another concern is not being cynical about the rationale for training. If the rationale seems largely to focus on minimizing organizational liability, then trainees are likely to be unmotivated and disengaged. In contrast, meta-analysis has established the positive role of training motivation (Colquitt, LePine, & Noe, Reference Colquitt, LePine and Noe2000) in achieving organizational goals and behavior change. It seems possible that training to reduce harassing or biased behavior might be more effective if it is framed as under the individual’s control (Colquitt et al., Reference Colquitt, LePine and Noe2000, p. 694) or integrated into an effort to increase morale rather than as a mandatory condition of employment (Dobbin & Kalev, Reference Dobbin and Kalev2016; Holladay, Knight, Paige, & Quiñones, Reference Holladay, Knight, Paige and Quiñones2003). For both sexual harassment and racial discrimination, training that has follow-ups or lasts longer should be more effective than short-duration training (Devine, Forscher, Austin, & Cox, Reference Devine, Forscher, Austin and Cox2012). Kath and Magley (Reference Kath, Magley, Chen and Cooper2014) noted that as with any change-oriented initiative, ongoing executive commitment to a workplace free of harassment and discrimination, and organizational support for key nonharassment values are required for training to be effective.

Research Question #1: Will unlawful racial discrimination or sexual harassment training oriented toward development (e.g., learning or mastering a new skill), as opposed to being oriented toward compliance, be effective in changing behavior?

Topic 2: Increasing training impact

An organizational climate that is intolerant of sexual harassment and assault can lead to lower levels of sexual misconduct (Bergman et al., Reference Bergman, Langhout, Palmieri, Cortina and Fitzgerald2002; Fitzgerald et al., Reference Fitzgerald, Drasgow, Hulin, Gelfand and Magley1997; Glomb, Munson, Hulin, Bergman, & Drasgow, Reference Glomb, Munson, Hulin, Bergman and Drasgow1999; Glomb et al., Reference Glomb, Richman, Hulin, Drasgow, Schneider and Fitzgerald1997; Wasti, Bergman, Glomb, & Drasgow, Reference Wasti, Bergman, Glomb and Drasgow2000). Offerman and Malamut (Reference Offermann and Malamut2002) found that female service members who perceived that their supervisor made efforts to stop sexual harassment reported feeling significantly freer to report the misconduct and felt more satisfied with the reporting process compared to service members who felt their supervisor was tolerant of sexual harassment. When an organization expresses to its employees that sexual harassment is considered to be a serious matter, employees are more willing to report the sexual misconduct (Brubaker, Reference Brubaker2009). Not only can this attitudinal change improve the climate of the workplace, it may also lead the organization to take reports of sexual misconduct more seriously (Bergman et al., Reference Bergman, Langhout, Palmieri, Cortina and Fitzgerald2002). This literature suggests that changes within the organizational climate and leadership response to these behaviors may help to prevent sexual harassment and assault from occurring by increased reporting at earlier stages and improving how sexual misconduct reports are handled (Kaylor & Weaver, Reference Kaylor and Weaver2018).

Trainee receptivity may be distributed as power functions rather than normal distributions (e.g., O’Boyle & Aguinis, Reference O’Boyle and Aguinis2012). Bezrukova et al. (Reference Bezrukova, Spell, Perry and Jehn2016) reported uneven meta-analytic moderation based on whether training was mandatory or voluntary, with better results for behaviorally oriented outcomes in mandatory training but more favorable reactions to training in voluntary attendee conditions. Rather than have all employees regardless of enthusiasm attend the same training, typical organizational tools such as surveys or assessments can be used strategically to anticipate predisposition to escalation of violence or harassment behaviors among business units or individuals. Psychologists can use this form of insider threat practice to devise intervention strategies aligned with the training or remediation needs of individuals or areas prone to escalation. Similarly, there may be employees who are enthusiastic about antidiscrimination or harassment initiatives who could help design intervention programs or processes on a peer-to-peer basis (see Kulik, Pepper, Roberson, & Parker, Reference Kulik, Pepper, Roberson and Parker2007).

Research Question #2: How can interventions, such as efforts to build a climate of intolerance for harassment or surveys to anticipate predisposition to escalation, be engineered to increase both participation in and receptivity to necessary changes in behavior resulting from training?

Topic 3: Training content

The typical training model presumes that aside from their motivation, trainees know how to be trained and transfer the training to work. Adler et al. (Reference Adler, Blies, Pickering, Hammermeister, Williams, Harada and Ohlson2015) tested this presumption in a randomized study of mental skills training. Their study focused on creating “mental skills,” which were specifically cognitive control (learning how to learn more effectively) and emotional regulation (including reduced anxiety and effective allocation of emotional resources; Adler et al., Reference Adler, Blies, Pickering, Hammermeister, Williams, Harada and Ohlson2015, p. 1753), among soldiers in basic training. The goal was to establish the extent to which learning these skills led to improved training performance. Adler et al. found that soldiers in the mental skills conditions relative to those in a control condition were significantly better able to learn and eventually performed better in some basic training tasks through instilling better learning and transfer habits.

Social psychology research on resilience training and attitude change might also be relevant. Cialdini et al. (Reference Cialdini, Demaine, Sagarin, Barrett, Rhoads and Winter2006) found that training using injunctive norms (“don’t do this”) was more effective in stopping unwanted behavior than was training using descriptive norms (“this is what other people do”). Cacioppo et al. (Reference Cacioppo, Adler, Lester, McGurk, Thomas, Chen and Cacioppo2015) examined a training intervention for social resilience, defined by Cacioppo, Reis, and Zautra (Reference Cacioppo, Reis and Zautra2011, p. 44) as “the capacity to foster, engage in, and sustain positive relationships, and to endure, recover from, and grow as a result of life stressors and social isolation.” An ability to empathize with others also defines social resilience. Cacioppo et al. (Reference Cacioppo, Adler, Lester, McGurk, Thomas, Chen and Cacioppo2015) found that social resilience training was effective in creating empathy and perspective-taking. In summary, Cialdini et al.’s (Reference Cialdini, Demaine, Sagarin, Barrett, Rhoads and Winter2006) results show that sexual harassment or unlawful racial discrimination training should focus on what not to do—maybe along the lines of do n0t harass, bully, or otherwise discriminate against people—while Cacioppo et al.’s (Reference Cacioppo, Adler, Lester, McGurk, Thomas, Chen and Cacioppo2015) results suggest that additional training components could replace the negative behavior (bias, bullying, harassment) with positive target behavior (using social resilience to build empathy, perspective-taking, and community). The meta-analysis by Forscher et al. (Reference Forscher, Lai, Axt, Ebersole, Herman, Devine and Nosek2019) and further work by Lai (Reference Lai2019) demonstrate that changes in bias-related attitudes occur through substituting negative attitudes with positive ones. Models of sexual harassment and unlawful racial discrimination training generally focus on the trainee as the source of the behavior that should be mitigated. However, sexual harassment training has shown positive results for those who have been harassed (traditionally, women or racial minorities; O’Leary-Kelly et al., Reference O’Leary-Kelly, Bowes-Sperry, Bates and Lean2009; Pina et al., Reference Pina, Gannon and Saunders2009; Walton & Cohen, Reference Walton and Cohen2007). Alternative training content might focus on training employees to intervene in a harassing or demeaning/biased setting as bystanders (e.g., Kleinsasser, Jouriles, McDonald, & Rosenfield, Reference Kleinsasser, Jouriles, McDonald and Rosenfield2015). Intervention or self-advocacy might also increase a sense of community and self-efficacy, which itself could have reinforcing effects on reducing bias and harassment.

Taken together, social psychological research seems to suggest that training regarding specific attitudes and correspondingly specific behavior may reduce bias and discrimination. Training also benefits targeted individuals. A challenge for organizational practitioners is identifying the specific attitude–behavior linkages amenable to training for both discrimination targets and those who might exhibit harassment or bias.

Research Question #3: How can training content be scaled to the needs of an organization that seeks to avoid discrimination and harassment, while also supporting its members who may have been targets of harassment and discrimination?

Topic 4: Bystander programs

By influencing attitudes, beliefs, and behaviors surrounding sexual harassment and assault, bystander programs encourage and train individuals to intervene when they witness situations of harassment (Berdahl & Raver, Reference Berdahl, Raver and Zedeck2011; Buchanan, Settles, Hall, & O’Connor, Reference Buchanan, Settles, Hall and O’Connor2014; Burns et al., Reference Burns, Eaton, Long and Zapp2019). Some bystander programs even boast empirical support, such as “Green Dot” (Coker et al., Reference Coker, Cook-Craig, Williams, Fisher, Clear, Garcia and Hegge2011, Reference Coker, Fisher, Bush, Williams, Clear and DeGue2015, Reference Coker, Bush, Fisher, Swan, Williams, Clear and DeGue2016), “Bringing in the Bystander” (Banyard, Moynihan, & Plante, Reference Banyard, Moynihan and Plante2007; Senn & Forrest, Reference Senn and Forrest2015), and “One in Four” (Foubert & Perry, Reference Foubert and Perry2007). Although bystander intervention programs have been found to be broadly effective in high school and college students (Coker et al., Reference Coker, Cook-Craig, Williams, Fisher, Clear, Garcia and Hegge2011, Reference Coker, Fisher, Bush, Williams, Clear and DeGue2015, Reference Coker, Bush, Fisher, Swan, Williams, Clear and DeGue2016; Lee, Guy, Perry, Sniffen, & Mixson, Reference Lee, Guy, Perry, Sniffen and Mixson2007; Senn & Forrest, Reference Senn and Forrest2015), future research should analyze these programs and how they can be tailored for prevention of sexual harassment and assault within the workplace.

Another disadvantage of the current research on bystander intervention is that it has been primarily researched using Caucasian populations and focused on sexual harassment (e.g., Diamond-Welch, Hetzel-Riggin, & Hemingway, Reference Diamond-Welch, Hetzel-Riggin and Hemingway2016; Kleinsasser, Jouriles, McDonald, & Rosenfield, Reference Kleinsasser, Jouriles, McDonald and Rosenfield2015; see Mulvey, Palmer, & Abrams, Reference Mulvey, Palmer and Abrams2016, and Nelson et al., Reference Nelson, Dunn, Paradies, Pederson, Sharpe, Hynes and Guerin2010, for exceptions). There is very little research examining bystander interventions regarding race/ethnicity bias; those few studies are primarily composed of student populations and have shown mixed results (Nelson et al., Reference Nelson, Dunn, Paradies, Pederson, Sharpe, Hynes and Guerin2010). Additional areas for exploration within bystander programs are both harassment and unlawful racial discrimination, socioeconomic status, and intersectionality (Edwards, Mattingly, Dixon, & Banyard, Reference Edwards, Mattingly, Dixon and Banyard2014; McCall, Reference McCall2005; Settles & Buchanan, Reference Settles, Buchanan, Benet-Martínez and Hong2014; Shields, Reference Shields2008). Current studies on race-based bullying and bystander intervention show reason to suspect that bystander intervention programs could have a powerful impact on reducing incidences of racial and sexual harassment in the workplace (Mulvey et al., Reference Mulvey, Palmer and Abrams2016).

Research Question #4: Is indirect training, such as bystander intervention, potentially more effective than direct behavioral modification training?

Topic 5: Training medium

Campbell et al. (Reference Campbell, Kuncel, Kostal, Ones, Anderson, Viswesvaran and Kepir Sinangil2018, p. 550) warned that training via gamification or virtual reality may be well-received by trainees but could suffer from poor design and operationalization of parameters. At the same time having a gamification intervention might be a way to monitor trainee progress and have more time spent on a “fun” activity.Footnote 5 The effectiveness of this training regimen would need to be evaluated carefully, but psychologists have been successful modifying behavior with a gamification approach (Weir, Reference Weir2018). It is difficult to balance engagement with training with effectiveness in changing behavior; as Bezrukova et al. (Reference Bezrukova, Spell, Perry and Jehn2016) showed, voluntary participation (i.e., engagement in training) is related to positive attitudes about training but not necessarily behavioral change. Because training engagement is not a reliable indicator of training effectiveness, there should be alignment of program goals with implementation.

Research Question #5: How can training programs be made both more engaging and more effectively aligned with program goals?

Topic 6: How can academic research clarify, and how can practitioners utilize, a continuum of harm approach for interventions?

Instead of starting with a method or program of training or organizational change, researchers and practitioners might start by defining a continuum of targeted behaviors including sexual harassment or unlawful racial discrimination behaviors, etiologies, and protective factors. A continuum implies that the negative behaviors start in one form or level of intensity, maybe as jokes, then escalate, possibly as threats. Codifying the target behaviors that comprise harassment or bias along a continuum presents an opportunity to confront these behaviors via training and policy, and to clarify consequences.

Policy is not the forte of organizational practitioners and scientists, but organizational science and practice inform policy. Applied psychologists have already begun to investigate this notion of a continuum (Lim & Cortina, Reference Lim and Cortina2005). Other efforts (Cortina, Rabelo, & Holland, Reference Cortina, Rabelo and Holland2018) have sought to define and clarify the scope of issues at stake by coining the term “perpetrator predation” to distinguish those who are targets from those who commit the discriminatory or harassing acts. Organizational practitioners should leverage insights from peers in domains such as social psychology and public health. For example, analysts at the U.S. Government Accountability Office (GAO; 2017) surveyed behavioral etiology, incidence, and protective factors surrounding sexual violence in the U.S. Department of Defense. This report drew heavily on work by public health scientists at the Centers for Disease Control and Prevention (Basile, Smith, Breiding, Black, & Mahendra, Reference Basile, Smith, Breiding, Black and Mahendra2014; Centers for Disease Control and Prevention, 2004; Wilkins, Tsao, Hertz, Davis, & Klevens, Reference Wilkins, Tsao, Hertz, Davis and Klevens2014) that placed sexual harassment within a continuum of harm including noncontact unwanted sexual behaviors, sexual harassment, and physical sexual assault. In an approach reflecting this continuum, organizational practitioners might work with the organization’s equal employment opportunity office or insider threat office (or some equivalent) to develop strategy, intervention goals, means to identify organizational culture or managerial “problem spots,” and metrics to evaluate progress. The objective might be to identify issues at a lower level of development (e.g., incivility) before they flare into incidents of discrimination or harassment. The GAO report’s main lessons are that organizational phenomena, such as culture, leadership, and team, and intra-individual processes can inform interventions, performance management, and training in organizations, which are not the forte of policy makers.

Applied psychologists might expand awareness of the continuum of harm by building from previous research demonstrating the negative organizational consequences of culture and climate surrounding harassment and bias. Meta-analysis (Willness, Steel, & Lee, Reference Willness, Steel and Lee2007), individual studies (e.g., Antecol & Cobb-Clark, Reference Antecol and Cobb-Clark2009; Lim & Cortina, Reference Lim and Cortina2005; McKay et al., Reference McKay, Avery, Tonidandel, Morris, Hernandez and Hebl2007; Sadler, Mengeling, Booth, O’Shea, & Torner, Reference Sadler, Mengeling, Booth, O’Shea and Torner2017), and systematic literature reviews (Johnson, Bidnall, & Benya, Reference Johnson, Bidnall and Benya2018) have documented the impacts that harassment or bias have on organizations and employees, frequently in terms of increased quit rates from organizations or careers. These studies have specifically found that the perpetuation of these harassing or discriminatory behaviors is enabled when organizational culture and climate do not clearly address harassment and bias. Research on employee misconduct (Kish-Gephart, Harrison, & Treviño, Reference Kish-Gephart, Harrison and Treviño2010) shows that employee conduct codes that are not reinforced are flouted, and unethical behavior becomes more likely. From a continuum of harm perspective, if there is not intervention for harassment and bias at early stages of the continuum, one might wonder what other organizational problems also have not been addressed. The same research (McKay et al., Reference McKay, Avery, Tonidandel, Morris, Hernandez and Hebl2007; Porath, Gerbasi, & Schorch, Reference Porath, Gerbasi and Schorch2015; Ruggs, Martinez, & Hebl, Reference Ruggs, Martinez and Hebl2011) shows that strong management action endorsing the value of diversity, or simply setting expectations for treating people well, leads to increased retention, performance, and ethical behavior.

A continuum of harm model implies a dynamic process.Footnote 6 Some might prefer a dimensional one (e.g., Gelfand, Fitzgerald, & Drasgow, Reference Gelfand, Fitzgerald and Drasgow1995). Academic research could clarify whether harassment or unlawful discrimination is dynamic and continuum-based, where unlawful racial discrimination behaviors seem innocent or vague at first but then escalate in intensity or type, or dimensional and construct-oriented, where unlawful racial discrimination behaviors do not escalate in intensity or type. We suggest that practitioners favor a continuum of harm model. Leaders and practitioners should treat identification and mitigation of these issues preferably at an early stage as part of the criteria of being a good leader. Organizational survey research (McKay et al., Reference McKay, Avery, Tonidandel, Morris, Hernandez and Hebl2007; Medeiros & Griffith, Reference Medeiros and Griffith2019; Rubino et al., Reference Rubino, Avery, McKay, Moore, Wilson, Van Driel and McDonald2018) can identify problem areas at the team or division/department level, as harassment and discrimination are signs at some point on a continuum of counterproductive behavior.

Research Question #6: How can practitioners develop the skill sets to work with managers to coordinate monitoring, policy, and mitigation regarding discrimination and harassment?

Topic 7: Professional competence and beliefs about change

Part of the answer to Research Question #6 concerns graduate training and development. If unlawful racial discrimination or sexual harassment behavior is a continuum of harm, there should be a commensurate continuum of intervention. The model I-O graduate psychology curriculum (Society for Industrial and Organizational Psychology, Inc., 2016) does not include training on how to understand or address harassing or discriminatory behavior. Sexual harassment is mentioned once in the 2016 document, in passing, as a subset of occupational health psychology, and unlawful racial discrimination is not mentioned anywhere in the document. The graduate curriculum guidelines state, under General Knowledge and Skills, part 1, Ethical, Legal, Diversity, and International Issues, that “I-O psychologists should have knowledge of and should behave in accord with relevant ethical guidelines when consulting as well as conducting research” and then cites as an example the American Psychological Association’s (2002, amended 2010) Ethical Principles of Psychologists and Code of Conduct Footnote 7 for reference. It is fair to conclude that applied psychologists are expected to maintain personal integrity and have general knowledge about sexual harassment and unlawful racial discrimination, but not to be educated in how to identify or provide guidance on how to intervene when organizations turn to them for expertise in dealing with these issues.

We call for an intentional focus from graduate curriculum or professional development perspectives in addressing issues of sexual harassment and unlawful racial discrimination. Consulting psychologists have developed methods and models of behavioral change (e.g., Bar-Haim, Lamy, Pergamin, Bakermans-Kranenburg, & Van Ijzendoorn, Reference Bar-Haim, Lamy, Pergamin, Bakermans-Kranenburg and Van Ijzendoorn2007; Osatuke, Yanovsky, & Ramsel, Reference Osatuke, Yanovsky and Ramsel2017) that could serve in part as the bases for intervening with those at risk of engaging in these behaviors; there is a similar lack of a curriculum knowledge base or practice guidelines for building resilience among those affected. Applied psychologists and organizational practitioners should believe people can change and that professionals can intervene effectively to create the conditions for change for individual contributors, work groups, and leaders. At the very least, training research, as bleak as its lessons are regarding transgressor behaviors, seems to show positive impacts in terms of improving the coping behavior of people who have been affected by harassment or unlawful racial discrimination.

Research Question #7: What impact would mandatory sexual harassment or unlawful racial discrimination training for practitioners have on practitioner beliefs and practices?

Topic 8: Incorporating corporate social responsibility and reputation management as part of an intervention strategy

Applied psychologists should consider that leadership attention put toward reducing discrimination and harassment might fit well within a corporate social responsibility (CSR) framework (Aguinis & Glavas, Reference Aguinis and Glavas2013; Morgeson, Aguinis, Waldman, & Siegel, Reference Morgeson, Aguinis, Waldman and Siegel2013) as part of the intervention continuum approach. CSR research and practice has had an outward-facing “macro” perspective (Morgeson et al., Reference Morgeson, Aguinis, Waldman and Siegel2013, p. 812) in which it has been studied and practiced from a strategy perspective (Aguinis & Glavas, Reference Aguinis and Glavas2013, p. 316). Yet improved intergroup relationships and “strengthening communities” are points of pride for some organizations. We propose that ongoing bias and harassment training for employees will integrate bias-free behavior as an aspect of embedded CSR. Current efforts at many organizations regarding harassment and unlawful racial discrimination might be described as peripheral to a true CSR approach, that is, something that is ongoing but “not integrated into an organization’s strategy, routines, and operations” (Aguinis & Glavas, Reference Aguinis and Glavas2013, p. 314). An example of antidiscrimination and harassment efforts that are part of an organization but are not truly embedded in a CSR framework might include diversity reporting by Google (Brown, Reference Brown2018) or by the U.S. Department of Justice (2018): While it is good that the organization supports awareness, it is unclear how the organization will use the information to inform its practices. An embedded CSR approach to reduction of discrimination and harassment would form the basis of a continuum-based intervention and better mobilize the workforce.

Embedding antiharassment training and diversity programs into a CSR framework would be further effective in helping to shape cultures of diversity and acceptance within an organization, which has been shown to be distinctively effective in reducing harmful behaviors in a variety of contexts (Kalev, Dobbin, & Kelly, Reference Kalev, Dobbin and Kelly2006; Miller & Prentice, Reference Miller and Prentice2016; Tankard & Paluck, Reference Tankard and Paluck2016). By embedding ongoing training into a CSR framework, organizations would take a step toward creating a cultural norm of inclusion and openness. Organizations with a strong cultural norm against biased and harassing behaviors have fewer incidences of such behaviors, and find that people are more willing to speak out when such behavior does occur (Buchanan et al., Reference Buchanan, Settles, Hall and O’Connor2014; Keenan, Reference Keenan2002; McKay et al., Reference McKay, Avery, Tonidandel, Morris, Hernandez and Hebl2007; Porath et al., Reference Porath, Gerbasi and Schorch2015; Ruggs et al., Reference Ruggs, Martinez and Hebl2011).

Research Question #8: Do organizations that make normative behavioral expectations and injunctions regarding discriminatory or harassing behavior part of their embedded CSR find positive empirical outcomes?

Practitioner guidance

Initial guidance for practitioners seeking to address issues of harassment or unlawful discrimination would include asking what current higher-performing managers and leaders do to defeat or at least mitigate harassment and discrimination. Leadership should make it a point to learn about the social and cognitive psychology of discrimination and harassment. On the individual level, those concerned about bias and harassment should look for allies among organizational attorneys or the training department or HR or employee affinity groups interested in these issues. For those working in areas of inclusion and diversity, try to frame the proposed diversity and inclusion initiative as part of leadership development consonant with better CSR. Practitioners should remember not to get enamored with the “bright shiny object” of cool training technology but instead look under the hood at how it could help track changes in participant attitudes, behavior, or cognitions. At the team or organization levels, the use of climate surveys or internal audits of harassment or discrimination claims can be used to measure training effectiveness. Finally, on both the individual and organizational levels, do not expect to rid your organization entirely of discrimination or harassment, but do not employ training as a “check the box” liability-waiver activity either. Encourage leaders to broaden their own thinking and challenge them to believe that, and act as if, no one should have to choose between being treated with respect and achieving the organization’s mission.

Concluding remarks

An organization’s reputational risk from discriminatory or harassing behavior has the potential to harm, shock, and outrage. Professional practices at different organizational levels could influence the organization’s microlevel (changing the behavior of individuals) to the mesolevel (survey data identifying work group “hot spots” of incivility or occurrences of negative behavior) and the macrolevel (managerial focus on changing organizational climate as part of a CSR initiative). Applied psychologists, starting with leadership of SIOP and its partner societies, should make antidiscrimination and antiharassment education and development a mandatory component of graduate education and provide ongoing continuing education experiences through conferences; maybe SIOP committee membership should be contingent upon completing training. This article’s literature review found scant evidence for the potential of one-time debiasing or antiharassment training to mitigate harassing or discriminatory behavior, let alone attitudes or organizational climate. Yet we argue that it is incumbent upon applied psychologists and organizational researchers to approach these issues with energy and optimism grounded in both proven and potential means of remediation and mitigation. The questions and guidance we have provided here are simply starting points. We should act as if Campbell et al.’s (Reference Campbell, Kuncel, Kostal, Ones, Anderson, Viswesvaran and Kepir Sinangil2018) summary claim that “training works” is correct and endeavor as a field to test and support that claim with theoretically grounded, empirically verified practices. We have more to offer organizations, employees, and the general public than stale training programs and free coffee.

Footnotes

The views expressed in this paper are solely those of the authors and do not necessarily reflect the views of the Federal Bureau of Investigation or of any branch of the federal government of the United States. We contributed roughly equally to this paper and are listed here in alphabetical order.

Our thanks go to, in alphabetical order, Patrick Forscher, Liz Hayes, Lisa Kath, Calvin Lai, Neil Lewis, Jr., Patrick McKay, Michelle Motta, Kristin Saboe, Rich Tonowski, and two anonymous reviewers for their responsiveness, thoughtfulness, and generosity both before and while we put this paper together. Finally, we thank Mark Poteet for his careful and tenacious editing.

1 The entire training program is available at https://starbuckschannel.com/thethirdplace/.

2 Meanwhile, the EEOC reported that the number of complaints received based on sexual orientation or identity (i.e., LGBTQ) harassment issues increased from about 808 in fiscal year 2013 to 1,811 in fiscal year 2018.

3 MSPB increased this roster of discrete harassing behaviors from eight to 12 in its 2016 analysis (U.S. Merit Systems Protection Board, 2018a, 2018b).

4 P. Forscher and C. K. Lai (personal communication, May 20, 2018) noted that these interventions are not the type of training one would find in a corporate or educational setting. The interventions in their meta-analyses were lab-based and frequently involved inducing positive attributions toward minority-group individuals or negative attributions of majority-group individuals. Finally, they noted that interventions targeting bias against one group (e.g., African Americans) would not produce a “spill-over effect” such that bias against a different group, for example women, would also be reduced while bias reduction against a target group was desired.

5 We thank K. Saboe for this suggestion though she might not phrase it exactly as it is here.

6 “Continuum of harm” in this sense is not consistent with the term “vicious cycle” used by Jones, Arena, Nittrouer, Alonso, and Lindsey (Reference Jones, Arena, Nittrouer, Alonso and Lindsey2017). A continuum of harm as used here and as defined by the CDC refers to a dynamic process in which small behaviors or incidental attitudes escalate to become problematic for the individual or target personnel (e.g., having negative affect to engaging in counterproductive thoughts to engaging purposefully in negative behavior). The “vicious cycle” in Jones et al. (Reference Jones, Arena, Nittrouer, Alonso and Lindsey2017) referred to the qualitative nature of biased behavior falling along the continua of subtlety, formality, and intentionality.

References

Adler, A. B., Blies, P. D., Pickering, M. A., Hammermeister, J., Williams, J., Harada, C., … Ohlson, C. (2015). Mental skills training with Basic Combat Training soldiers: A group-randomized trial. Journal of Applied Psychology, 100, 17521764. doi:10.1037/apl0000021CrossRefGoogle ScholarPubMed
Aguinis, H., & Glavas, A. (2013). Embedded versus peripheral corporate social responsibility: Psychological foundations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 6, 314332.CrossRefGoogle Scholar
Aksoy, C. G., Carpenter, C. S., Frank, J., & Huffman, M. L. (2018). Gay glass ceilings: Sexual orientation and workplace authority in the UK (technical report #IZA DP No. 11574). Bonn, Germany: IZA Institute of Labor Economics.Google Scholar
Alhejji, H., Garavan, T., Carbery, R., O’Brien, F., & McGuire, D. (2016). Diversity training programme outcomes: A systematic review. Human Resource Development Quarterly, 27, 95149. doi:10.1002/hrdq.21221CrossRefGoogle Scholar
Anderson, N. (2015, June 23). Were one in five college women sexually assaulted? The debate over numbers continues. The Washington Post. Retrieved from https://www.washingtonpost.com/news/grade-point/wp/2015/06/23/were-one-in-five-college-women-sexually-assaulted-the-debate-over-numbers-continues/Google Scholar
Anderson, L. A., & Whiston, S. C. (2005). Sexual assault education programs: A meta-analytic examination of their effectiveness. Psychology of Women Quarterly, 29, 374388. doi:10.1111/j.1471-6402.2005.00237.xCrossRefGoogle Scholar
Antecol, H., & Cobb-Clark, D. (2003). Does sexual harassment training change attitudes? A view from the federal level. Social Science Quarterly, 84, 826842.CrossRefGoogle Scholar
Antecol, H., & Cobb-Clark, D. (2009). Racial harassment, job satisfaction, and intentions to remain in the military. Journal of Population Economics, 22, 713738. doi:10.1007/s00148-007-0176-lCrossRefGoogle Scholar
Arthur, W. Jr., Bennett, W. Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88, 234245. doi:10.1037/0021-9010.88.2.234Google Scholar
Arthur, W. Jr., Bennett, W. Jr., Stanush, P. L., & McNelly, T. L. (1998). Factors that influence skill decay and retention: A quantitative review and analysis. Human Performance, 11, 57101.CrossRefGoogle ScholarPubMed
Banyard, V. L., Moynihan, M. M., & Plante, E. G. (2007). Sexual violence prevention through bystander education: An experimental evaluation. Journal of Community Psychology, 35, 463481.CrossRefGoogle Scholar
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & Van Ijzendoorn, M. H. (2007). Threat-related attentional bias in anxious and non-anxious individuals: A meta-analytic study. Psychological Bulletin, 133, 124. doi:10.1037/0033-2909.133.1.1CrossRefGoogle Scholar
Basile, K. C., Smith, S. G., Breiding, M. J., Black, M. C., & Mahendra, R. R. (2014). Sexual violence surveillance: Uniform definitions and recommended data elements, Version 2.0 (technical report). Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.CrossRefGoogle Scholar
Bergman, M. E., Langhout, R. D., Palmieri, P. A., Cortina, L. M., & Fitzgerald, L. F. (2002). The (un)reasonableness of reporting: Antecedents and consequences of reporting sexual harassment. Journal of Applied Psychology, 87, 230242. doi:10.1037/0021-9010.87.2.230Google Scholar
Berdahl, J. L., & Raver, J. L. (2011). Sexual harassment. In Zedeck, S. (Ed.), Handbook of industrial and organizational psychology (Vol. 3) (pp. 641669). Washington, DC: American Psychological Association.CrossRefGoogle ScholarPubMed
Bezrukova, K., Spell, C. S., Perry, J. L., & Jehn, K. A. (2016). A meta-analytical integration of over 40 years of research on diversity training evaluation. Psychological Bulletin, 142, 12271274. doi:10.1037/bul0000067Google Scholar
Blakely, G. L., Blakely, E. H., & Moorman, R. H. (1998). The effects of training on perceptions of sexual harassment allegations. Journal of Applied Social Psychology, 28, 7183.CrossRefGoogle ScholarPubMed
Belluz, J. (2018, April 19). Companies like Starbucks love anti-bias training. But it doesn’t work – and may backfire. Vox. Retrieved from https://www.vox.com/science-and-health/2018/4/19/17251752/philadelphia-starbucks-arrest-racial-bias-training)CrossRefGoogle Scholar
Brewer, M. B. (1999). The psychology of prejudice: Ingroup love and outgroup hate? Journal of Social Issues, 55, 429444. doi:10.1111/0022-4537.00126Google Scholar
Brown, D. (2018, June). Google diversity annual report 2018. Available at https://diversity.google/.CrossRefGoogle Scholar
Brown, S. E. V, Sabat, I. E., Follmer, K. B., Jenkins, E., & Martinez, L. R. (2018). At the intersection of sex and heterosexism: Perceptions of same-sex harassment. Poster presented at the 33rd Annual SIOP Conference, Chicago, IL.Google Scholar
Brubaker, S. J. (2009). Sexual assault prevalence, reporting and policies: Comparing college and university campuses and military service academies. Security Journal, 22, 5672. doi:10.1057/sj.2008.10Google Scholar
Buchanan, N. T., Settles, I. H., Hall, A. T., & O’Connor, R. C. (2014). A review of organizational strategies for reducing sexual harassment: Insights from the US military. Journal of Social Issues, 70, 687702. doi:10.1111/josi.12086CrossRefGoogle Scholar
Burns, V. L., Eaton, A. A., Long, H., & Zapp, D. (2019). Exploring the role of race and gender on perceived bystander ability and intent: Findings before and after exposure to an online training program to prevent sexual assault on campus. Violence Against Women, 25, 9991017. doi:10.1177%2F1077801218807089CrossRefGoogle Scholar
Cacioppo, J. T., Adler, A. B., Lester, P. B., McGurk, D., Thomas, J. L., Chen, H.-Y., & Cacioppo, S. (2015). Building social resilience in soldiers: A double dissociative randomized controlled study. Journal of Personality and Social Psychology, 109, 90105. doi:10.1037/pspi0000022CrossRefGoogle Scholar
Cacioppo, J. T., Reis, H. T., & Zautra, A. J. (2011). Social resilience: The value of social fitness with an application to the military. American Psychologist, 66, 4351. doi:10.1037/a0021419CrossRefGoogle ScholarPubMed
Campbell, J. P., Kuncel, N. R., & Kostal, J. W. (2018). Training and learning in work roles. In Ones, D. S., Anderson, N., Viswesvaran, C., & Kepir Sinangil, H. (Eds.), The SAGE handbook of industrial, work, and organizational psychology: Personnel psychology and employee performance (2nd ed., pp. 533610). London, England: SAGE Publications Ltd.CrossRefGoogle ScholarPubMed
Centers for Disease Control and Prevention. (2004). The bully-sexual violence pathway in early adolescence (white paper). Atlanta, GA: Centers for Disease Control and Prevention.Google Scholar
Chabris, C., & Brown, M. (2018, April 25). Starbucks’s troubles can be a test for anti-bias training: Does it work? Wall Street Journal. Retrieved from https://www.wsj.com/articles/starbuckss-troubles-can-be-a-test-for-anti-bias-training-does-it-work-1524669057Google Scholar
Coker, A. L., Bush, H. M., Fisher, B. S., Swan, S. C., Williams, C. M., Clear, E. R., & DeGue, S. (2016). Multi-college bystander intervention evaluation for violence prevention. American Journal of Preventive Medicine, 50, 295302.Google Scholar
Coker, A. L., Cook-Craig, P., Williams, C. M., Fisher, B. S., Clear, E. R., Garcia, L. S., & Hegge, L. M. (2011). Evaluation of green dot: An active bystander intervention to reduce sexual violence on college campuses. Violence Against Women, 17, 777796.CrossRefGoogle ScholarPubMed
Coker, A. L., Fisher, B. S., Bush, H. M., Williams, C. M., Clear, E. R., & DeGue, S. (2015). Evaluation of the green dot bystander intervention to reduce interpersonal violence among college students across three campuses. Violence Against Women, 21, 15071527.CrossRefGoogle ScholarPubMed
Cialdini, R. B., Demaine, L. J., Sagarin, B. J., Barrett, D. W., Rhoads, K., & Winter, P. L. (2006). Managing social norms for persuasive impact. Social Influence, 1, 315. doi:10.1080/15534510500181459CrossRefGoogle ScholarPubMed
Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85, 678707. doi:10.1037//0021-9010.g5.5.678CrossRefGoogle Scholar
Cortina, L. M., Rabelo, V. C., & Holland, K. J. (2018.) Beyond blaming the victim: Toward a more progressive understanding of workplace mistreatment. Industrial and Organizational Psychology, 11, 81100. doi:10.1017/iop.2017.54CrossRefGoogle ScholarPubMed
Curtis, E. F., & Dreachslin, J. L. (2008). Diversity management interventions and organizational performance: A synthesis of current literature. Human Resource Development Review, 7, 107134. doi:10.1177/1534484307311700CrossRefGoogle Scholar
DeGue, S., Valle, L. A., Holt, M. K., Massetti, G. M., Matjasko, J. L., & Tharp, A. T. (2014). A systematic review of primary prevention strategies for sexual violence perpetration. Aggression and Violent Behavior, 19, 346362. doi:10.1016/j.avb.2014.05.004CrossRefGoogle Scholar
Devine, P. G., Forscher, P. S., Austin, A. J., & Cox, W. T. L. (2012). Long-term reduction in implicit race bias: A prejudice habit-breaking intervention. Journal of Experimental Social Psychology, 48, 12671278. doi:10.1016/j.jesp.2012.06.003CrossRefGoogle ScholarPubMed
Diamond-Welch, B. K., Hetzel-Riggin, M. D., & Hemingway, J. A. (2016). The willingness of college students to intervene in sexual assault situations: Attitude and behavior differences by gender, race, age, and community of origin. Violence and Gender, 3, 4954. doi:10.1089/vio.2015.0023CrossRefGoogle ScholarPubMed
Dobbin, F., & Kalev, A. (2016, July–August). Why diversity programs fail. Harvard Business Review. Retrieved from https://hbr.org/2016/07/why-diversity-programs-failCrossRefGoogle Scholar
Edwards, K. M., Mattingly, M. J., Dixon, K. J., & Banyard, V. L. (2014). Community matters: Intimate partner violence among rural young adults. American Journal of Community Psychology, 53, 198207.Google Scholar
Farris, C., Jaycox, L. H., Schell, T. L., Street, A., Farris, C., Kilpatrick, D., & Tanielian, T. (2015). Sexual harassment and gender discrimination findings: Active component. In Morral, A. R., Gore, K. L., & Schell, T. L. (Eds.), Sexual assault and sexual harassment in the U.S. military, volume 2: Estimates for Department of Defense Service Members from the 2014 RAND Military Workplace Study (pp. 3154, technical report #RAND-RR870z2-1). Santa Monica, CA: RAND Corporation.10.1007/s10464-014-9633-7CrossRefGoogle ScholarPubMed
Fedina, L., Holmes, J. L., & Backes, B. L. (2018). Campus sexual assault: A systematic review of prevalence research from 2000 to 2015. Trauma, Violence, & Abuse, 19, 7693. doi:10.1177/1524838016631129Google Scholar
Fitzgerald, L. F., Drasgow, F., Hulin, C. L., Gelfand, M. J., & Magley, V. J. (1997). Antecedents and consequences of sexual harassment in organizations: A test of an integrated model. Journal of Applied Psychology, 82, 578589. doi:10.1037/0021-9010.82.4.578CrossRefGoogle ScholarPubMed
Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A. (2019). A meta-analysis of procedures to change implicit measures. Journal of Personality & Social Psychology: Attitudes and Social Cognition, 117(3), 522559. doi:10.1037/pspa0000160CrossRefGoogle ScholarPubMed
Forscher, P. S., Mitamura, C., Dix, E. L., Cox, W. T. L., & Devine, P. G. (2017). Breaking the prejudice habit: Mechanisms, timecourse, and longevity. Journal of Experimental Social Psychology, 72, 133146. doi:10.1016/j.jesp.2017.04.009CrossRefGoogle ScholarPubMed
Foubert, J. D., & Perry, B. C. (2007). Creating lasting attitude and behavior change in fraternity members and male student athletes: The qualitative impact of an empathy-based rape prevention program. Violence Against Women, 13, 7086.CrossRefGoogle ScholarPubMed
Gelfand, M. J., Fitzgerald, L. F., & Drasgow, F. (1995). The structure of sexual harassment: A confirmatory analysis across cultures and settings. Journal of Vocational Behavior, 47, 164177.CrossRefGoogle ScholarPubMed
Ghumman, S., Ryan, A. M., & Park, J. S. (2016). Religious harassment in the workplace: An examination of observer intervention. Journal of Organizational Behavior, 37, 279306. doi:10.1002/job.2044CrossRefGoogle Scholar
Glomb, T. M., Munson, L. J., Hulin, C. L., Bergman, M. E., & Drasgow, F. (1999). Structural equation models of sexual harassment: Longitudinal explorations and cross-sectional generalizations. Journal of Applied Psychology, 84, 1428.CrossRefGoogle Scholar
Glomb, T. M., Richman, W. L., Hulin, C. L., Drasgow, F., Schneider, K. T., & Fitzgerald, L. F. (1997). Ambient sexual harassment: An integrated model of antecedents and consequences. Organizational Behavior and Human Decision Processes, 71, 309328.CrossRefGoogle ScholarPubMed
Goldberg, C. B. (2011) What do we really know about sexual harassment training effectiveness? In Paludi, M. A. (Ed.), Praeger handbook on understanding and preventing workplace discrimination (Vol. 2, pp. 4548). Santa Barbara, CA: Praeger.CrossRefGoogle Scholar
Goldman, B. M., Gutek, B. A., Stein, J. H., & Lewis, K. (2006). Employment discrimination in organizations: Antecedents and consequences. Journal of Management, 32, 786830. doi:10.117710149206306293544Google Scholar
Hauenstein, N. M. A., Findlay, R. A., & McDonald, D. P. (2010). Using situational judgment tests to assess training effectiveness: Lessons learned evaluating military equal opportunity advisor trainees. Military Psychology, 22, 262281. doi:10.1080/089956052010492679CrossRefGoogle Scholar
Hebl, M. R., Bigazzi Foster, J., Mannix, L. M., & Dovidio, J. F. (2002). Formal and interpersonal discrimination: A field study of bias toward homosexual applicants. Personality and Social Psychology Bulletin, 28, 815825.Google Scholar
Holladay, C. L., Knight, J. L., Paige, D. L., & Quiñones, M. A. (2003). The influence of framing on attitudes toward diversity training. Human Resource Development Quarterly, 14, 245263. doi:10.1002/hrdq.1065CrossRefGoogle Scholar
Huselid, M. A. (1995). The impact of human resource management practices on turnover, productivity, and corporate financial performance. Academy of Management Journal, 38, 635672.CrossRefGoogle Scholar
Hussey, I., & De Houwer, J. (unpublished manuscript). Completing a race IAT increases implicit racial bias. Retrieved from https://doi.org/10.31234/osf.io/vxsj7CrossRefGoogle Scholar
Jaycox, L. H., Schell, T. L., Morral, A. R., Street, A., Farris, C., Kilpatrick, D., & Tanielian, T. (2015). Sexual assault findings: Active component. In Morral, A. R., Gore, K. L., and Schell, T. L. (Eds.), Sexual assault and sexual harassment in the U.S. military, volume 2: Estimates for Department of Defense Service Members from the 2014 RAND Military Workplace Study (pp. 930, technical report #RAND-RR870z2-1). Santa Monica, CA: RAND Corporation.Google Scholar
Jefferson, H., & Lewis, N. Jr. (2018, April 23). Starbucks won’t have any idea whether its diversity training works. Washington Post. Retrieved from https://www.washingtonpost.com/news/posteverything/wp/2018/04/23/starbucks-wont-have-any-idea-whether-its-diversity-training-works/?noredirect=on&utm_term=.43ea30c1b395).CrossRefGoogle Scholar
Johnson, P. A., Bidnall, S. E., & Benya, F. F. (Eds.) (2018). Sexual harassment of women: Climate, culture, and consequences in academic sciences, engineering, and medicine. Washington, DC: The National Academies Press.Google Scholar
Jones, K. P., Arena, D. F., Nittrouer, C. L., Alonso, N. M., & Lindsey, A. P. (2017). Subtle discrimination in the workplace: A vicious cycle. Industrial and Organizational Psychology: Perspectives on Science and Practice, 10, 5176. doi:10.1017/iop.2016.91Google Scholar
Kalinoski, Z. T., Steele-Johnson, D., Peyton, E. J., Leas, K. A., Steinke, J., & Bowling, N. A. (2013). A meta-analytic evaluation of diversity training outcomes. Journal of Organizational Behavior, 34, 10761104. doi:10.1002/job.1839Google Scholar
Kalev, A., Dobbin, F., & Kelly, E. (2006). Best practices or best guesses? Assessing the efficacy of corporate affirmative action and diversity policies. American Sociological Review, 71, 589617.CrossRefGoogle Scholar
Kapor Center for Social Impact. (2017). Teach leavers study: A first-of-its-kind analysis of why people voluntarily left jobs in tech (white paper). Retrieved from https://www.kaporcenter.org/wp-content/uploads/2017/08/TechLeavers2017.pdfCrossRefGoogle Scholar
Kath, L. M., & Magley, V.J. (2014). Development of a theoretically grounded model of sexual harassment awareness training effectiveness. In Chen, P.-Y. and Cooper, C. L. (Eds.), Work and Wellbeing: Wellbeing: A Complete Reference Guide, Volume III (pp. 319339). London, England: John Wiley & Sons, Ltd.CrossRefGoogle Scholar
Kaylor, L., & Weaver, T. (2018). An examination of work-related factors that may impact military sexual trauma (Doctoral dissertation, St. Louis University, St. Louis, MO).CrossRefGoogle Scholar
Keenan, J. P. (2002). Whistleblowing: a study of managerial differences. Employee Responsibilities and Rights Journal, 14, 1732. doi:10.1023/A:1015796528233.Google Scholar
Kim, Y., & Ployhart, R. E. (2014). The effects of staffing and training on firm productivity and profit growth before, during, and after the Great Recession (monograph). Journal of Applied Psychology, 99, 361389. doi:10.1037/a0035408Google Scholar
Kish-Gephart, J. J., Harrison, D. A., & Treviño, L. K. (2010). Bad apples, bad cases, and bad barrels: Meta-analytic evidence about sources of unethical decisions at work. Journal of Applied Psychology, 95, 131. doi:10.1037/a0017103Google Scholar
Kleinsasser, A., Jouriles, E. N., McDonald, R., & Rosenfield, D. (2015). An online bystander intervention program for the prevention of sexual violence. Psychology of Violence, 5, 227235. doi:10.1037/a0037393CrossRefGoogle Scholar
Kulik, C. T., Pepper, M. B., Roberson, L., & Parker, S. K. (2007). The rich get richer: Predicting participation in voluntary diversity training. Journal of Organizational Behavior, 28, 753769. doi:10.1002/job.444CrossRefGoogle Scholar
Kulik, C. T., & Roberson, L. (2008). Common goals and golden opportunities: Evaluations of diversity education in in academic and organizational settings. Academy of Management Learning and Education, 7, 309331.CrossRefGoogle ScholarPubMed
Lacerenza, C. N., Reyes, D. L., Marlow, S. L., Joseph, D. L., & Salas, E. (2017). Leadership training design, delivery, and implementation: A meta-analysis. Journal of Applied Psychology, 102, 16861718. doi:10.1037/apl0000241CrossRefGoogle ScholarPubMed
Lai, C. K. (2019, February 7). A meta-analysis of change in implicit bias and behavior. Presentation at the annual Personality and Social Psychology conference, Portland, OR. Slides available at osf.io/3unva/.CrossRefGoogle Scholar
Lai, C. K., Haidt, J., & Nosek, B. A. (2014). Moral elevation reduces prejudice against gay men. Cognition and Emotion, 28, 781794. doi:10.1080/02699931.2013.861342CrossRefGoogle Scholar
Lai, C. K., Marini, M., Lehr, S. A., Cerruti, C., Shin, J.-E. L., Joy-Gaba, J. A., … Nosek, B. A. (2014). Reducing implicit racial preferences: I. A comparative investigation of 17 interventions. Journal of Experimental Psychology: General, 143, 17651785. doi:10.1037/a0036260CrossRefGoogle ScholarPubMed
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, B., Devos, T., … Nosek, B. A. (2016). Reducing implicit racial preferences: II. Intervention effectiveness across time. Journal of Experimental Psychology: General, 145, 10011016. doi:10.1037/xge0000179Google Scholar
Lee, D. S., Guy, L., Perry, B., Sniffen, C. K., & Mixson, S. A. (2007). Sexual violence prevention. The Prevention Researcher, 14(2), 1520.CrossRefGoogle ScholarPubMed
Leidner, B., Castano, E, Zaiser, E., & Giner-Sorolla, R. (2010). Ingroup glorification, moral disparagement, and justice in the context of collective violence. Personality and Social Psychology Bulletin, 36, 11151129. doi:10.1177/0146167210376391CrossRefGoogle ScholarPubMed
Lim, S., & Cortina, L.M. (2005). Interpersonal mistreatment in the workplace: The interface and impact of general incivility and sexual harassment. Journal of Applied Psychology, 90, 483496. doi:10.1037/0021-9010.90.3.483.CrossRefGoogle ScholarPubMed
Marquis, J. P., Farris, C., Hall, K. C., Kamarck, K. N., Lim, N., Shontz, D., … Wong, E. C. (2017). Improving oversight and coordination of Department of Defense programs that address problematic behaviors among military personnel (Technical report #RR3152). Santa Monica, CA: RAND.Google Scholar
McCall, L. (2005). The complexity of intersectionality. Signs, 30, 17711800.CrossRefGoogle Scholar
McKay, P. F., Avery, D. R., Tonidandel, S., Morris, M. A., Hernandez, M., & Hebl, M. R. (2007). Racial differences in employee retention: Are diversity climate perceptions the key? Personnel Psychology, 60, 3562.CrossRefGoogle ScholarPubMed
Medeiros, K., & Griffith, J. (2019). #Ustoo: How I-O psychologists can extend the conversation on sexual harassment and sexual assault through workplace training. Industrial and Organizational Psychology: Perspectives on Science and Practice, 12(1), 119. doi:10.1017/iop.2018.155Google Scholar
Miller, D. T., & Prentice, D. A. (2016). Changing norms to change behavior. Annual Review of Psychology, 67, 339361. doi:10.1146/annurev-psych-010814-015013CrossRefGoogle Scholar
Morgeson, F. P., Aguinis, H., Waldman, D. A., & Siegel, D. S. (2013). Extending corporate social responsibility research to the human resource management and organizational behavior domains: A look to the future. Personnel Psychology, 66, 805824. doi:10.1111/peps.12055CrossRefGoogle Scholar
Mulvey, K. L., Palmer, S. B., & Abrams, D. (2016). Race-based humor and peer group dynamics in adolescence: Bystander intervention and social exclusion. Child Development, 87, 13791391. doi:10.1111/cdev.12600CrossRefGoogle Scholar
Nelson, J., Dunn, K. M., Paradies, Y., Pederson, A., Sharpe, S., Hynes, M., & Guerin, B. (2010). Review of bystander approaches in support of preventing race-based discrimination. Victorian Health Promotion Foundation (VicHealth), Carlton, Australia. Retrieved from http://www.vichealth.vic.gov.au/~/media/ResourceCentre/PublicationsandResources/Discrimination/Bystander_discrim_review.ashxCrossRefGoogle Scholar
O’Boyle, E. Jr., & Aguinis, H. (2012). The best and the rest: Revisiting the norm of normality of individual performance. Personnel Psychology, 65, 79119.CrossRefGoogle ScholarPubMed
O’Leary-Kelly, A. M., Bowes-Sperry, L., Bates, C. A., & Lean, E. R. (2009). Sexual harassment at work: A decade (plus) of progress. Journal of Management, 35, 503536. doi:10.1177/0149206308330555CrossRefGoogle Scholar
Offermann, L. R., & Malamut, A. B. (2002). When leaders harass: The impact of target perceptions of organizational leadership and climate on harassment reporting and outcomes. Journal of Applied Psychology, 87, 885893. doi:10.1037/0021-9010.87.5.885CrossRefGoogle ScholarPubMed
Osatuke, K., Yanovsky, B., & Ramsel, D. (2017). Executive coaching: New framework for evaluation. Consulting Psychology Journal: Practice and Research, 69, 172186. doi:10.1037/cpb0000073Google Scholar
Pager, D., & Shepherd, H. (2008). The sociology of discrimination: Racial discrimination in employment, housing, credit, and consumer markets. Annual Review of Sociology, 34, 181209.CrossRefGoogle Scholar
Paluck, E. L., & Green, D. P. (2009). Prejudice reduction: What works? A review and assessment of research and practice. Annual Review of Psychology, 60, 339367. doi:10.1146/annurev.psyc.60.110707.163607CrossRefGoogle Scholar
Paluck, E. L., Green, S. A., & Green, D. P. (2019). The contact hypothesis re-evaluated. Behavioural Public Policy, 3(2), 129158. doi:10.1017/bpp.2018.25CrossRefGoogle ScholarPubMed
Phillips, B. N., Deiches, J., Morrison, B., Chan, F., & Bezyak, J. L. (2016). Disability diversity training in the workplace: Systematic review and future directions. Journal of Occupational Rehabilitation, 26, 264275. doi:10.1007/s10926-015-9612-3CrossRefGoogle Scholar
Pina, A., Gannon, T. A., & Saunders, B. (2009). An overview of the literature on sexual harassment: Perpetrator, theory, and treatment issues. Aggression and Violent Behavior, 14, 126138. doi:10.1016/j.avb.2009.01.002CrossRefGoogle ScholarPubMed
Porath, C. L., Gerbasi, A., & Schorch, S. L. (2015). The effects of civility on advice, leadership, and performance. Journal of Applied Psychology, 100, 15271541. http://dx.doi.org/10.1037/apl0000016CrossRefGoogle ScholarPubMed
Robb, L. A., & Doverspike, D. (2001). Self-reported proclivity to harass as a moderator of the effectiveness of sexual harassment-prevention training. Psychological Reports, 88, 8588.CrossRefGoogle Scholar
Rubino, C., Avery, D. R., McKay, P. F., Moore, B. L., Wilson, D. C., Van Driel, M. S., … McDonald, D. P. (2018). And justice for all: How organizational justice climate deters sexual harassment. Personnel Psychology, 71, 519544. doi:10.1111/peps.12274CrossRefGoogle ScholarPubMed
Ruggs, E. N., Martinez, L. R., & Hebl, M. R. (2011). How individuals and organizations can reduce interpersonal discrimination. Social and Personality Psychology Compass, 5, 2942. doi:10.1111/j.1751-9004.2010.00332.xCrossRefGoogle Scholar
Sackett, P. R. (2002). The structure of counterproductive work behaviors: Dimensionality and relationships with facets of job performance. International Journal of Selection and Assessment, 10, 511.CrossRefGoogle Scholar
Sadler, A. G., Mengeling, M. A., Booth, B. M., O’Shea, A. M. J., & Torner, J. C. (2017). The relationship between U.S. military officer leadership behaviors and risk of sexual assault of Reserve, National Guard, and active component servicewomen in nondeployed locations. American Journal of Public Health, 107, 147155. doi:10.2105/AJPH.2016.303520CrossRefGoogle ScholarPubMed
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012). The science of training and development in organizations: What matters in practice. Psychological Sciences in the Public Interest, 13, 74101. doi:10.1177/1529100612436661CrossRefGoogle Scholar
Senn, C. Y., & Forrest, A. (2015). “And then one night when I went to class …”: The impact of sexual assault bystander intervention workshops incorporated in academic courses. Psychology of Violence, 6, 607618.CrossRefGoogle Scholar
Settles, I. H., & Buchanan, N. T. (2014). Multiple groups, multiple identities, and intersectionality. In Benet-Martínez, V. & Hong, Y. (Eds.), The Oxford handbook of multicultural identity (pp. 160180). New York, NY: Oxford University Press.CrossRefGoogle Scholar
Shields, S. A. (2008). Gender: An intersectionality perspective. Sex Roles, 59(5–6), 301311.CrossRefGoogle ScholarPubMed
Sickler, J. (2018, May 2). What does a bad business reputation cost? Retrieved from https://www.commpro.biz/what-does-a-bad-business-reputation-cost/CrossRefGoogle ScholarPubMed
Society for Industrial and Organizational Psycholog y, Inc. (2016). Guidelines for education and training in industrial-organizational psychology. Bowling Green, OH: Author. Available at http://www.siop.org/Instruct/SIOP_ET_Guidelines_2017.pdf.CrossRefGoogle Scholar
Starbucks. (2018, April 17). (News release.) Starbucks to close all stores nationwide for racial-bias education on May 29. Retrieved from https://news.starbucks.com/press-releases/starbucks-to-close-stores-nationwide-for-racial-bias-education-may-29Google Scholar
State of New South Wales, Department of Premier and Cabinet, Behavioral Insights Unit (2016, August). Behavioural approaches to increasing workforce diversity (white paper). State of New South Wales, Australia. Retrieved from https://bi.dpc.nsw.gov.au/.CrossRefGoogle Scholar
Tankard, M. E., & Paluck, E. L. (2016). Norm perception as a vehicle for social change. Social Issues and Policy Review, 10, 181211. doi:10.1111/sipr.12022Google Scholar
Triana, M. del C., Jayasinghe, M., & Pieper, J. R. (2015). Perceived workplace racial discrimination and its correlates: A meta-analysis. Journal of Organizational Behavior, 36, 491513. doi:10.1002/job.1988Google Scholar
U.S. Department of Justice. (2018, June). Review of gender equity in the Department’s law enforcement components (technical report #18-03). Washington, DC: U.S. Department of Justice, Office of the Inspector General, Evaluation and Inspections Division. Retrieved from https://oig.justice.gov/reports/2018/e1803.pdf#page=1Google Scholar
U.S. Code of Federal Regulation, Title 29, Subtitle B, Chapter XIV, Part 1604, Section 1604.11. Retrieved from https://www.law.cornell.edu/cfr/text/29/1604.11Google Scholar
U.S. Equal Employment Opportunity Commission. (n.d.). Enforcement and litigation statistics. Retrieved from https://www.eeoc.gov/eeoc/statistics/enforcement/CrossRefGoogle Scholar
U.S. Government Accountability Office. (2017). Sexual violence: Actions needed to improve DOD’s efforts to address the continuum of unwanted sexual behaviors (report # GAO-18-33). Washington, DC: U.S. Government Accountability Office.CrossRefGoogle Scholar
U.S. Merit Systems Protection Board. (2014, May). Sexual orientation and the federal workplace: Policy and perception. Washington, DC: U.S. Merit Systems Protection Board.Google Scholar
U.S. Merit Systems Protection Board. (2018a). Update on sexual harassment in the federal workplace. Washington, DC: U.S. Merit Systems Protection Board.Google Scholar
U.S. Merit Systems Protection Board. (2018b, May). Issues of merit. Washington, DC: U.S. Merit Systems Protection Board.Google Scholar
Walton, G. M., & Cohen, G. L. (2007). A question of belonging: Race, social fit, and achievement. Journal of Personality and Social Psychology, 92, 8296. doi:10.1037/0022-3514.92.1.82Google Scholar
Wasti, S. A., Bergman, M. E., Glomb, T. M., & Drasgow, F. (2000). Test of the cross-cultural generalizability of a model of sexual harassment. Journal of Applied Psychology, 85, 766778.Google Scholar
Weir, K. (2018, July/August). Psychological testing and assessments are going high-tech. Monitor on Psychology, 49(7), 34. Retrieved from https://www.apa.org/monitor/2018/07-08/ce-corner.aspx.Google Scholar
Wilkins, N., Tsao, B., Hertz, M., Davis, R., & Klevens, J. (2014). Connecting the dots: An overview of the links among multiple forms of violence (technical report). Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.Google Scholar
Williams, J. H., Fitzgerald, L. F., & Drasgow, F. (1999). The effects of organizational practices on sexual harassment and individual outcomes in the military. Military Psychology, 11, 303328.CrossRefGoogle ScholarPubMed
Willness, C. R., Steel, P., & Lee, K. (2007). A meta-analysis of the antecedents and consequences of workplace sexual harassment. Personnel Psychology, 60, 127162.CrossRefGoogle Scholar