Hostname: page-component-745bb68f8f-kw2vx Total loading time: 0 Render date: 2025-02-11T11:16:28.388Z Has data issue: false hasContentIssue false

Communication and Collective Actions: A Survey Experiment on Motivating Energy Conservation in the U.S.

Published online by Cambridge University Press:  20 August 2014

Toby Bolsen
Affiliation:
Georgia State University, 38 Peachtree Center Avenue, Atlanta, GA 30303, USA, e-mail: tobybolsen@gmail.com
James N. Druckman
Affiliation:
Northwestern University, Scott Hall 601 University Place, Evanston, IL 60208, USA, e-mail: druckman@northwestern.edu
Fay Lomax Cook
Affiliation:
Northwestern University, 2040 Sheridan Road, Evanston, IL 60208, USA, e-mail: flc943@northwestern.edu
Rights & Permissions [Opens in a new window]

Abstract

When do citizens take action to benefit the public good, even when individual benefits are scant or non-existent? We address this question with a focus on an area of critical importance when it comes to environmental sustainability—specifically, we examine citizens' actions in the domain of energy conservation. We do so by using a survey experiment to evaluate the impact of exposure to communications posited to shape collective action behavior. We find that communications shape behavior depending on two primary factors not previously studied in concert: to whom responsibility is attributed for collective outcomes; and, what effects, or consequences, are associated with one's actions. We find that communications emphasizing individual responsibility and collective environmental benefits can stimulate collective action.

Type
Research Article
Copyright
Copyright © The Experimental Research Section of the American Political Science Association 2014 

INTRODUCTION

When do citizens take action to benefit the public good, even when individual benefits are scant or non-existent? In this paper, we explore when exposure to communications induces citizens to engage in collective actions on their own volition: a topic that has received little direct attention despite the large literature on why citizens engage in collective actions. We focus on a) how communications affect attributions of responsibility for collective outcomes and b) how communications that highlight positive or negative effects resulting from an action shape individuals’ willingness to act for the collective good. We attend to two classes of behavior in the domain of energy conservation, which is an area of critical importance when it comes to environmental sustainability. Specifically, we study 1) investment behaviors including capital outlays for goods such as insulating one’s home; and, 2) curtailment behaviors that entail decreasing the amount of energy one consumes such as adjusting ambient home temperature to save energy (Black et al., Reference Black, Stern and Elworth1985; Sears et al., Reference Sears, Tyler, Citrin and Kinder1978; Stern Reference Stern2000). We find that stimulating collective action to conserve energy is challenging, but not impossible, because it requires communications that emphasize both individual responsibility and collective environmental benefits.

COMMUNICATION AND COLLECTIVE ACTION

Considerable work, including various types of experiments, explores why individuals engage in a collective action (e.g., Andreoni and Croson Reference Andreoni and Croson2008; Coleman and Steed Reference Coleman and Steed2009; Dawes and Thaler Reference Dawes and Thaler1988; Fehr and Gächter Reference Fehr and Gächter2000; Hamman et al., Reference Hamman, Weber and Woon2011; Ostrom et al., Reference Ostrom, Walker and Gardner1992). Yet, this literature has studied a limited variation in the content of what is communicated to individuals (Coleman and Ostrom Reference Coleman, Ostrom, Druckman, Green, Kuklinski and Lupia2011). Our study is about communications that could be encountered through mass media, inter-personal discussion, and / or some form of new media. In their review of the literature on experimental research on collective action, Coleman and Ostrom (Reference Coleman, Ostrom, Druckman, Green, Kuklinski and Lupia2011) note that communication “has a profound effect” yet it has barely been studied (p. 343).Footnote 1

Our goal is to fill this gap in the literature. We focus on two types of communications that collective action models of behavior suggest matter: first, the likely costs and benefits resulting from the action (e.g., Olson Reference Olson1965); and second, one’s perceived “duty” or responsibility to act (Riker and Ordeshook Reference Riker and Ordeshook1968). Unlike prior work, we influence these perceptions via exposure to communications that come in the form of frames which, for us, are part of a story line in describing an issue, highlighting certain aspects of reality at the expense of others (e.g., Druckman Reference Druckman2001; Gamson Reference Gamson1992). An enormous literature demonstrates that frames can and do shape individuals’ attitudes and behaviors (see Druckman Reference Druckman and Keren2011).

We focus on two types of emphasis frames.Footnote 2 The first type is an attribution frame (Iyengar Reference Iyengar1991) – that is, descriptions of who is primarily responsible for providing a collective good. We expect attributions of responsibility to affect collective action behavior primarily because frames that directly link individuals’ decisions with collective outcomes are central to mobilizing collective action (e.g., Polletta and Ho Reference Polletta, Ho, Gooden and Tilly2006). The more one sees individuals’ actions as responsible for the collective outcome, the more likely they are to perceive that their own action will be impactful, which is a key determinant of whether or not individuals engage in collective actions (Finkel and Mueller Reference Finkel and Muller1998; Finkel et al., Reference Finkel, Muller and Opp1989; Lubell Reference Lubell2002; Lubell et al., Reference Lubell, Zahran and Vedlitz2007; Riker and Ordeshook Reference Riker and Ordeshook1968). Frames that attribute responsibility to individuals for collective outcomes also may resonate with a deeply entrenched value of individualism in American culture (Feldman Reference Feldman1988). On the other hand, the more one sees government as responsible for coordinating individuals’ actions to promote positive collective outcomes the less likely one is to take action because it will not been seen as impactful.

Hypothesis 1: Individuals will be more likely to engage in a collective action following exposure to a frame that emphasizes individuals’ responsibility for collective outcomes, all else constant.

Hypothesis 2: Individuals will be less likely to engage in a collective action following exposure to a frame that emphasizes the government’s responsibility for collective outcomes, all else constant.

The other type of frame we explore highlights the costs and benefits associated with taking action. We analyzed news articles from The New York Times (NYT) and The USA Today from June 2008 to June 2009 that included one of the following terms in the headline or lead paragraph: “energy policy,” “energy crisis,” “energy shortage,” or “energy plan.”Footnote 3 We found that the most prominent frames when it comes to energy conservation are: (1) the environmental benefits associated with taking action (a frame appearing in 55% of the articles); and, (2) the upfront costs for investments versus immediate savings for curtailment (a frame appearing in 48% of the articles) .We use a “cost frame” to examine a communication that primes an important consideration in this domain of behavior. Our choice of frames thus has a theoretical basis in a canonical collection action model and an empirical one given the results from our content analysis.

Hypothesis 3: Individuals will be more likely to engage in energy conservation (which can be construed as a collective action) following exposure to a frame that emphasizes its environmental benefits, all else constant.

Hypothesis 4: Individuals will be less likely to engage in energy investment behaviors (which can be construed as a collective action) following exposure to a frame that emphasizes the costs to consumers, but more likely to engage in energy curtailment behaviors (since they would save those costs), all else constant.

Hypothesis 4 highlights a key distinction between the two types of conservation behaviors we examine. Energy curtailment involves reducing one’s consumption of energy, which saves money but also may involve sacrifices (Stern Reference Stern2000). Capital investments, meanwhile, usually require spending additional money up-front in order to potentially reap long-term savings.

We also offer two straightforward predictions that follow directly from our prior hypotheses.

Hypothesis 5: Individuals will be more likely to engage in a collective action following exposure to a frame that emphasizes the benefits resulting from one’s actions (e.g., environmental benefits) and individuals’ responsibility for collective outcomes, all else constant.

Hypothesis 6: Individuals will be less likely to engage in energy investment behaviors following exposure to a frame that emphasizes the costs to consumers and the government’s responsibility for collective outcomes, all else constant.

SURVEY EXPERIMENT

We implemented a survey experiment in August 2010 to test our hypotheses. We used the Internet to draw a representative sample of 1,600 members of the U.S. population.Footnote 4 The composition of our sample is nearly identical to the 2012 ANES sample in terms of party identification and ethnicity (details are available in the online supplementary appendix); however, as is typical of web-based surveys (Malhotra and Krosnick Reference Malhotra and Krosnick2007), our sample is slightly more educated and interested in politics. Using procedures outlined by Bloom (Reference Bloom1995), power analyses reveal that the experimental design could detect moderate treatment effects with a high degree of statistical power, and thus, we are confident that the N was sufficient (details are available in the online supplementary appendix). Participants completed an initial battery of attitudinal and demographic questions, and then were exposed to one of the treatments described below, which randomly assigned participants to one of nine conditions that manipulated the attribution of responsibility frame (none, individual, government) and an effect frame (none, environment, costs). The appendix reports the wording of the treatments and order of the questions.

We manipulated responsibility attributions by asking respondents to read a statement about the agent responsible for dealing with the nation’s energy situation. The individual attribution treatment stated, “The ultimate success of our nation’s energy policy depends largely on individuals’ choices about energy consumption. Individuals need to step up to the plate – something they have done throughout American history without having to rely on the government.” The government attribution treatment stated, “The ultimate success of our nation’s energy policy depends largely on governmental decisions about the energy supply. Government needs to step up to the plate – something they often do when individuals alone cannot resolve a problem.

We manipulated the consequences associated with an action by including a statement about its economic or environmental effects. The cost frame stated, “These choices have important economic consequences. For instance, switching from regular light bulbs to energy saving bulbs will cost consumers, in general, billions of dollars each year by causing them to pay a cost premium.” The environmental frame stated, “These choices have important environmental consequences. For instance, switching from regular light bulbs to energy saving bulbs will help ensure that individuals, in general, live in a healthy environment by saving the world from millions of metric tons of greenhouse gases.” Importantly, in employing these frames, we ensured that they were equally effective/strong via a pre-test (see Chong and Druckman Reference Chong and Druckman2007).Footnote 5

Dependent Measures

We chose to focus on behaviors people were likely able to perform: (1) investing in insulation for one’s home or apartment; and, (2) adjusting one’s home thermostat setting to save energy. We included three dependent measures for investment behaviors that were asked immediately after exposure to one of the experimental treatments. First, respondents were asked: “How likely are you to invest in insulation or weatherization for your home or apartment?” on a 7-point fully labeled scale ranging from 1 = “extremely unlikely” to 7 = “extremely likely.” We follow others in using a self-reported intention measure to study behavior in this domain (e.g., Lubell et al., Reference Lubell, Zahran and Vedlitz2007; Sears et al., Reference Sears, Tyler, Citrin and Kinder1978).Footnote 6 Second, we measure information-seeking behavior by asking respondents: “Would you be interested in receiving more information about how to insulate or weatherize your home or apartment?” If the answer was “yes,” then participants were asked to provide their email address to receive one email with the corresponding information from a non-profit, non-partisan organization. We focus on participants who actually provided an email address. This is a unique measure as it is an actual rather than intended behavior. Third, we asked respondents: “What is the maximum amount you would be willing to spend to insulate or weatherize your home or apartment to save energy? Enter an amount ranging from $0 to $500” (akin to a contingent valuation measure; see Green et al., Reference Green, Jackowitz, Kahneman and McFadden1998).

We included two dependent measures for curtailment behaviors. First, respondents were asked: “How likely are you to lower your thermostat setting in the winter and/or raise the setting in the summer to save energy?” on a 7-point fully labeled scale ranging from 1 = “extremely unlikely” to 7 = “extremely likely.” We measured information-seeking behavior by asking respondents if they would like to receive more information “about Smart Energy Meters that save energy” in an email.Footnote 7

RESULTS

Table 1 presents the means, standard deviations, Ns, and 95% confidence intervals for the estimated means for each condition.Footnote 8 We indicate statistical significance in Table 1 from difference of means tests relative to the no attribution, no consequence condition labeled condition 1 in Table 1.Footnote 9 We found that random assignment produced assigned groups that had similar background/demographic attributes and that all main effects are robust when a host of controls are included. (Details are available in the online supplementary appendix) We also report, at the bottom of Table 1, the results from five individual models estimating the joint significance of the experimental conditions relative to the control group baseline (condition 1) for each dependent variable. The tests confirm that the conditions are jointly and significantly different from the control group baseline for each model.

Table 1 Experimental Treatment Effects on Dependent Measures

Note: Entries in each cell report the mean for each respective dependent measure (see column headings), standard deviation (in parentheses), 95% confidence interval associated with each estimate (in parentheses), and the N. Baseline condition (control group is in boldface). For model 1 and model 4, 1 = “extremely unlikely” and 7 = “extremely likely.” For model 2 and model 5, 0 = “no” and 1 = “yes.” For model 3, respondents entered an amount ranging from $ 0 to $ 500. **p ≤ .01;*p ≤ .05; # p ≤ .10, one-tailed test.

We conducted joint significance tests for the impact of the experimental conditions on each dependent variable in multivariate analyses relative to the control group (condition 1) and report the following results: model 1, F (8, 1591) = 7.31 (p < .001); model 2, χ2(8) = 38.55 (p < .001); model 3, F (8, 1591) = 7.49 (p < .001); model 4, F (8, 1591) = 6.51 (p < .001); and, model 5, χ2(8) = 58.59 (p < .001).

We find either no support or only marginal support for hypothesis 1, which predicted that the individual responsibility attribution frame on its own would increase investment and curtailment. The frame leads individuals to be more willing to invest in insulation (condition 2, model 1) with marginally significant movement from 4.49 to 4.74; however, the frame does not have an impact on the other behaviors. This may be surprising given individualism is a core value in the U.S.

In contrast, we find support for hypothesis 2 across outcome measures. When responsibility is attributed to the government for collective outcomes, individuals are significantly less likely to invest in insulation (from 4.49 to 4.12, condition 3, model 1), significantly less interested in receiving an email with information on home insulation (from .21 to .14, model 2), willing to pay significantly less to conserve energy (from $232 to $183.41, model 3), significantly less willing to adjust the temperature in their home to save energy (from 5.44 to 5.12, model 4) and significantly less interested in receiving information about Smart Energy Meters (from .18 to .07, model 5).

No support exists for hypothesis 3 that predicts that individuals will be more likely to engage in energy conservation following a frame that emphasizes environmental benefits (see condition 7, Table 1). There are no instances across dependent variables where emphasizing the collective environmental benefits of energy conservation on its own affects behavior. Conversely, we find strong support for hypothesis 4. In the presence of a frame highlighting the costs of these actions to consumers, individuals are significantly less likely to invest in insulation (from 4.49 to 4.13, condition 4, model 1), significantly less likely to request an email seeking information about insulation (from .21 to .14, model 2) and willing to pay significantly less to insulate one’s home or apartment (from $232.00 to $188.90, model 3). We predicted increased curtailment behavior in the presence of an economic effects frame. Highlighting the economic consequences of these actions significantly increases the likelihood of adjusting one’s home thermostat to save energy (from 5.44 to 5.84, model 4) and requests to receive an email with information about Smart Energy Meters (from .18 to .27, model 5). Thus, individual attributions on their own do little but when individual benefits are highlighted, people act.

We also find strong support for hypothesis 5. Exposure to an individual responsibility attribution frame combined with a frame highlighting the collective environmental benefits of taking action causes individuals to be significantly more likely to report a willingness to make investments to conserve energy (from 4.49 to 4.94), more interested in receiving an email with information about how to insulate one’s home or apartment (from .21 to .31), and willing to pay more to insulate one’s home (from $232.00 to $286.24) (see condition 8, Table 1). Similarly, with respect to curtailment behaviors, individuals exposed to this combination of frames are more willing to adjust the home thermostat (from 5.44 to 5.74, model 4) and request information (from .18 to .28, model 5). We also find strong support for hypothesis 6 that a cost frame paired with a government attribution of responsibility frame would decrease individuals’ willingness to make investments (see condition 6, models 1–3). Indeed, the results indicate that receiving this combination of frames significantly decreases reported willingness to insulate one’s home (from 4.49 to 4.00), requests for information (from .21 to .14), and willingness to pay for investments (from $232.00 to $181.35). On the other hand, with respect to curtailment behaviors (see condition 6, models 4–5), the economic effects frame trumps the attribution frame and leads people to become significantly more willing to take action as a way to save money.

Although we did not offer explicit hypotheses for the conditions in which there were directionally opposed frames consisting of competing responsibility attribution and distinct effect frames (conditions 5 and 9), we see in both instances that it is the negative (anti-investment) frame that is stronger in demobilizing investment behaviors. The combination of the negative and positive frames significantly decreases the likelihood of investment behaviors in the range of 5% to 10%. We suspect this reflects a negativity bias (e.g., Baumeister et al., Reference Baumeister, Bratslavsky, Finckenauer and Vohs2001). The combination of the individual responsibility attribution frame and an economic effects frame (condition 5, models 4–5) increases the likelihood of curtailment behaviors.

CONCLUSION

We find that communications influence whether or not individuals intend to engage in collective actions. Nonetheless, mobilizing individuals to engage in energy-conservation-related collective action is challenging because it requires both persuading people to attribute responsibility to themselves and emphasizing that positive collective benefits will occur as a result (in support of hypothesis 5). Counter to hypothesis 1 and hypothesis 3, an individual responsibility attribution frame and an environmental benefits frame in isolation did not increase action. In contrast, in support of hypotheses 2, 4, and 6, demobilization is easier because emphasizing either the economic consequences (e.g., costs of investments) and/or attributing responsibility to the government decreases individuals’ willingness to act.

Our results are consistent with evidence from field experiments that find exposure to different types of communications can significantly affect household electricity usage (Allcott Reference Allcott2011; Ayres et al., Reference Ayres, Raseman and Shih2009). However, as opposed to these studies, we do not examine the extent to which the treatment effects we uncover persist over time. Extant work on communication effects suggests that they endure only under certain conditions; for instance, following repeated exposure to communications or arguments (Druckman et al., Reference Druckman, Fein and Leeper2012; Cacioppo and Petty Reference Cacioppo and Petty1989; Moons et al., Reference Moons, Mackie and Garcia-Marques2009). Finally, the demobilization effect we find is important, especially given that in the aforementioned content analysis we found that government is the agent most often assigned responsibility for the nation’s energy problems. The political implications of this finding may be considerable given that liberals often advocate for a pro-active government on many issues, but in doing so may undercut voluntary efforts to mitigate collective action problems. These are important areas for future work on private-sphere environmentally-relevant behaviors.

SUPPLEMENTARY MATERIAL

To view supplementary material for this paper, please visit http://dx.doi.org/10.1017/S2052263014000025.

Appendix

Condition 1

We are now going to ask you about energy choices you may make.

Condition 2

We are now going to ask you about energy choices you may make. The ultimate success of our nation’s energy policy depends largely on individuals’ choices about energy consumption. Individuals need to step up to the plate—something they have done throughout American history without having to rely on the government.

Condition 3

We are now going to ask you about energy choices you may make. The ultimate success of our nation’s energy policy depends largely on governmental decisions about the energy supply. Government needs to step up to the plate—something they often do when individuals alone cannot resolve a problem.

Condition 4

We are now going to ask you about energy choices you may make. These choices have important economic consequences. For instance, switching from regular light bulbs to energy saving bulbs will cost consumers, in general, billions of dollars each year by causing them to pay a cost premium.

Condition 5

We are now going to ask you about energy choices you may make. These choices have important economic consequences. For instance, switching from regular light bulbs to energy saving bulbs will cost consumers, in general, billions of dollars each year by causing them to pay a cost premium. That said, the ultimate success of our nation’s energy policy depends largely on individuals’ choices about energy consumption. Individuals need to step up to the plate—something they have done throughout American history without having to rely on the government.

Condition 6

We are now going to ask you about energy choices you may make. These choices have important economic consequences. For instance, switching from regular light bulbs to energy saving bulbs will cost consumers, in general, billions of dollars each year by causing them to pay a cost premium. This is why the ultimate success of our nation’s energy policy depends largely on governmental decisions about the energy supply. Government needs to step up to the plate—something they often do when individuals alone cannot resolve a problem.

Condition 7

We are now going to ask you about energy choices you may make. These choices have important environmental consequences. For instance, switching from regular light bulbs to energy saving bulbs will help ensure that individuals, in general, live in a healthy environment by saving the world from millions of metric tons of greenhouse gases.

Condition 8

We are now going to ask you about energy choices you may make. These choices have important environmental consequences. For instance, switching from regular light bulbs to energy saving bulbs will help ensure that individuals, in general, live in a healthy environment by saving the world from millions of metric tons of greenhouse gases. This is why the ultimate success of our nation’s energy policy depends largely on individuals’ choices about energy consumption. Individuals need to step up to the plate—something they have done throughout American history without having to rely on the government.

Condition 9

We are now going to ask you about energy choices you may make. These choices have important environmental consequences. For instance, switching from regular light bulbs to energy saving bulbs will help ensure that individuals, in general, live in a healthy environment by saving the world from millions of metric tons of greenhouse gases. That said, the ultimate success of our nation’s energy policy depends largely on governmental decisions about the energy supply. Government needs to step up to the plate—something they often do when individuals alone cannot resolve a problem.

Dependent Measures

How likely are you to invest in insulation or weatherization for your home or apartment?

What is the maximum amount you would be willing to spend to insulate or weatherize your home or apartment to save energy? Enter an amount ranging from $0 to $500.

Enter amount: $_________

Would you be interested in receiving more information about how to insulate or weatherize your home or apartment?

Yes: _________

No: __________

(If “yes” was selected): We will send you ONE e-mail with such information that we have obtained from a non-profit organization. (If you are not interested, please select one of the responses below.)

Enter e-mail address here: ____________________________________

_____ No thanks, I already receive this information.

_____ No thanks, I am interested but prefer not to provide my e-mail at this time.

How likely are you to lower your thermostat setting in the winter and/or raise the setting in the summer to save energy?

Would you be interested in receiving more information about Smart Energy Meters that save energy?

Yes: ______

No: _______

(If “yes” was selected): We will send you ONE e-mail with such information that we have obtained from a non-profit organization. (If you are not interested, please select one of the responses below.)

Enter e-mail address here: ____________________________________

_____ No thanks, I already receive this information.

_____ No thanks, I am interested but prefer not to provide my e-mail at this time.

Footnotes

1 Coleman and Ostrom (Reference Coleman, Ostrom, Druckman, Green, Kuklinski and Lupia2011: 344) explain that most communication in collective action laboratory studies focus on participant communications with one another about strategies, which is quite distinct from our focus.

2 One prominent usage which we do not pursue is valence frames (positive versus negative) as popularized by Tversky and Kahneman (Reference Tversky and Kahneman1981).

3 This resulted in a total of 67 articles (28 from the USA Today and 39 from the NYT) after removing articles that were not focused on the U.S. energy situation.

4 We contracted with a survey research company (Bovitz Inc.) to collect the data. The sample was drawn from a panel of respondents who have opted in to complete online surveys. The panel was originally developed based on a random-digit-dial (RDD) telephone survey, where to enter the panel a respondent needed to have access to the Internet. (In this sense, it is a non-probability sample in the same way as those taken by firms such as YouGov are non-probability samples.) The panel has continued to grow based on ongoing RDD recruiting and referrals. From the panel, which has approximately one million members, a given sample is drawn using a matching algorithm (based on likely response rates) to ensure that those screened to qualify for the survey constitute a sample that demographically represents the United States. We report a response rate of 21% among individuals contacted to participate in the survey. This sampling approach is acceptable for experimental studies (Druckman and Kam Reference Druckman, Kam, Druckman, Green, Kuklinski and Lupia2011).

5 Specifically, in a pre-test, we found the frames do not significantly differ in terms of perceived “strength” (e.g., how compelling the frame is seen as being) but they do significantly differ in terms of direction with the economic frame being seen as significantly less in favor of energy conservation compared to the environmental frame. We also pre-tested and confirmed that our attribution frames were effective in placing responsibility on the individual or government (details are available from the authors).

6 Ajzen and Fishbein (Reference Ajzen, Fishbein, Albarracin, Johnson and Zanna2005: 188) explain that an “intention to perform a behavior. . . is the closest cognitive antecedent of actual behavioral performance. . .” Further, O’Keefe (Reference O'Keefe2002: 128) states, “there is good evidence that voluntary actions can be successfully predicted from intentions.” Nonetheless, we acknowledge that we do not know the scaling factor that links intentions to behavior, especially when the intentions are measured immediately following exposure to the treatment and the behavior comes days or months later.

7 We also asked a variety of belief importance (and content) questions as is typical in some framing experiments and all the results cohere with our main results reported below. We do not explore mediation given doing so brings with it inferential problems (see Bullock and Ha Reference Bullock, Ha, Druckman, Green, Kuklinski and Lupia2011). Details on these questions are available in the online supplementary appendix.

8 One might expect partisanship to affect these behaviors, beyond the experimental stimuli; however, when adding a host of demographic variables, partisanship did not have a consistent effect. Aside from our experimental conditions, perhaps the most consistent predictive variable is political knowledge with more knowledgeable individuals engaging in more energy conservation behaviors. That said, our survey also asked straightforwardly the extent to which government is responsible for addressing energy problems and Democrats are significantly more likely to view government as responsible (the question came prior to the experimental manipulation on the survey).

9 We use one-tailed tests of significance, as is common in the framing literature, given that we have clear directional expectations for the impact of our experimental conditions on opinions (Blalock Reference Blalock1979).

References

REFERENCES

Allcott, H. 2011. Social Norms and Energy Conservation. Journal of Public Economics 95 (9–10): 1082–95.CrossRefGoogle Scholar
Ajzen, Icek, and Fishbein, Martin. 2005. The Influence of Attitudes on Behaviors. In The Handbook of Attitudes, eds. Albarracin, D., Johnson, B. T., and Zanna, M. P.. London: Lawrence Erlbaum Associates.Google Scholar
Andreoni, J. and Croson, R. 2008. Partners Versus Strangers. Handbook of Experimental Economics Results, vol. 1, 776–83.Google Scholar
Ayres, I., Raseman, S. and Shih, A. 2009. Evidence from Two Large Field Experiments that Peer Comparison Feedback Can Reduce Residential Energy Usage. National Bureau of Economic Research, Working Paper No. 15386.Google Scholar
Baumeister, R. F., Bratslavsky, E., Finckenauer, C. and Vohs, K. D. 2001. Bad Is Stronger than Good. Review of General Psychology 5 (4): 323–70.Google Scholar
Black, S. J., Stern, P. C. and Elworth, J. T. 1985. Personal and Contextual Influences on Household Energy Adaptations. Journal of Applied Psychology 70 (1): 321.Google Scholar
Blalock, H. M. Jr. 1979. Social Statistics (2nd ed.). New York: McGraw-Hill.Google Scholar
Bloom, H. S. 1995. Minimum Detectable Effects: A Simple Way to Report the Statistical Power of Experimental Designs. Evaluation Review 19 (5): 547–56.Google Scholar
Bullock, J. and Ha, S. E. 2011. Mediational Analysis Is Harder than It Looks. In Cambridge handbook of experimental political science, eds. Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A.. New York: Cambridge University Press.Google Scholar
Cacioppo, J. T. and Petty, R. E. 1989. Effects of Message Repetition on Argument Processing, Recall, and Persuasion. Basic and Applied Social Psychology 10 (1): 312.Google Scholar
Chong, D. and Druckman, J. N. 2007. A Theory of Framing and Opinion Formation in Competitive Elite Environments. Journal of Communication 57 (1): 99118.Google Scholar
Coleman, E. A. and Steed, B. 2009. Monitoring and Sanctioning on the Commons: An Application to Forestry. Ecological Economics 68 (7): 2106–113.CrossRefGoogle Scholar
Coleman, E. A. and Ostrom, E. 2011. Experimental Contributions to Collective-Action Theory. In Cambridge Handbook of Experimental Political Science, eds. Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A.. New York: Cambridge University Press.Google Scholar
Dawes, R. M. and Thaler, R.H. 1988. Anomalies: Cooperation. The Journal of Economic Perspectives 2 (3): 187–97.CrossRefGoogle Scholar
Druckman, J. N. 2001. On the Limits of Framing Effects. Journal of Politics 63 (4): 1041–66.CrossRefGoogle Scholar
Druckman, J. N. 2011. What's It all About?: Framing in Political Science. In Perspectives on Framing, ed. Keren, G.. New York: Psychology Press/Taylor & Francis, 279301.Google Scholar
Druckman, J. N. and Bolsen, T. 2011. Framing, Motivated Reasoning, and Opinions About Emergent Technologies. Journal of Communication 61 (4): 659–88.Google Scholar
Druckman, J. N., Fein, J. and Leeper, T. J. 2012. A Source of Bias in Public Opinion Stability. American Political Science Review 106 (2): 430–54.CrossRefGoogle Scholar
Druckman, J. N. and Kam, C. D. 2011. Students as Experimental Participants: A defense of the ‘Narrow Data Base’. In Cambridge Handbook of Experimental Political Science, eds. Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A.. New York: Cambridge University Press, 4157.Google Scholar
Fehr, E. and Gächter, S. 2000. Cooperation and Punishment in Public Goods Experiments. American Economic Review 90 (4): 980–94.CrossRefGoogle Scholar
Feldman, S. 1988. Structure and Consistency in Public Opinion, American Journal of Political Science 32 (2): 416–40.CrossRefGoogle Scholar
Finkel, S. E. and Muller, E. N. 1998. Rational Choice and the Dynamics of Collective Political Action. The American Political Science Review 92 (1): 3749.Google Scholar
Finkel, S. E., Muller, E. N. and Opp, K.-D. 1989. Personal Influence, Collective Rationality, and Mass Political Action. American Political Science Review 83 (3): 885903.Google Scholar
Gamson, W. A. 1992. Talking Politics. New York: Cambridge University Press.Google Scholar
Green, D., Jackowitz, K. E., Kahneman, D. and McFadden, D. 1998. Referendum Contingent Valuation, Anchoring, and Willingness to Pay for Public Goods. Resource and Energy Economics 20 (2): 85116.Google Scholar
Hamman, J. R., Weber, R. A. and Woon, J. 2011. An Experimental Investigation of Electoral Delegation and the Provision of Public Goods. American Journal of Political Science 55 (4): 738–52.Google Scholar
Iyengar, S. 1991. Is Anyone Responsible? Chicago: The University of Chicago.Google Scholar
Lubell, M., Zahran, S. and Vedlitz, A. 2007. Collective Action and Citizen Responses to Global Warming. Political Behavior 29 (3): 391414.Google Scholar
Lubell, M. 2002. Environmental Activism as Collective Action. Environment and Behavior 34 (4): 431–54.Google Scholar
Malhotra, N. and Krosnick, J. A. 2007. The Effect of Survey Mode and Sampling on Inferences About Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples. Political Analysis 15 (3): 286323.Google Scholar
Moons, W. G., Mackie, D. M. and Garcia-Marques, T. 2009. The Impact of Repetition-Induced Familiarity on Agreement with Weak and Strong Arguments. Journal of Personality and Social Psychology 96 (1): 3244.Google Scholar
O'Keefe, D. J. 2002. Persuasion (2nd ed.). Thousand Oaks: Sage.Google Scholar
Olson, M. 1965. The Logic of Collective Action: Public Goods and the Theory of Groups. New York: Schocken Books.Google Scholar
Ostrom, E., Walker, J. and Gardner, R. 1992. Covenants with and Without a Sword: Self-Governance Is Possible. American Political Science Review 86 (2): 404–17.Google Scholar
Polletta, F. and Ho, M. K. 2006. Frames and Their Consequences. In The Oxford Handbook of Contextual Political Analysis, eds. Gooden, R. E. and Tilly, C.. Oxford: Oxford University Press.Google Scholar
Riker, W. H. and Ordeshook, P. C. 1968. A Theory of the Calculus of Voting. American Political Science Review 62 (1): 2542.Google Scholar
Sears, D. O., Tyler, T. R., Citrin, J. and Kinder, D. R. 1978. Political System Support and Public Response to the Energy Crisis. American Journal of Political Science 22 (1): 5682.Google Scholar
Stern, P. C. 2000. Toward a Coherent Theory of Environmentally Significant Behavior. Journal of Social Issues 56 (3): 407–24.Google Scholar
Tversky, A. and Kahneman, D. 1981. The Framing of Decisions and the Psychology of Choice. Science, 211 (4481): 453–58.Google Scholar
Figure 0

Table 1 Experimental Treatment Effects on Dependent Measures

Supplementary material: File

Bolsen Supplementary Material

Table A1-A4

Download Bolsen Supplementary Material(File)
File 43.3 KB