I am grateful to Lupia, Levine, Menning, and Sin for their detailed and stimulating response to “Homer Gets a Tax Cut.” Their critique raises a variety of important substantive, methodological, and philosophical issues. In this brief reply I note some points of substantive agreement, attempt to clarify the specific empirical claim that seems to have inspired much of their irritation with my piece, and dissent from their embrace of “rationales” as the primary building blocks of democratic theory and “social marketing” as a paradigm for rethinking our role as social scientists.
Political Values and Information Effects
Lupia, Levine, Menning, and Sin's primary empirical contribution is a regression analysis demonstrating the heterogeneity of information effects on support for the 2001 Bush tax cut. More-informed Republicans and conservatives were roughly similar to less-informed Republicans and conservatives in their views about the tax cut, while more-informed Democrats and liberals were vastly less favorable than their less-informed counterparts. These relationships appear weakly in Lupia, Levine, Menning, and Sin's figure 2 (due to substantial measurement error in the NES interviewers' information ratings); they appear much more clearly in the statistical alanlyses reported in Lupia, Levine, Menning, and Sin's table 1 (which rely, as my own analysis did, on instrumental variables estimation to correct for attenuation in the parameter estimates).1
The 2002 NES survey was a telephone survey conducted by the Indiana University Center for Survey Research rather than the University of Michigan's Survey Research Center. The interviewer ratings of political information seem to be a good deal less reliable than in other NES surveys. For example, the correlation between pre- and post-election information ratings for the same respondents was .70 in 2004, but only .36 in 2002.
I certainly agree with Lupia, Levine, Menning, and Sin's key claim that political information may have different effects on different people. Indeed, I made the same point in print two decades ago, and again in critiquing Lupia's own previous work on information effects.2
Where we disagree is in assessing the implications of this heterogeneity for my conclusions about the bases of support for the Bush tax cut. According to Lupia, Levine, Menning, and Sin, the fact that Republicans and conservatives “supported the tax cut at extraordinary high levels, regardless of their information ratings” (777) renders my conclusions “erroneous” (774). My own view is that their reanalysis provides a useful but hardly surprising elaboration of the relevant finding in my article.The fact that ideological and partisan disagreements about the tax cut only emerged clearly among relatively well-informed people will come as no surprise to anyone who has read John Zaller's influential study of The Nature and Origins of Mass Opinion. Zaller provided several examples of similar “polarization effects” in cases “in which political elites heatedly disagree.”3
Zaller 1992, 100.
Oddly, Lupia, Levine, Mening, and Sin's statistical results imply considerably less support for the tax cut among uninformed conservatives than among uninformed Republicans, Democrats, or liberals. This anomaly may reflect the fact that more than 60 percent of the NES respondents qualify as “conservatives” by their coding.
My point, in the portion of “Homer Gets a Tax Cut” that Lupia, Levine, Mening, and Sin focus upon, was that this marked asymmetry had a dramatic impact on the overall distribution of public support for the tax cut. Nothing in their reanalysis of the NES data provides any grounds for doubting that a better-informed public would have been markedly less enthusiastic about the tax cut. Rather, what they show is that the information effect I documented was concentrated among Democrats and liberals.5
Lupia, Levine, Mening, and Sin exclude “pure” independents and ideological moderates from their subgroup analyses.
“Simple Ignorance” and Support for the Bush Tax Cut
Much of Lupia, Levine, Menning, and Sin's critique focuses on my claim that “the strong plurality support for Bush's tax cut … is entirely attributable to simple ignorance.” They insist that the partisan and ideological disparities in information effects documented in their table 1 invalidate this assertion, but never really explain why. Indeed, despite referring to the “simple ignorance” claim more than a dozen times, they never pause to consider what it means or how I arrived at it. The previous sentence of my article specified the basis for the claim: the predicted level of support for the tax cut implied by my analysis (on a scale ranging from +1 for strong support to −1 for strong opposition) ranged from +.84 (indicating near-unanimous support) at the bottom of the information scale to −.06 (indicating an equal mix of support and opposition) at the top of the information scale.6
For the purposes of this calculation I set the other characteristics included as explanatory factors in my regression model to neutral values; so, more precisely, −.06 is the predicted level of support for a fully informed political independent with average income.
An analogy may be helpful here. Wand et al. provided very convincing statistical evidence that thousands of voters in Florida's Palm Beach County mistakenly marked their ballots in the 2000 presidential election for Patrick Buchanan rather than Al Gore. The authors concluded that Palm Beach County's confusing “butterfly ballot” was “pivotal in the 2000 presidential race.”7
Wand et al. 2001, 803.
The point I tried to make in the sentence on which so much of Lupia, Levine, Menning, and Sin's critique seems to hinge is that the strong plurality support for Bush's tax cut in the 2002 NES survey was entirely attributable to ignorance in just the same sense that Bush's narrow plurality in Florida was entirely attributable to the butterfly ballot: no ignorance, no strong plurality.8
The analogy can be extended one step further. Just as Lupia, Levine, Menning, and Sin “suspect that many opponents of the tax cut were pleased to hear that public support for a policy with which they disagreed was due to the public's ignorance” (779), I suspect that many Gore supporters were pleased to hear that the outcome of the 2000 presidential election was a “mistake.” In neither case does the warm glow shed any light one way or the other on the persuasiveness of the claim.
Lupia, Levine, Menning, and Sin's apparent misunderstanding of my “simple ignorance” claim is facilitated by ignoring most of the rest of my article, which examined a variety of potential bases of public support for the Bush tax cut. Some of my findings seem quite consistent with their basic point that people “approach political problems from varying ideological perspectives and with different values in mind” (779). Indeed, that observation—which they offer as a basis for criticizing my analysis—is a virtual paraphrase of the first of my “four important conclusions,” that “opinions about tax policy are shaped by broad political values such as partisanship and ideology.”9
Bartels 2005, 23.
On the other hand, several of my findings struck me as very hard to square with any straightforward ideological or “values” interpretation. Why were people who thought their own taxes were too high so much more likely to support the tax cut, despite the fact that it would have only a modest impact on most people's own tax bills? Conversely, why did attitudes about the tax burden borne by the rich have no apparent effect on support for the tax cut, despite the fact that most of the benefits were targeted to wealthy taxpayers? Why were people with modest incomes, who got little or nothing in the way of direct benefits, more supportive than wealthy people, who got substantial tax reductions? Why were people who thought the government wasted a lot of tax money less supportive of tax cuts than those who thought the government was spending money efficiently? Lupia, Levine, Menning, and Sin have no light to shed on any of these findings—beyond insisting as a general matter that “much of the support for the tax cut is attributable to something other than ignorance” (777) and that “citizens have reasons for the opinions they have” (780).
Reasonable Disagreement
Lupia, Levine, Menning, and Sin attach considerable significance to the fact that some splendidly well-informed liberals and Democrats supported Bush's tax cuts. Their most striking example—an “endorsement” from prominent liberal economist (and my Princeton colleague) Alan Blinder—is highly strained, to say the least. The sum total of Blinder's comments in the radio news story they offer as a source for their characterization consisted of the following two sentences: “The timing turns out to be, more or less by accident, very good…. The right kind of bill to have passed, it's too late now, would have a lot of tax relief in the short term—even more than was legislated—but much less eight, nine, ten years from now.” Later the same year (November 28, 2001), Blinder testified before the Joint Economic Committee of the U.S. Congress, stressing the unfulfilled need for a bipartisan short-term stimulus plan that “cuts taxes only where the tax cuts do the economy some good” (emphasis original). A few years later, he wrote that “the most profound, and profoundly disturbing, innovation in budget policy during the administration of George W. Bush has been to discard the old-fashioned notion that presidents who propose a tax cut or new spending should also propose some way to pay for it.”10
“Social Security and the New Fiscal Policy,” in The American Prospect Online, January 14, 2005.
On the other hand, there clearly were important Democratic elected officials who supported Bush's plan. Lupia, Levine, Menning, and Sin claim that seven Democratic senators voted for the 2001 tax cut; in fact there were twelve. However, there was less to this bipartisan support than meets the eye. Four of the twelve Democratic supporters—Max Baucus, John Breaux, Blanche Lincoln, and Robert Torricelli—sat on the Senate Finance Committee, which had “crammed in several more provisions” to make the president's original proposal more palatable to Lincoln and Torricelli, among others.11
Nitschke 2001.
As it turned out, only Baucus was reelected by a comfortable margin; Carnahan and Cleland were defeated, Toricelli dropped out of his race, Johnson was reelected by a 50-49 margin, and Landrieu won by a 52-48 margin in a runoff election.
Loughlin and Yoon 2003.
Of course, neither personal wealth nor reelection concerns nor special provisions for committee members figured in the reasons these senators offered for voting the way they did. If our goal as social scientists is, as Lupia, Levine, Menning, and Sin (779) have it, to “better fit our analyses into their rationales,” then these factors are simply irrelevant to understanding the politics of the tax cut. However, that would seem to me to be a counterproductive narrowing of our explanatory repertoire. People's “rationales” are sometimes unreliable bases for understanding and explaining their behavior.
Beyond Extenuation
I noted in “Homer Gets a Tax Cut” that 40 percent of the respondents in the 2002 NES survey said they hadn't thought about whether they favored or opposed the 2001 Bush tax cut. Lupia, Levine, Menning, and Sin counter that the vast majority of these people did claim to have thought about the imminent war in Iraq or corporate scandals or the 2002 campaign. “The fact that many do not pay attention to an issue such as tax cuts,” they argue (778), “may say little about their political competence more generally.” Since I did not assert anything about people's “political competence more generally,” I am happy to leave to others the difficult question of how many multi-trillion-dollar issues a competent citizen can afford to ignore. I agree that citizens are busy, that they pick and choose what to pay attention to, and even that they “lack the opportunity to act on individual policy proposals” (778). However, those are (potential) justifications for ignorance and superficial thinking about tax policy, not evidence against my characterization of public opinion on this issue.
Lupia, Levine, Menning, and Sin's unsubtle effort to, quite literally, change the subject is in service of a broader goal: rationalizing everyday political thinking and behavior. As Luskin aptly put it, after decades of scholarly research “the controversy over how sophisticated most people are has not really died so much as transformed itself. The Panglossian line has merely shifted from denial to extenuation.”14
Luskin 2002, 284.
I agree that understanding people's rationales for their own behavior is one crucial element of successful explanation in the social sciences. However, decades of psychological research have amply demonstrated that people's subjective understandings of their own behavior are often incomplete, predictably biased, and sometimes highly misleading.15
Thus, a methodology of social inquiry limited to understanding people's rationales seems decidedly incomplete on purely scientific grounds, whatever merits it may have from the standpoint of “social marketing.”Moreover, even when the reasons people offer for their own behavior are accurate reflections of why they thought or did what they did, it does not necessarily follow that those reasons are cogent or politically sensible. Psychologists who study human decision-making focus much of their attention on the implications of pervasive biases, cognitive shortcuts, and inferential errors. In assessing judgments or choices, they attempt to “avoid overly strict interpretations, which treat reasonable answers as errors, as well as overly charitable interpretations, which attempt to rationalize every response.”16
Kahneman and Tversky 1982, 493–494.
Usually, the psychologists' evaluative task is greatly simplified by focusing on simple experimental situations in which an “error in judgment” can be “demonstrated by comparing peoples' responses either with an established fact (e.g., that the two lines are equal in length) or with an accepted rule of arithmetic, logic, or statistics.”17
Ibid.
The complexity and contestedness of the political world make evaluation of political decision-making a difficult enterprise, fraught with opportunities for misjudgment and misunderstanding. But they also make it more important in both scientific and political terms. Ignorance, confusion, misinformation, and wishful thinking are likely to loom large in any realistic account of ordinary citizens' political beliefs and judgments—that is, unless we are willing to stipulate, as a matter of faith, that the same people who consistently misjudge the lengths of lines and the ramifications of simple probability statements somehow invariably succeed in mastering political issues of staggering difficulty.
Lupia, Levine, Menning, and Sin (779) worry that “to reach the conclusion that voters are ‘unenlightened,’ ‘simple-minded,’ or ‘simply ignorant’ requires a great deal of speculation—speculation for which direct evidence is scant.”18
Casual readers may be tempted to interpret Lupia, Levine, Menning, and Sin's concern as implying that I “use[d] a study such as ‘Homer’ to reach the conclusion that voters are ‘unenlightened,’ ‘simple-minded,’ or ‘simply ignorant.’” In fact, I reached none of those conclusions. Rather, I characterized some of the considerations of self-interest that influenced people's opinions about the Bush tax cut as “unenlightened” and “simple-minded,” and noted that “simple ignorance” contributed significantly to the overall level of public support for the policy. If pressed for a more general characterization of the distribution of political information among ordinary citizens, I would simply second Converse's (1990, 372) observation that “the mean is low and the variance high.”
In an essay on “New Challenges to the Rationality Assumption,” Daniel Kahneman noted that “The criteria for using the terms ‘rational’ or ‘irrational’ in non-technical discourse are substantive: one asks whether beliefs are grossly out of kilter with available evidence, and whether decisions serve or damage the agent's interests.”19
Kahneman 2000, 758.
That is not to say that the beliefs and behavior of better-informed people should always or automatically be considered substantively rational. Sometimes, as Lupia, Levine, Menning and Sin (782) surmise, “even when people are well informed they still do not meet [my] preferred standard of decision making.” Well-informed people are sometimes quite wrong about things—even when it comes to straightforward factual matters. For example, well-informed conservatives in the 2002 and 2004 NES surveys were significantly more likely than less-informed conservatives to deny that differences in income between rich people and poor people in the United States had increased over the past 20 years—a denial “grossly out of kilter with available evidence.”20
Bartels 2008, ch. 5.
Bartels 1990.
Criticizing the behavior of citizens or policy-makers is a messy and contentious business. It may even be counterproductive from the standpoint of “social marketing”; I don't know. In any case, our primary task as social scientists is not to tell people what they want to hear, or to “better fit our analyses into their rationales,” or even to “match critical social needs (such as those of the poor) with citizens' desires.” Rather, it is to understand how people think and act, and why. If they think and act like Superman, so much the better for them, and for us. Still, we should leave some room in our understanding of social science—and in our understanding of human nature—for the possibility that they (we all) sometimes think and act more like Homer Simpson.