Hostname: page-component-6bf8c574d5-b4m5d Total loading time: 0 Render date: 2025-02-14T18:35:01.691Z Has data issue: false hasContentIssue false
  • English
  • Français

Comparing Incomparable Survey Responses: Evaluating and Selecting Anchoring Vignettes

Published online by Cambridge University Press:  04 January 2017

Gary King  and
Jonathan Wand
Gary King
Affiliation:
Institute for Quantitative Social Science, 1737 Cambridge Street, Harvard University, Cambridge MA 02138. e-mail: king@harvard.edu (corresponding author)
Jonathan Wand
Affiliation:
Department of Political Science, Encina Hall, Room 308 West, Stanford University, Stanford, CA 94305-6044. e-mail: wand@stanford.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

When respondents use the ordinal response categories of standard survey questions in different ways, the validity of analyses based on the resulting data can be biased. Anchoring vignettes is a survey design technique, introduced by King et al. (2004, Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review 94 [February]: 191–205), intended to correct for some of these problems. We develop new methods both for evaluating and choosing anchoring vignettes and for analyzing the resulting data. With surveys on a diverse range of topics in a range of countries, we illustrate how our proposed methods can improve the ability of anchoring vignettes to extract information from survey data, as well as saving in survey administration costs.

Type
Research Article
Information
Political Analysis , Volume 15 , Issue 1 , Winter 2007 , pp. 46 - 66
Copyright
Copyright © The Author 2006. Published by Oxford University Press on behalf of the Society for Political Methodology 

References

Golan, Amos, Judge, George, and Miller, Doug. 1996. Maximum entropy econometrics: Robust estimation with limited data. London: John Wiley and Sons.Google Scholar
Grendar, M. Jr., and Grendar, M. 2003. Maximum probability/entropy translating of contiguous categorical observations into frequencies. Working paper, Institute of Mathematics and Computer Science, Mathematical Institute of Slovak Academy of Sciences, Banska Bystrica.Google Scholar
Heitjan, Daniel F., and Rubin, Donald. 1990. Inference from coarse data via multiple imputation with application to age heaping. Journal of the American Statistical Association 85: 304–14.CrossRefGoogle Scholar
King, Gary. 1997. A solution to the ecological inference problem: Reconstructing individual behavior from aggregate data. Princeton, NJ: Princeton University Press.Google Scholar
King, Gary, Honaker, James, Joseph, Anne, and Scheve, Kenneth. 2001. Analyzing incomplete political science data: An alternative algorithm for multiple imputation. American Political Science Review 95 (March): 49–69. http://gking.harvard.edu/files/abs/evil-abs.shtml.CrossRefGoogle Scholar
King, Gary, Murray, Christopher J. L., Salomon, Joshua A., and Tandon, Ajay. 2004. Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review 98 (February): 191–205. http://gking.harvard.edu/files/abs/vign-abs.shtml.Google Scholar
King, Gary, Tomz, Michael, and Wittenberg, Jason. 2000. Making the most of statistical analyses: Improving interpretation and presentation. American Journal of Political Science 44 (April): 341–55. http://gking.harvard.edu/files/abs/making-abs.shtml.Google Scholar
Kullback, S., and Leibler, R. A. 1951. On information and sufficiency. Annals of Mathematical Statistics 22 (March): 79–86.CrossRefGoogle Scholar
Lin, Shin, Cutler, David L., Zwick, Michael E., and Chakravarti, Aravinda. 2002. Haplotype inference in random population samples. American Journal of Human Genetics 71: 1129–37.Google Scholar
Schwarz, Norbert. 1999. Self-reports: How the questions shape the answers. American Psychologist 54: 93–105.CrossRefGoogle Scholar
Sekhon, Jasjeet Singh, and Mebane, Walter R. Jr. 1998. Genetic optimization using derivatives: Theory and application to nonlinear model. Political Analysis 7: 187–210.Google Scholar
Shannon, Claude E. 1949. The mathematical theory of communication. Urbana-Champaign, IL: University of Illinois Press.Google Scholar
Wand, Jonathan, King, Gary, and Lau, Olivia. Forthcoming. Anchors: Software for anchoring vignettes data. Journal of Statistical Software.Google Scholar