Hostname: page-component-7b9c58cd5d-wdhn8 Total loading time: 0 Render date: 2025-03-17T00:13:17.345Z Has data issue: false hasContentIssue false

Mis-judging merit: the effects of adjudication errors in contests

Published online by Cambridge University Press:  14 March 2025

Astrid Gamba*
Affiliation:
Department of Economics, University of Insubria, Via Monte Generoso 71, 21100 Varese, Italy
Luca Stanca
Affiliation:
Department of Economics Management and Statistics, and NeuroMI, University of Milan-Bicocca, Piazza dell’Ateneo Nuovo 1, 20126 Milan, Italy

Abstract

Within contests, adjudication errors imply at the same time the exclusion of a meritorious candidate and the inclusion of a non-meritorious one. We study theoretically how adjudication errors affect bids in all-pay auctions, by disentangling the respective effects of exclusion and inclusion errors, and showing how they interact with the framing of incentives (prize or penalty) under different assumptions on preferences. We test our theoretical predictions with an experiment where we manipulate the presence of exclusion errors, inclusion errors, and the framing of incentives. The experimental evidence indicates that errors of either exclusion or inclusion significantly decrease bids in all-pay auctions relative to a setting without errors, interacting negatively, with no significant difference in the size of their effects. Bid levels are significantly higher in a penalty framing relative to a prize framing, both in the absence of errors and in the presence of adjudication errors.

Type
Original Paper
Copyright
Copyright © The Author(s), under exclusive licence to Economic Science Association 2022.

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Supplementary Information The online version contains supplementary material available at https://doi.org/10.1007/s10683-022-09785-4.

The replication material for the study is available at https://doi.org/10.3886/E182901V3.

References

Amegashie, J. A. (2006). A contest success function with a tractable noise parameter. Public Choice, 126(135), 135144. 10.1007/s11127-006-2461-zCrossRefGoogle Scholar
Armantier, O., & Boly, A. (2015). Framing of incentives and effort provision. International Economic Review, 56(3), 917938. 10.1111/iere.12126CrossRefGoogle Scholar
Azrieli, Y., Chambers, C., & Healy, P. J. (2018). Incentives in experiments: A theoretical analysis. Journal of Political Economy, 126(4), 14721503. 10.1086/698136CrossRefGoogle Scholar
Balart, P., Chowdhury, S. M., & Troumpounis, O. (2017). Linking individual and collective contests through noise level and sharing rules. Economics Letters, 155, 126130. 10.1016/j.econlet.2017.03.020CrossRefGoogle Scholar
Baye, M. R., Kovenock, D., & de Vries, C. G. (1996). The all-pay auction with complete information. Economic Theory, 8(2), 291306. 10.1007/BF01211819CrossRefGoogle Scholar
Baye, M. R., Kovenock, D., & de Vries, C. G. (2005). Comparative analysis of litigation aystems: an auction-theoretic approach. The Economic Journal, 115(505), 583601. 10.1111/j.1468-0297.2005.01010.xCrossRefGoogle Scholar
Brooks, R. R. W., Stremitzer, A., & Tontrup, S. (2012). Framing contracts: Why loss framing increases effort. Journal of Institutional and Theoretical Economics, 168(1), 6282. 10.1628/093245612799440032CrossRefGoogle Scholar
Brooks, P., & Zank, H. (2005). Loss averse behavior. Journal of Risk and Uncertainty, 31(3), 301325. 10.1007/s11166-005-5105-7CrossRefGoogle Scholar
Cason, T. N., Masters, W. A., & Sheremeta, R. M. (2020). Winner-take-all and proportional-prize contests: Theory and experimental results. Journal of Economic Behavior and Organization, 175, 314327. 10.1016/j.jebo.2018.01.023CrossRefGoogle Scholar
Charness, G., Gneezy, U., & Halladay, B. (2016). Experimental methods: Pay one or pay all. Journal of Economic Behavior and Organization, 131(A), 141150. 10.1016/j.jebo.2016.08.010CrossRefGoogle Scholar
Chowdhury, S. M., Jeon, J. Y., & Ramalingam, A. (2017). Property rights and loss aversion in contests. Economic Inquiry, 56(3), 14921511. 10.1111/ecin.12505CrossRefGoogle Scholar
Corazzini, L., Faravelli, M., & Stanca, L. (2010). A prize to give for: An experiment on public good funding mechanisms. The Economic Journal, 120, 944967. 10.1111/j.1468-0297.2009.02314.xCrossRefGoogle Scholar
Corchón, L. C. (2007). The theory of contests: A survey. Review of Economic Design, 11(2), 69100. 10.1007/s10058-007-0032-5CrossRefGoogle Scholar
Corchón, L. C., Serena, M. Corchón, L. C., & Marini, M. A. (2018). Contest theory. Handbook of Game Theory and Industrial Organization, Edward Elgar Publishing 125146.CrossRefGoogle Scholar
Dave, C., Eckel, C. C., Johnson, A. A., & Rojas, C. (2010). Eliciting risk preferences: When is simple better?. Journal of Risk and Uncertainty, 41(3), 219243. 10.1007/s11166-010-9103-zCrossRefGoogle Scholar
Davis, D., & Reilly, R. J. (1998). Do too many cooks always spoil the stew? An experimental analysis of rent-seeking and the role of a strategic buyer. Public Choice, 35, 89115. 10.1023/A:1004916624881CrossRefGoogle Scholar
De Quidt, J., Fallucchi, F., Köllec, F., Nosenzo, D., & Quercia, S. (2017). Bonus versus penalty: How robust are the effects of contract framing?. Journal of the Economic Science Association, 3, 174182. 10.1007/s40881-017-0039-9CrossRefGoogle ScholarPubMed
Delfgaauw, J., Dur, R., Non, A., & Verbeke, W. (2015). The effects of prize spread and noise in elimination tournaments: A natural field experiment. Journal of Labour Economics, 33(3), 521569. 10.1086/679670CrossRefGoogle Scholar
Dickinson, D. L. (2001). The carrot vs the stick in work team motivation. Journal of Experimental economics, 4(1), 107124. 10.1023/A:1011449606931CrossRefGoogle Scholar
Drugov, M., & Ryvkin, D. (2020). How noise affects effort in tournaments. Journal of Economic Theory, 188(2), 10.1016/j.jet.2020.105065CrossRefGoogle Scholar
Ernst, C., & Thöni, C. (2013). Bimodal bidding in experimental all-pay auctions. Games, 4(4), 608623. 10.3390/g4040608CrossRefGoogle Scholar
Eckel, C., & Grossman, P. (2002). Sex Differences and statistical stereotyping in attitudes toward financial risk. Evolution and Human behavior, 23(4), 281295. 10.1016/S1090-5138(02)00097-1CrossRefGoogle Scholar
Eckel, C., & Grossman, P. (2008). Forecasting risk attitudes: An experimental study using actual and forecast gamble choices. Journal of Economic Behavior and Organization, 68, 117. 10.1016/j.jebo.2008.04.006CrossRefGoogle Scholar
Eckel, C., & Grossman, P. (2008). Men, women and risk aversion: Experimental evidence. Handbook of Experimental Economics Results, 1(113), 10611073. 10.1016/S1574-0722(07)00113-8CrossRefGoogle Scholar
Faravelli, M., & Stanca, L. (2012). Single versus multiple prize contests to finance public goods: Theory and experimental evidence. Journal of Economic Behavior and Organization, 81, 677688. 10.1016/j.jebo.2011.10.007CrossRefGoogle Scholar
Fischbacher, U. (2007). z-Tree: Zurich toolbox for ready-made economic experiments. Experimental Economics, 10(2), 171178. 10.1007/s10683-006-9159-4CrossRefGoogle Scholar
Fryer, R. G., Levitt, S. D., List, J., & Sadoff, S. (2012). Enhancing the efficacy of teacher incentives through loss aversion: A field experiment. NBER Working, 252, 18237.Google Scholar
Gächter, S., Johnson, E. J., & Herrmann, A. (2021). Individual-level loss aversion in riskless and risky choices. Theory and Decision, 92, 599624. 10.1007/s11238-021-09839-8CrossRefGoogle Scholar
Gächter, S., Orzen, S., Renner, E., & Starmer, C. (2009). Are experimental economists prone to framing effects? A natural field experiment. Journal of Economic Behavior and Organization, 70(3), 443446. 10.1016/j.jebo.2007.11.003CrossRefGoogle Scholar
Gneezy, U., & Smorodinsky, R. (2006). All-pay auctions: An experimental study. Journal of Economic Behavior and Organization, 61, 255275. 10.1016/j.jebo.2004.09.013CrossRefGoogle Scholar
Greiner, B. (2004). The online recruitment system ORSEE 2.0: A guide for the organization of experiments in economics. Working Paper Series in Economics 10, University of Cologne.Google Scholar
Hammond, K. R. (1996). Human Judgment and Social Policy, Irreducible Uncertainty Inevitable Error Unavoidable Injustice Oxford University Press.CrossRefGoogle Scholar
Harrison, G. W., Lau, M. I., & Rutström, E. E. (2007). Estimating risk attitudes in denmark: A field experiment. The Scandinavian Journal of Economics, 109(2), 341368. 10.1111/j.1467-9442.2007.00496.xCrossRefGoogle Scholar
Hillman, A., & Riley, J. G. (1989). Politically contestable rents and transfers. Economics and Politics, 1, 1740. 10.1111/j.1468-0343.1989.tb00003.xCrossRefGoogle Scholar
Holt, C. A., & Laury, S. K. (2002). Risk aversion and incentive effects. The American Economic Review, 92(5), 16441655. 10.1257/000282802762024700CrossRefGoogle Scholar
Hong, F., Hossain, T., & List, J. A. (2015). Framing manipulations in contests: A natural field experiment. Journal of Economic Behavior and Organization, 128, 372382. 10.1016/j.jebo.2015.02.014CrossRefGoogle Scholar
Hossain, T., & List, J. A. (2012). The behavioralists visits the factory: Increasing productivity using simple framing manipulations. Management Science, 58(12), 21512167. 10.1287/mnsc.1120.1544CrossRefGoogle Scholar
Imas, A., Sadoff, A., & Samek, A. (2017). Do people anticipate loss aversion?. Management Science, 63(5), 12711284. 10.1287/mnsc.2015.2402CrossRefGoogle Scholar
Jia, H. (2008). A stochastic derivation of the ratio form of contest success functions. Public Choice, 135(3), 125130. 10.1007/s11127-007-9242-1CrossRefGoogle Scholar
Jia, H., Skaperdas, S., & Vaidya, S. (2013). Contest functions: Theoretical foundations and issues in estimation. International Journal of Industrial Organization, 31(3), 211222. 10.1016/j.ijindorg.2012.06.007CrossRefGoogle Scholar
Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2), 263292. 10.2307/1914185CrossRefGoogle Scholar
Kaplow, L., & Shavell, S. (1994). Accuracy in the determination of liability. Journal of Law and Economics, 37, 115. 10.1086/467304CrossRefGoogle Scholar
Klose, B., & Kovenock, D. (2015). The all-pay Auction with complete information and identity-dependent externalities. Economic Theory, 59(1), 119. 10.1007/s00199-014-0848-5CrossRefGoogle Scholar
Konrad, K. (2009). Strategy and Dynamics in Contests, New York: Oxford University Press.CrossRefGoogle Scholar
Lazear, E. P., & Rosen, S. (1981). Rank and order tournament: An optimal labor contract. Journal of Political Economy, 89(5), 841864. 10.1086/261010CrossRefGoogle Scholar
Levitt, S. D., List, J. A., Neckermann, S., & Sadoff, S. (2016). The behavioralist goes to school: Leveraging behavioral economics to improve educational performance. American Economic Journal: Economic Policy, 8(4), 183219.Google Scholar
List, J. A., Van Soest, D., Stoop, J., & Zhou, H. (2020). On the role of group size in tournaments: Theory and evidence from lab and field experiments. Management Science, 66(10), 43594377. 10.1287/mnsc.2019.3441CrossRefGoogle Scholar
Lugovskyy, V., Puzzello, D., & Tucker, S. (2010). An experimental investigation of overdissipation in the all-pay auction. European Economic Review, 54(8), 974997. 10.1016/j.euroecorev.2010.02.006CrossRefGoogle Scholar
Mermer, A. G. (2016). Over-workers and drop-outs in competitions: Contests with expectations-based loss-averse agents. Mimeo.Google Scholar
Millner, E. L., & Pratt, M. D. (1989). An experimental investigation of efficient rent-seeking. Public Choice, 62(2), 139151. 10.1007/BF00124330CrossRefGoogle Scholar
Ong, D., & Chen, Z. (2012). Tiger women: An all-Pay auction experiment on the gender heuristic of the desire to win. Working Paper.Google Scholar
Png, Ivan P. L (1986). Optimal subsidies and damages in the presence of judicial error. International Review of Law and Economics, 6, 101105. 10.1016/0144-8188(86)90042-6CrossRefGoogle Scholar
Polinsky, A. M., & Shavell, S. (2009). Public Enforcement of Law, Edward Elgar.Google Scholar
Potters, J., de Vries, C., & van Winden, F. (1998). An experimental investigation of rational rent seeking. European Journal of Political Economy, 14(4), 783800. 10.1016/S0176-2680(98)00037-8CrossRefGoogle Scholar
Price, C., & Sheremeta, R. (2015). Endowment origin, demographic effects and individual preferences in contests. Journal of Economics and Management Strategy, 24, 597619.Google Scholar
Rizzolli, M., & Stanca, L. (2012). Judicial errors and crime deterrence: Theory and experimental evidence. Journal of Law and Economics, 55(2), 311338. 10.1086/663346CrossRefGoogle Scholar
Schmidt, U., & Traub, S. (2002). An experimental test of loss aversion. Journal of Risk and Uncertainty, 25(3), 233249. 10.1023/A:1020923921649CrossRefGoogle Scholar
Sheremeta, R. (2013). Overbidding and heterogeneous behavior in contest experiments. Journal of Economic Surveys, 27, 491514. 10.1111/joes.12022CrossRefGoogle Scholar
Sheremeta, R., & Zhang, J. (2010). Can groups solve the problem of over-bidding in contests?. Social Choice and Welfare, 35, 175197. 10.1007/s00355-009-0434-0CrossRefGoogle Scholar
Thorngate, W., & Carroll, B. (1990). Tests versus contests: A theory of adjudication. Recent Research in Psychology, 65, 431438. 10.1007/978-1-4613-9688-8_43CrossRefGoogle Scholar
Thorngate, W., Dawes, R. M., & Foddy, M. (2009). Judging Merit, Psychology Press.Google Scholar
Tullock, G. Buchanan, J. M., Tollison, R. D., & Tullock, G. (1980). Efficient Rent-seeking. Toward a Theory of the Rent-seeking Society, 97–112, Texas A &M University Press.Google Scholar
Supplementary material: File

Gamba and Stanca supplementary material

Online Appendix for “Mis-judging merit: The effects of adjudication errors in contests”
Download Gamba and Stanca supplementary material(File)
File 1.2 MB