Tailored proper scoring rules elicit decision weights
Journal Title: Judgment and Decision Making - Year 2015, Vol 10, Issue 1
Abstract
Proper scoring rules are scoring methods that incentivize honest reporting of subjective probabilities, where an agent strictly maximizes his expected score by reporting his true belief. The implicit assumption behind proper scoring rules is that agents are risk neutral. Such an assumption is often unrealistic when agents are human beings. Modern theories of choice under uncertainty based on rank-dependent utilities assert that human beings weight nonlinear utilities using decision weights, which are differences between weighting functions applied to cumulative probabilities. In this paper, I investigate the reporting behavior of an agent with a rank-dependent utility when he is rewarded using a proper scoring rule tailored to his utility function. I show that such an agent misreports his true belief by reporting a vector of decision weights. My findings thus highlight the risk of utilizing proper scoring rules without prior knowledge about all the components that drive an agent’s attitude towards uncertainty. On the positive side, I discuss how tailored proper scoring rules can effectively elicit weighting functions. Moreover, I show how to obtain an agent’s true belief from his misreported belief once the weighting functions are known.
Authors and Affiliations
Arthur Carvalho
Keywords
Related Articles
- EP ID EP678161
- DOI -
- Views 157
- Downloads 0
Affect, risk perception and future optimism after the tsunami disaster
Environmental events such as natural disasters may influence the public's affective reactions and decisions. Shortly after the 2004 Tsunami disaster we assessed how affect elicited by thinking about this disaster influen...
Predicting biases in very highly educated samples: Numeracy and metacognition
We investigated the relations between numeracy and superior judgment and decision making in two large community outreach studies in Holland (n=5408). In these very highly educated samples (e.g., 30–50% held graduate degr...
Moral identity in psychopathy
Several scholars have recognized the limitations of theories of moral reasoning in explaining moral behavior. They have argued that moral behavior may also be influenced by moral identity, or how central morality is to o...
Thoughtful days and valenced nights: How much will you think about the problem?
Considerable research has pointed towards processing differences as a viable means for understanding the strength and likelihood of a framing effect. In the current study we explored how differences in processing may eme...
Is broad bracketing always better? How broad decision framing leads to more optimal preferences over repeated gambles
The effect of choice bracketing — the consideration of repeated decisions as a set versus in isolation — has important implications for products that are inherently time-sensitive and entail varying levels of risk, inclu...