The category size bias: A mere misunderstanding
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 2
Abstract
Redundant or excessive information can sometimes lead people to lean on it unnecessarily. Certain experimental designs can sometimes bias results in the researcher’s favor. And, sometimes, interesting effects are too small to be studied, practically, or are simply zero. We believe a confluence of these factors led to a recent paper (Isaac & Brough, 2014, JCR). This initial paper proposed a new means by which probability judgments can be led astray: the category size bias, by which an individual event coming from a large category is judged more likely to occur than an event coming from a small one. Our work shows that this effect may be due to instructional and mechanical confounds, rather than interesting psychology. We present eleven studies with over ten times the sample size of the original in support of our conclusion: We replicate three of the five original studies and reduce or eliminate the effect by resolving these methodological issues, even significantly reversing the bias in one case (Study 6). Studies 7–8c suggest the remaining two studies are false positives. We conclude with a discussion of the subtleties of instruction wording, the difficulties of correcting the record, and the importance of replication and open science.
Authors and Affiliations
Hannah Perfecto, Leif D. Nelson and Don A. Moore
Keywords
Related Articles
- EP ID EP678335
- DOI -
- Views 165
- Downloads 0
Do Europeans like nudges?
In recent years, many governments have shown a keen interest in “nudges” — approaches to law and policy that maintain freedom of choice, but that steer people in certain directions. Yet to date, there has been little evi...
Pair-wise comparisons of multiple models
Often research in judgment and decision making requires comparison of multiple competing models. Researchers invoke global measures such as the rate of correct predictions or the sum of squared (or absolute) deviations o...
Post-error recklessness and the hot hand
Although post-error slowing and the “hot hand” (streaks of good performance) are both types of sequential dependencies arising from the differential influence of success and failure, they have not previously been studied...
Identifying decision strategies in a consumer choice situation
In two studies on mobile phone purchase decisions, we investigated consumers’ decision strategies with a newly developed process tracing tool called InterActive Process Tracing (IAPT). This tool is a combination of sever...
Evidence for and against a simple interpretation of the less-is-more effect
The less-is-more effect predicts that people can be more accurate making paired-comparison decisions when they have less knowledge, in the sense that they do not recognize all of the items in the decision domain. The tra...