True-and-error models violate independence and yet they are testable
Journal Title: Judgment and Decision Making - Year 2013, Vol 8, Issue 6
Abstract
Birnbaum (2011) criticized tests of transitivity that are based entirely on binary choice proportions. When assumptions of independence and stationarity (iid) of choice responses are violated, choice proportions could lead to wrong conclusions. Birnbaum (2012a) proposed two statistics (correlation and variance of preference reversals) to test iid, using random permutations to simulate p-values. Cha, Choi, Guo, Regenwetter, and Zwilling (2013) defended methods based on marginal proportions but conceded that such methods wrongly diagnose hypothetical examples of Birnbaum (2012a). However, they also claimed that “true and error” models also satisfy independence and also fail in such cases unless they become untestable. This article presents correct true-and-error models; it shows how these models violate iid, how they might correctly identify cases that would be misdiagnosed by marginal proportions, and how they can be tested and rejected. This note also refutes other arguments of Cha et al. (2013), including contentions that other tests failed to violate iid “with flying colors”, that violations of iid “do not replicate”, that type I errors are not appropriately estimated by the permutation method, and that independence assumptions are not critical to interpretation of marginal choice proportions.
Authors and Affiliations
Michael H. Birnbaum
Keywords
Related Articles
- EP ID EP678104
- DOI -
- Views 150
- Downloads 0
Learning to reason: The influence of instruction, prompts and scaffolding, metacognitive knowledge, and general intelligence on informal reasoning about everyday social and political issues
Twelve experiments examined ways of improving informal reasoning, as assesed by presenting students with accessible, current, and interesting social and political issues, eliciting reasoning about them, and scoring the r...
The importance of learning when making inferences
The assumption that people possess a repertoire of strategies to solve the inference problems they face has been made repeatedly. The experimental findings of two previous studies on strategy selection are reexamined fro...
The retrospective gambler’s fallacy: Unlikely events, constructing the past, and multiple universes
The gambler’s fallacy (Tune, 1964) refers to the belief that a streak is more likely to end than chance would dictate. In three studies, participants exhibited a retrospective gambler’s fallacy (RGF) in which an event th...
Editorial: Methodology in judgment and decision making research
In this introduction to the special issue on methodology, we provide background on its original motivation and a systematic overview of the contributions. The latter are discussed with correspondence to the phase of the...
Domain-specific temporal discounting and temptation
In this investigation, we test whether temporal discounting is domain-specific (i.e., compared to other people, can an individual have a relatively high discount rate for one type of reward but a relatively low discount...