Diagnostic Task Selection for Strategy Classification in Judgment and Decision Making: Theory, Validation, and Implementation in R
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
One major statistical and methodological challenge in Judgment and Decision Making research is the reliable identification of individual decision strategies by selection of diagnostic tasks, that is, tasks for which predictions of the strategies differ sufficiently. The more strategies are considered, and the larger the number of dependent measures simultaneously taken into account in strategy classification (e.g., choices, decision time, confidence ratings; Glöckner, 2009), the more complex the selection of the most diagnostic tasks becomes. We suggest the Euclidian Diagnostic Task Selection (EDTS) method as a standardized solution for the problem. According to EDTS, experimental tasks are selected that maximize the average difference between strategy predictions for any multidimensional prediction space. In a comprehensive model recovery simulation, we evaluate and quantify the influence of diagnostic task selection on identification rates in strategy classification. Strategy classification with EDTS shows superior performance in comparison to less diagnostic task selection algorithms such as representative sampling. The advantage of EDTS is particularly large if only few dependent measures are considered. We also provide an easy-to-use function in the free software package R that allows generating predictions for the most commonly considered strategies for a specified set of tasks and evaluating the diagnosticity of those tasks via EDTS; thus, to apply EDTS, no prior programming knowledge is necessary.
Authors and Affiliations
Marc Jekel, Susann Fiedler and Andreas Glöckner
Keywords
Related Articles
- EP ID EP677862
- DOI -
- Views 141
- Downloads 0
Recognition judgments and the performance of the recognition heuristic depend on the size of the reference class
In a series of three experiments, participants made inferences about which one of a pair of two objects scored higher on a criterion. The first experiment was designed to contrast the prediction of Probabilistic Mental M...
Disentangling the effects of alternation rate and maximum run length on judgments of randomness
Binary sequences are characterized by various features. Two of these characteristics—alternation rate and run length—have repeatedly been shown to influence judgments of randomness. The two characteristics, however, have...
Reference dependence, cooperation, and coordination in games
The problems of how self-interested players can cooperate despite incentives to defect, and how players can coordinate despite the presence of multiple equilibria, are among the oldest and most fundamental in game theory...
Modeling sequential context effects in judgment analysis:
In this article a broad perspective incorporating elements of time series theory is presented for conceptualizing the data obtained in multi-trial judgment experiments. Recent evidence suggests that sequential context ef...
Direct and indirect effects of pathological gambling on risk attitudes
We study individual decision making in a lottery-choice task performed by three different populations: gamblers under psychological treatment (äddicts"), gamblers' spouses ("victims"), and people who are neither gamblers...