Building the
Machine
How do you pick 200 trials out of 17,955 possible choices?
The problem
The design calls for a few hundred trials. But which ones?
Investments range from 1 to 10 tokens. Probabilities from 5% to 95%. Outcomes from 0 to 39 tokens. The full factorial space contains 17,955 possible trials.
Not all trials are equally informative. Some tell us a lot about Prospect Theory parameters. Others are redundant or uninformative. We need a systematic method to select the best ones.
Generate the trial space
First, create all possible trials. For each investment level (1 to 10 tokens), generate all combinations of outcomes and probabilities.
A fine grid over four dimensions
Define the complete 4D parameter space for Prospect Theory. For each parameter, a grid of 50 values.
Certainty equivalents
For every single trial (17,955) and every single parameter combination (6.25M), calculate the certainty equivalent: how much is this gamble worth to a person with these specific risk preferences?
This required massive parallel computing. We computed 112 billion certainty equivalents to build a complete map of predicted behaviour.
Filter to discriminative trials
Eliminate trials that don't vary with parameter values. If everyone accepts a trial (or everyone rejects it) regardless of their parameters, it provides no information.
- 1Threshold crossing (CE crosses 0)
- 2Sufficient range (range ≥ 0.5)
- 3Avoid consensus (< 95% agreement)
Fisher information, one derivative at a time
Fisher information quantifies how much a trial tells you about a parameter. It is based on derivatives: how much does the certainty equivalent change when you tweak α, λ, γ+ or γ−?
D-optimal sequential selection
We don't just pick random trials. We use an algorithm that selects trials one by one.
- 1Pick the trial that maximises information about the parameters, given what we already know
- 2Add it to the set. Update the information matrix.
- 3Repeat, towards a target of 300. Keeping the set balanced stopped it at 286.
The 286 trials ran in the first pilot, each participant in one condition. For the second pilot, in both conditions, the set grew into a pool of 403. From that pool the same selection kept the final 200 trials, with at least five trials at each of the 19 probability levels. Every participant plays these 200 trials twice: once with a person, once with a lottery.
A set of trials that is the most efficient way we know to estimate Prospect Theory parameters with this design
Precision estimates
The Fisher information matrix tells us how precisely we can estimate each parameter. Precision is measured by standard errors (SE). Smaller is better. These are the standard errors of the 2025 set of 286 trials.
Validation
We didn't just trust the maths. We ran simulations to check that it works.