Exogenous Failure Assignment
In observational settings, analyzing how individuals respond to negative performance feedback is confounded by self-selection, as individuals who voluntarily choose difficult tasks differ systematically from those who select easy tasks.
Picture this
Imagine testing how drivers handle an unexpected patch of black ice on a road. If drivers only go onto the icy road voluntarily, only risk-tolerant drivers are tested; but if a road detour forces a random selection of drivers onto the ice patch, researchers can measure true handling ability and recovery without selection bias.
What the evidence says
Among the subset forced into the difficult task who failed in Round 1 (N = 558 in Sample A, N = 522 in Sample B), treated students re-attempted the difficult task in Round 2 at rates 17.6 percentage points higher in Sample A (p = 0.002) and 13.9 percentage points higher in Sample B (p = 0.064) than control group baseline rates of 36% and 51%.
- Who
- N = 1,491 elementary school students forced into the difficult task in Round 1 (Sample A: N = 817; Sample B: N = 674) in Istanbul, Turkey.
- How
- Randomized assignment implemented via a 50% chance of forced execution in Round 1 to break self-selection into task difficulty.
What to do
Implement forced probabilistic assignment to challenging condition rounds in experimental trials to evaluate post-failure persistence free of selection bias.
From the source
"This procedure allows us to have a random subset of children where the effects of 1st round feedback on 2nd round task choices can be analyzed free of selection."
Ever Failed, Try Again, Succeed Better: Results from a Randomized Educational Intervention on Grit