In Simple Words
Imagine giving a veteran ship captain an automated weather navigation computer, but leaving its use completely optional. If the captain believes personal intuition is superior and fears the computer might eventually replace human judgment, the captain will leave the computer turned off and navigate strictly by memory.
Swiss jobseekers: estimated download effect
- Prediction not downloaded
- Comparison condition
- Prediction downloaded
- No clear overall change in programme matching
2005 trial, excluding Geneva. Instrumental-variable estimates; matching measured within 90 days. An uncertain effect is not proof of zero.
See source →Research question
Implementing decision-support software under a policy of full caseworker discretion without binding incentives leads frontline staff to disregard or actively sabotage the system. While restricting discretion risks crowding out intrinsic caseworker motivation and ignoring valuable private information, complete discretion renders statistical targeting tools ineffective.
Participants
N = 142 treatment caseworkers managing jobseekers across Swiss regional employment offices in a randomized pilot experiment (excluding Geneva).
Study Design
Randomized field study utilizing server access logs to track download frequencies, combined with Instrumental Variables (2SLS) estimation using caseworker randomization as an instrument for prediction downloads.
Results
15% of treatment caseworkers (21 out of 142) never downloaded predictions for any client, overall predictions were inspected for only 37% of jobseekers, and IV estimates confirmed that downloading predictions had no statistically significant effect on compliance rates (0.00 to -0.05 across specifications).
Takeaway
Design algorithmic implementation protocols that combine caseworker discretion with explicit compliance incentives or mandatory justification requirements when deviating from statistical predictions.
Source and citation
See source →Read alongside the research
Plain-English glossary
Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.
- Statistically significant
A label used when a result passes a chosen statistical threshold, often p < 0.05. It does not show how large or useful an effect is. A result that is not statistically significant does not prove there is no effect.
ExampleA study reports p = 0.03 against a 0.05 threshold. It passes that test, but the effect could still be too small to matter.
American Statistical Association · Statement on p-values ↗Read more about statistically significant →