Full Caseworker Discretion and System Sabotage

Download image · 1200 × 630 PNG

In Simple Words

Imagine giving a veteran ship captain an automated weather navigation computer, but leaving its use completely optional. If the captain believes personal intuition is superior and fears the computer might eventually replace human judgment, the captain will leave the computer turned off and navigate strictly by memory.

Swiss jobseekers: estimated download effect

Prediction not downloaded
Comparison condition
Prediction downloaded
No clear overall change in programme matching

2005 trial, excluding Geneva. Instrumental-variable estimates; matching measured within 90 days. An uncertain effect is not proof of zero.

See source →

Research question

Implementing decision-support software under a policy of full caseworker discretion without binding incentives leads frontline staff to disregard or actively sabotage the system. While restricting discretion risks crowding out intrinsic caseworker motivation and ignoring valuable private information, complete discretion renders statistical targeting tools ineffective.

Participants

N = 142 treatment caseworkers managing jobseekers across Swiss regional employment offices in a randomized pilot experiment (excluding Geneva).

Study Design

Randomized field study utilizing server access logs to track download frequencies, combined with Instrumental Variables (2SLS) estimation using caseworker randomization as an instrument for prediction downloads.

Results

15% of treatment caseworkers (21 out of 142) never downloaded predictions for any client, overall predictions were inspected for only 37% of jobseekers, and IV estimates confirmed that downloading predictions had no statistically significant effect on compliance rates (0.00 to -0.05 across specifications).

Takeaway

Design algorithmic implementation protocols that combine caseworker discretion with explicit compliance incentives or mandatory justification requirements when deviating from statistical predictions.

Source and citation

See source →

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Statistically significant

A label used when a result passes a chosen statistical threshold, often p < 0.05. It does not show how large or useful an effect is. A result that is not statistically significant does not prove there is no effect.

ExampleA study reports p = 0.03 against a 0.05 threshold. It passes that test, but the effect could still be too small to matter.

American Statistical Association · Statement on p-values ↗Read more about statistically significant →

Related findings