In Simple Words
When some assigned groups fail to receive a promised intervention, using initial random assignment as an indicator to adjust overall outcomes is like measuring a fitness program's impact based on everyone invited, then mathematically adjusting for those who actually attended the gym.
Research question
In field experiments, non-compliance—such as administrative failures where assigned schools fail to receive tutors or participants decline intervention—biases direct treatment estimates.
Participants
N = 9,986 Grade 3 and Grade 4 students across 77 municipal primary schools in Mumbai, India.
Study Design
Instrumental Variables (IV) / Two-Stage Least Squares (2SLS) regressing test score improvements on actual treatment status using random assignment intention-to-treat (ITT) as an instrument.
Results
In Year 2 in Mumbai, 33% of schools assigned to receive a balsakhi tutor did not receive one due to administrative difficulties; 2SLS instrumentation successfully eliminated non-compliance bias to yield unbiased direct treatment estimates.
Takeaway
Use initial random assignment as an instrumental variable in Two-Stage Least Squares regression when evaluating educational interventions affected by program non-compliance or implementation failure.