Hawthorne Transitory Performance Decay
RCTJournal Article
Immediate test score gains observed during active education programs may reflect temporary increases in student novelty, gratitude, or test-taking effort rather than durable cognitive skill accumulation.
Picture this
A temporary surge in performance caused by being observed or given special attention is like an athlete running faster when spectators cheer; once the crowd leaves, performance drifts back toward fundamental baseline capability.
What the evidence says
Initial short-term test score gains of 0.28 to 0.47 standard deviations decayed to a persistent gain of approximately 0.10 standard deviations one year post-program, revealing significant transitory effort components.
- Who was studied
- N = 9,925 primary school students tracked longitudinal post-program in Vadodara, India.
- How
- Longitudinal follow-up evaluation measuring test performance persistence one year after program participation ceased.
What to do
Conduct post-intervention follow-up testing at least one year after program completion to separate permanent cognitive skill accumulation from temporary Hawthorne effects.
From the source
"One possible interpretation is that the increase of 0.10 standard deviations corresponds to the 'real' impact of the program and that the remainder of the difference was due a transitory increase due to short-term improvement in knowledge... or a Hawthorne effect."
Remedying Education: Evidence from Two Randomized Experiments in India