Hawthorne Effect Mitigation in Phone Surveys

In Simple Words

Imagine keeping a daily food diary—just the act of writing down every meal might make a person eat healthier even if they are not on an official diet. Standardizing survey phrasing to mirror baseline surveys ensures that frequent calls act purely as an invisible measuring tape without nudging participants to change their actual habits.

Research question

High-frequency survey tracking carries the risk of inducing Hawthorne or experimenter demand effects, where frequent questioning artificially increases study participants' job search behavior or alters their reporting independent of policy interventions.

Participants

**N = 3,052 participants** surveyed fortnightly via phone panels in Addis Ababa, Ethiopia.

Study Design

Methodological validation testing for measurement-induced behavioral distortions across high-frequency phone panel rounds (referencing Franklin, 2017).

Results

Standardized fortnightly phone surveys collected reliable longitudinal search data without generating detectable Hawthorne or priming effects, preserving true treatment-control contrast across survey rounds.

Takeaway

Structure high-frequency panel questionnaires using identical baseline wording and non-directional prompts to avoid inducing behavioral measurement artifacts among study participants.

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Longitudinal study

A study that checks the same group of people at different times. This lets researchers examine how things change over time.

ExampleResearchers ask the same workers about their wellbeing at the start, after three months and after six months.

NICE · Longitudinal study ↗Read more about longitudinal study →

Baseline

The starting measurements in a study. Researchers use these to compare what participants were like at the start with what happens later.

ExampleBefore a training programme starts, researchers measure workers’ earnings. That first measurement is the baseline.

GET-IT glossary · Baseline characteristics ↗Read more about baseline →

Related findings

• Active Tracking Attrition Mitigation →Methods & evidence

  Dispatching field teams directly to children's homes when they miss school testing operates like a home delivery service tracking down uncollected mail to ensure every package is accounted for.

• High-Frequency Survey Recall Validation →Methods & evidence

  Imagine testing whether an accounting class helps people manage money by asking them to estimate their monthly spending at the end of thirty days. To double-check if their end-of-month estimates are accurate or just wild guesses, a researcher checks in with them every single evening to log every penny spent that day, comparing the daily total against the monthly memory estimate.

• Commercial Ad Platform Algorithmic Randomization Imbalance →Methods & evidence

  Allowing a commercial ad algorithm to handle randomization is like letting a profit-driven tournament host pick matching opponents. The platform optimizes for click rates rather than making sure both starting teams are equally balanced.

• Multi-Source Administrative-Survey Data Triangulation →Methods & evidence

  Think of monitoring a patient's health by combining heart rate monitors and blood tests with direct interviews about how they feel. Combining automated medical readings with verbal feedback provides a complete, accurate picture of health rather than relying on either measurement alone.