Placebo Validation of Information Treatment Mechanisms

In Simple Words

Imagine giving a vitamin supplement to someone who already has perfect vitamin levels; if their health stays completely unchanged while deficient people improve, it proves the supplement works specifically by correcting deficiencies rather than through a placebo effect.

Research question

Field experiments delivering informational disclosures risk confounding pure belief-updating channels with experimenter demand effects, Hawthorne effects, or simple attention shocks.

Participants

N = 598 Community Health Workers who held accurate baseline beliefs regarding supervisor salary (250,000 SLL) across Peripheral Health Units in Sierra Leone.

Study Design

Empirical placebo group comparison within a randomized information experiment, tracking performance changes among workers whose baseline salary beliefs equaled the truth.

Results

Disclosing official supervisor salary to workers with accurate baseline beliefs produced no statistically significant change in household visits under either meritocratic (+1.308 visits; p = 0.608) or non-meritocratic (-0.968 visits; p = 0.608) promotion regimes, ruling out attention or demand artifacts.

Takeaway

Include pre-surveyed accurate-belief subgroups as empirical placebo controls when designing information intervention trials to rule out attention shocks.

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Baseline

The starting measurements in a study. Researchers use these to compare what participants were like at the start with what happens later.

ExampleBefore a training programme starts, researchers measure workers’ earnings. That first measurement is the baseline.

GET-IT glossary · Baseline characteristics ↗Read more about baseline →

Statistically significant

A label used when a result passes a chosen statistical threshold, often p < 0.05. It does not show how large or useful an effect is. A result that is not statistically significant does not prove there is no effect.

ExampleA study reports p = 0.03 against a 0.05 threshold. It passes that test, but the effect could still be too small to matter.

American Statistical Association · Statement on p-values ↗Read more about statistically significant →

Related findings

• Administrative Social Security Data Linkage for Earnings Measurement →Economics (general)

  Instead of asking individuals to remember and report exact yearly income numbers from a decade ago, researchers obtain signed consent to link survey profiles directly to official government tax records. This creates an unalterable, objective earnings ledger covering years before and after a financial event.

• Agnostic Machine Learning Heterogeneity Detection in Field Trials →Economics (general)

  Evaluating a program using only average results is like measuring the average temperature of a room with one frozen wall and one burning wall and concluding the room is comfortable. Machine learning acts like a thermal camera, splitting the room into sections to reveal the extreme cold and extreme heat hiding behind the average.

• Asymmetric Wealth Effect of Subsidized Index Contracts →Economics (general)

  Imagine buying a lottery ticket that costs $1, but pays out $1,000 if a major storm hits. Paying $1 during normal weather is so cheap that it does not change weekly spending or force extra work hours to make up for the cost.

• Audit-Protected Performance Measurement →Economics (general)

  Imagine a classroom exam where students know that random answer sheets will be double-checked by independent outside inspectors; unpredictable audits prevent students from cheating or making fake arrangements with graders.