Subjective surveys often reflect user optimism or social desirability bias rather than physical reality.

Download image · 1200 × 630 PNG

Research procedure

Compare reported and measured stove performance

  1. Ask about fuel, cost and cooking time
  2. Weigh fuel and time cooking sessions
  3. Compare reports with physical measurements

Illustrative summary of the source-described audit in 2,575 households across 44 villages over four years. Fuel weight is measured before and after cooking. Positive user reports alone do not establish actual fuel or time savings.

See source →

How

When to use

Program managers evaluate technology adoption using household surveys, but self-reported feedback often suffers from perception bias. When assessing energy or time savings, subjective user responses can contradict actual physical performance. Evaluators combine survey questions with objective measurements of fuel weight and cooking duration to detect performance discrepancies.

Audit household fuel consumption and cooking duration by comparing subjective survey responses with direct physical measurements.

  1. Field evaluators visit sampled households in rural target villages across evaluation waves.
  2. Evaluators administer survey questionnaires asking households to estimate daily fuel usage, fuel costs, and total cooking time.
  3. Evaluators collect objective data by measuring fuel wood weights before and after cooking sessions.
  4. Evaluators measure actual cooking durations across meals using timed observation logs.
  5. Evaluators compare self-reported user perceptions with objective physical measurements to determine true performance.

Why it works

Auditing self-reports against direct physical measurements isolates true technological savings from perceived benefits.

Example

Evaluators tested 2,575 households across 44 villages in Orissa, India over four years. While households reported in surveys that new stoves performed well by saving fuel and cooking time, objective measurements showed clean stoves caused no significant reduction in actual fuel usage, fuel costs, or cooking duration.

About the study

Participants

2,575 households in 44 rural villages, Orissa, India.

Study Design

Four-year longitudinal Randomized Controlled Trial (RCT) auditing subjective survey responses against objective measures of fuel usage and cooking time across lottery waves.

Results

Clean stoves did not reduce actual fuel usage, fuel expenditures, or cooking time, despite households reporting positive performance on both measures in subjective survey responses.

Source

See source →