Holding salary information identical across treatment arms ensures that differences in post-treatment responses isolate changes in social image beliefs.

Download image · 1200 × 630 PNG

Research procedure

Measure beliefs before and after information

  1. Ask baseline stigma and salary questions
  2. Randomly assign salary-only or salary-plus-stigma information
  3. Repeat belief questions; provide phone credit

Illustrative summary of the source-described survey sequence for 300 Cairo jobseekers. Salary information is identical across groups; starting and five-year salary expectations are measured.

See source →

How

When to use

Researchers and evaluators often struggle to determine whether messaging interventions alter psychological stigma beliefs or monetary return expectations. Program designers need a method to isolate mechanisms and verify that information treatments change social image perceptions without confounding income expectations. This approach serves job assistance organizations seeking to measure baseline and post-treatment beliefs among jobseekers.

Conduct an online survey experiment with pre- and post-information questions to track changes in stigma beliefs and income expectations among jobseekers.

  1. Partner with an employment organization to enroll jobseekers into an online survey platform.
  2. Collect baseline demographic characteristics including age, gender, education, and employment status.
  3. Ask baseline questions regarding perceptions of societal stigma and expected short-term and five-year salaries for entry-level positions.
  4. Randomly assign respondents to receive either salary-only information or salary information combined with a salient stigma statement.
  5. Re-ask the questions regarding societal stigma, family pride, peer respect, and expected starting and five-year salaries.
  6. Provide telephone credit to participants upon survey completion in appreciation for their time.

Why it works

Tracking baseline and endline beliefs enables ANCOVA estimation of direct treatment effects on non-monetary perceptions.

Example

Researchers partnered with the National Employment Pact in Cairo, Egypt to survey 300 blue-collar jobseekers using phone credit incentives. Receiving the salient stigma script increased the belief that society looks down on entry-level jobs by 0.10 points without altering short-term or five-year salary expectations.

About the study

Participants

300 unemployed and underemployed blue-collar jobseekers in Greater Cairo, Egypt.

Study Design

Online randomized survey experiment using ANCOVA regressions controlling for baseline values to evaluate post-treatment belief changes across control and treatment arms.

Results

The salient stigma statement significantly increased beliefs that society looks down on entry-level jobs (+0.10 points, p < 0.01) and reduced expected family pride (-0.15 points, p < 0.10), while producing no significant change in current salary expectations (+57 EGP/month, p = 0.27) or five-year salary expectations (-92 EGP/month, p = 0.46).

Source

See source →