Tag
external_validity
5 findings
EducationBetween-School Generalizability Limit of Within-School RCTsRandom assignment was strictly bounded within individual schools, grade levels, and subjects, preventing statistical evaluation of whether teacher value-added metrics hold predictive validity for cross-school teacher transfers or district-wide comparisons.RCTLabour & employmentCasual-Labor Field-Laboratory Screening ProxyReplicated real-world day-labor market conditions where 91 percent of participants were active labor force participants and 45 percent had made real job referrals, achieving a 72 percent return rate (N = 407 referrals) with robust experimental control over financial and screening incentives.RCTMethods & evidenceCross-Sample Intervention ReplicabilityKey treatment effects replicated across both cohorts with striking consistency: persistent choice of challenging tasks increased by 8.5 percentage points in Sample A (p < 0.01) and 12.9 percentage points in Sample B (p < 0.01); week-ahead commitment increased by 14.3 percentage points in Sample A (p < 0.01) and 19.1 percentage points in Sample B (p < 0.01); and second-visit success increased by 8.7 percentage points in Sample A (p < 0.01) and 10.7 percentage points in Sample B (p < 0.05).RCTMethods & evidenceExperimental Self-Selection Verification and External ValidityProject firms showed no statistically significant differences from nonproject firms in pre-intervention assets ($12.8M vs $13.9M, p = 0.841), employees (204 vs 221, p = 0.552), total borrowings ($4.9M vs $5.5M, p = 0.756), or baseline BVR management scores (2.52 vs 2.55, p = 0.859).Observational StudyEconomics (general)Non-Applicant Selection Bias in Active Labor Market EvaluationsControl application rate was 43% in Experiment 1 and job fair attendance was 5.9% in Experiment 2, establishing that recruitment messaging alters who enters the sample pool before program training impact evaluation occurs.RCT