Evaluation-Induced Gender Bias
Subjective evaluation systems can introduce systematic demographic bias when financial stakes are introduced into performance appraisals. Evaluators who display no observable bias in non-monetary feedback may favor specific employee demographic groups when evaluations directly dictate wage increases.
Picture this
Imagine a judge who gives honest, balanced feedback during non-competitive practice rounds, but subconsciously gives higher scores to familiar faces when actual prize money is on the line. Adding high financial stakes to human judgment opens the door for unconscious demographic preferences to sway final pay decisions.
What the evidence says
When subjective evaluations directly determined financial raises, male teachers received 10% higher performance ratings controlling for teacher actions and student outcomes; when evaluations carried no financial stake, no evaluation difference by gender existed.
- Who
- N = 6,080 teachers (80% female) and 189 managers (61% female) across 234 private schools in Pakistan.
- How
- Randomized controlled trial (RCT) combined with vignette-based survey experiments and administrative appraisal analysis controlling for teacher actions and student outcomes.
What to do
Pair high-stakes subjective rating systems with high-frequency managerial monitoring and explicit evaluation rubrics to eliminate demographic evaluation disparities.
From the source
"When manager evaluations affect employees' raises, we find male teachers receive 10% higher evaluations controlling for a rich set of teacher actions and student outcomes. When evaluations are only used for feedback, but do not have a financial stake, we see no difference in evaluation score by gender."
Subjective versus Objective Incentives and Employee Productivity