Peer Cognitive Evaluation Asymmetry

Download image · 1200 × 630 PNG

In Simple Words

Imagine asking two people to predict how well their friends will solve a set of complex math puzzles. A math expert accurately judges which friends possess true mathematical talent, whereas someone who struggles with basic arithmetic cannot tell which of their friends is actually good at solving math problems.

Male referrers in Kolkata

Above-average puzzle scores
Score change 0.190 standard deviations per predicted puzzle
Below-average puzzle scores
Score change 0.025 standard deviations per predicted puzzle

Observed score groups. Changes per extra puzzle predicted solved. Low-score estimate uncertain, with weak instruments; no causal group or formal interaction claim.

See source →

Research question

Workers across different ability levels do not possess equal capability in estimating the cognitive job skills of their peers, resulting in unequal screening effectiveness across the workforce.

Participants

N = 505 male labor market participants (280 high-ability, 225 low-ability) in Kolkata, India.

Study Design

Heckman selection model regressing actual referral puzzle task scores on referrer pre-task predictions across high-ability vs low-ability participant subsamples.

Results

High-ability workers accurately predicted referral puzzle scores (coefficient = 0.190, p < 0.05), corresponding to an 0.8 standard deviation performance difference, whereas low-ability workers showed no statistically significant predictive accuracy (coefficient = 0.025, p > 0.10).

Takeaway

Audit referral recommendations based on referrer job performance before relying on referrer predictions, as low-performing employees lack the ability to accurately gauge peer capability.

Source and citation

See source →

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Statistically significant

A label used when a result passes a chosen statistical threshold, often p < 0.05. It does not show how large or useful an effect is. A result that is not statistically significant does not prove there is no effect.

ExampleA study reports p = 0.03 against a 0.05 threshold. It passes that test, but the effect could still be too small to matter.

American Statistical Association · Statement on p-values ↗Read more about statistically significant →

Related findings