Strategic Misreporting in High-Stakes Peer Evaluation
RCTReview
When community members know peer evaluations directly determine who receives tangible financial benefits, personal incentives conflict with truthful reporting [1, 7]. Evaluators distort rankings to favor family members, close friends, or business partners, degrading the diagnostic value of peer information [1, 11].
Picture this
Imagine a teacher asking students to vote on which classmate gets a free laptop, where students naturally vote for their best friends rather than the most deserving student. When rankings directly control who wins a valuable grant, evaluator self-interest and social loyalty override honesty, causing respondents to systematically inflate scores for close peers [1, 7, 11].
What the evidence says
Ranking report accuracy dropped by 30% to 34% when financial resources and grant allocations were at stake due to nepotism and peer favoritism [11].
- Who was studied
- 1,345 households in 274 peer groups of five microentrepreneurs in Amravati, Maharashtra, India [5, 6].
- How
- Randomized field experiment varying reporting stakes (High Stakes where top-ranked peers received extra lottery tickets vs. No Stakes) and visibility (Public vs. Private) [7, 12, 13].
What to do
Decouple peer-ranking surveys from direct, unadjusted grant allocation decisions to prevent strategic distortion and nepotistic reporting.
From the source
"The accuracy of responses dropped on average by 30 to 34 percent when the allocation of resources was at stake." [11]
Impact_of_Community_Information_in_Identifying_High_Ability_Microentrepreneurs.pdf