Scoring candidate resumes directly through experienced hiring managers captures subtle nuances in education, job history, and skills that simple demographic variables overlook.

Download image · 1200 × 630 PNG

Research steps

Have managers grade anonymised CVs

  1. Sample CVs; remove identifiers
  2. Randomise batches for hiring managers
  3. Grade CVs; aggregate quality scores

Illustrative summary of the source-described procedure. Use excellent, good, average or below average. The Lahore evaluation covers 1,477 jobseekers and 122,946 matches; scores reflect hiring-manager assessments.

See source →

How

When to use

Evaluating applicant quality often relies on self-reported qualifications or crude proxies like years of education, which may fail to capture how employers value complete resume profiles. Hiring manager standardized CV quality scoring presents anonymized candidate resumes to active recruiters to assign objective quality grades. It is intended for employment platforms and researchers evaluating whether candidate recruitment or application interventions alter applicant quality distributions.

Measure candidate quality by having hiring managers evaluate anonymized candidate resumes using a standardized scoring rubric.

  1. Select a representative sample of candidate CV profiles registered on the job matching platform.
  2. Anonymize the CV profiles by removing candidate contact details and personal identifiers.
  3. Recruit hiring managers and recruiters from participating commercial firms to act as independent evaluators.
  4. Present the anonymized candidate CV profiles to the evaluators in randomized batches.
  5. Instruct hiring managers to grade each CV profile as excellent, good, average, or below average based on overall candidate employability.
  6. Aggregate employer grades to establish baseline candidate quality scores for heterogeneity and selection analysis.

Why it works

This produces an employer-validated measure of candidate quality that mirrors real-world recruitment decisions.

Example

In Lahore, Pakistan, research teams presented anonymized CV profiles for 1,477 registered jobseekers across 122,946 matches to hiring managers for standardized quality grading. The resulting scores demonstrated that treatment outreach increased applications equally across all CV quality tiers without diluting applicant quality.

About the study

Participants

N = 1,477 jobseekers (122,946 jobseeker-vacancy matches) evaluated by commercial hiring managers in Lahore, Pakistan.

Study Design

Observational recruiter evaluation study integrated within a randomized field experiment, interplaying employer-assigned CV quality tiers with treatment assignment.

Results

Employer-graded CV scores revealed that proactive phone call treatment increased application rates similarly across excellent, good, and lower quality tiers (p = 0.186 for interaction), with marginal applications achieving identical predicted interview rates (6.3%) as inframarginal applications.

Source

See source →