Original source
Are Active Labor Market Policies Directed at Firms Effective? Evidence from a Randomized Evaluation with Local Employment Agencies
Dated research draft · Version date: 19 January 2020
Search for this source ↗Permission for School’s use is unestablished.
Used in these cards
Incorporate annual firm recruitment intention survey data as a core stratification variable when designing randomized labor market field experiments.
"The sample was stratified by indicators for the agency to which the firm was administratively attached, if the firm had intended to recruit in 2014 and by the number of employees on the firm's payroll..."
Delegate candidate initial verification and pre-selection screening to intermediary agency caseworkers to restrict applicant volume and lower private firm evaluation effort.
"In line with the implementation of these types of services, we find that treatment firms receive significantly less applicants for final review, that they expend significantly less effort themselves in generating applicants and that their vacancies are significantly more likely to be filled by counselor-made matches over an 8-week period."
Offer workplace immersion trials and counselor-backed candidate attribute endorsements to employers to verify unobservable soft skills before contract finalization.
"This included 'Valorization' in which counselors put special effort into highlighting specific jobseeker attributes that might be unobservable to, or overlooked by the employer. This could also include an 'evaluation' service whereby the candidate is evaluated through a simulation or immersion in the firm before the decision to hire is made."
Evaluate recruitment agency performance based on the 8-week match conversion rate rather than total candidate referral volume.
"Their vacancies are significantly more likely to be filled by counselor-made matches over an 8-week period."
Assign dedicated recruitment counselors to newly opened vacancies within 24 hours of posting to maximize initial match velocity and candidate placement success.
"We see that treatment and control survival rates diverge in the very first day of vacancy creation with the difference continuing to diverge over the observation period. We can formally reject the null of equality of the survival functions using a Cox regression based test with a p-value of 0.02."
Reallocate public labor market intervention budgets to offer direct, free recruitment support to employers during periods of economic slack.
"In this paper, we explore the effectiveness and potential limitations of a symmetric intervention that assists firms in their recruitment operations in a slack labor market."
Apply double post-Lasso automated variable selection to control for baseline high-dimensional firm attributes without introducing specification search bias.
"To select covariates, we implement the double post lasso developed in Belloni et al. (2014) in order to avoid the risk of specification search... There is almost no impact of adding the additional covariates either on the estimated coefficients or on their standard errors."
Deploy firm recruitment assistance programs continuously across both recessionary and expansionary macroeconomic cycles, switching service focus from candidate generation to applicant filtering.
"This implies that pre-screening services may be effective in reducing 'candidate generating costs' when candidates are hard to come by, but also reduce the screening costs associated with large flows of applications when there are many jobseekers and relatively few jobs."
Provide external candidate filtering support to employers during both economic recessions and economic expansions, adapting services from candidate generation in tight markets to resume pre-selection in slack markets.
"Firms have trouble generating candidates for their vacancies 'when times are good' as benchmark theory would predict, but also when times are bad due to the number of applications they receive when opening a position."
Factor general equilibrium spillover discounts (subtracting 27% to 32% from micro-level hiring estimates) into cost-benefit evaluations before scaling firm-targeted labor interventions nationwide.
"For each hire in a treated firm the real increase in the total workforce in the market will be only 0.68. This suggests that even with a marginal intervention equilibrium effects can matter."
Proactively offer free recruitment services and vacancy cost reductions to small and medium enterprises during economic downturns to stimulate permanent employment demand.
"We show that this shock led to a 24% increase in open-ended vacancy postings with the PES that translated into a 10% increase in permanent contract hires for registered jobseekers, on average over a six-month treatment period."
Focus intensive public placement and pre-selection services on employer accounts that have established communication histories with public employment counselors before launching cold recruitment outreach.
"In contrast we find that employment creation is completely centered on firms that were previously in contact with the PES. We find average treatment effects very close to zero for firms which were not formerly in contact with PES counselors. But for firms which were, we detect large significant effects: +0.124 hires of registered jobseekers in permanent contracts and we reject the null of equal impacts (p-value of 2.1%)."
Offer public vacancy cost subsidies specifically tailored to low-qualification entry-level roles where upfront hiring expenses block marginal employment creation.
"This evidence conforms to the idea that the drop in vacancy costs allowed treatment firms to create less productive jobs... compensated by the drop in the recruitment cost."
Construct a priority targeting index that ranks sectors by local labor market tightness and job-finding rates to direct employer outreach toward the most depressed micro-markets.
"We created a priority ranking of professions per agency based on local-level tightness and job finding probabilities weighted by the stock of jobseekers registered in the agency. Using a profession-sector correspondence table, we then merged these 'priority professions' to sectors."
Calculate labor market tightness at the intersection of commuting zone and industrial sector to capture localized supply-demand frictions.
"We calculate tightness again at the micro-market level (commute-zone x sector) to obtain a more granular indicator of the labor market conditions faced by sample firms at the beginning of the intervention."
Apply 99th percentile top-coding truncation to administrative labor market outcome variables prior to running linear treatment regressions in randomized trials.
"Finally, we top-code all administrative data at the 99th percentile of their distribution in order to make sure our linear estimates are not driven by a few, very large recruiting firms."
Establish 1 to 5 non-negotiable prerequisite criteria directly with hiring managers before shortlisting candidates to align candidate screening with unstated firm needs.
"Special criteria involves working with the employer to establish a maximum of 1-5 prerequisites, on which to select candidates that are not necessarily observable in the vacancy posting... Coefficient and control mean indicates that treated firms are much more likely to receive this service for their vacancies, +122%."
Delegate resume screening to external public recruitment counselors who establish pre-selection criteria and limit final interview slates to a maximum of 10 pre-verified candidates.
"With 'verification' the PES counselor could recommend that firms choose to have applicants apply only through the counselor by making the vacancy private (not publicly available online). Or, if publicly posted, jobseekers could only see the brand or chain name and thus cannot contact the recruiter directly, thus shifting the pre-screening responsibility entirely to the counselor."
Convert public online job postings into private agency-administered listings to restrict applicant inflows and eliminate unvetted application volume.
"Importantly, implementation of verification implies that counselors take control of how firms receive applications. For instance, they can make the vacancy private so that it is not publicly available on the internet, only in agencies."
Restrict public access to online job postings by making listings anonymous or private, routing all candidate submissions through designated screening intermediaries.
"With 'verification' the PES counselor could recommend that firms choose to have applicants apply only through the counselor by making the vacancy private (not publicly available online)... We see that treatment increases the proportion of vacancies that were made private by 57%..."
Initiate proactive outreach campaigns where caseworkers contact employers directly to identify latent hiring demands rather than relying on passive vacancy submissions.
"Counselors in the 129 participating local employment agencies intensively prospected treatment firms for 3 months starting on September 15th, 2014 while the control group was 'sanctuarized' until March 31, 2015..."
Utilize standard 1 to 3 month statutory probation windows alongside external candidate pre-screening to mitigate termination risks associated with open-ended permanent employment contracts.
"A trial period or période d'essai, typically lasts 1-3 months for permanent contracts in France in which either side can unilaterally end the contract without consequence... This provides evidence that the program helped firms hire workers that made it past the formal trial period."
Provide official public caseworker endorsements and pre-selection evaluations for long-term unemployed applicants to counteract negative employer perceptions during hiring.
"Our study shows that screening services offered by the PES are services that firms demand in part because they may alleviate the uncertainty about hiring the unemployed."
Validate field experiment statistical significance by running 10,000-iteration randomization permutation tests alongside standard asymptotic t-tests.
"Following Young (2018), we implement randomization inference for the usual student test, using 10,000 permutations tests. This allows to obtain a consistent estimate of the exact p-value of our test."
Isolate permanent contract hires or restrict evaluation windows to contracts exceeding minimum threshold durations when assessing active labor market policy impacts.
"For example, roughly 53% of all flows concern fixed or temp contracts of a week or less. Not surprisingly, the standard deviation of hires over all contracts is 9.9 times as large as that of permanent contracts. This obviously inhibits our ability to detect a significant effect on overall hiring as the impact on permanent contract hires is diluted."
Equip employment counselors to proactively present pre-vetted jobseeker profiles directly to firm managers without waiting for an official vacancy posting to trigger hiring.
"These spontaneous candidate promotions are defined as a counselor presenting a résumé to an employer in absence of a declared hiring need or vacancy."
Convert disparate contract hiring flows into standardized cumulative workday metrics before evaluating the aggregate impact of employment interventions.
"This 'theoretical number of workdays' allows us to have a standardized measure of employment creation... calculating workdays allows us to compare the overall theoretical employment creation within and across contract types."
Track applicant generation separately across caseworker-initiated, employer-initiated, and jobseeker-initiated channels to isolate search effort substitution.
"These data are novel in that they provide a measure of search effort put forth by each of the three actors."
Track post-intervention recruitment metrics over a multi-year horizon to distinguish between permanent job creation and temporary public agency posting channel substitution.
"Figure 4a shows positive and significant effects during the sanctuary period (15 Sep. - 31 Dec. 2014), but we see also they progressively decline starting May 2015... Although standard errors are large, these results indicate that treatment firms posted relatively less vacancies than control firms after the sanctuary period."
Utilize standardized public agency drafting templates to ensure job postings meet statutory non-discrimination standards and clearly specify skill prerequisites.
"French law requires that vacancies do not discriminate on the basis of demographic characteristics such as gender or race and that they contain adequate job descriptions: a baseline salary offer, skill requirements and working times and hours."
Exclude multi-branch corporate establishments from organizational field trials to prevent internal knowledge spillovers from contaminating control units.
"We thus exclude firms that had multiple branches included in the experiment due to the possibility of within-company spillover effects that would dilute treatment effects. Our final sample comprises 7,438 unique firms."