Research procedure
Score rug quality using expert assessment
- Recruit a local master artisan
- Inspect rugs during intermittent workshop visits
- Score eleven physical dimensions from 1 to 5
Illustrative summary of the source-described quality assessment. Dimensions include corners, waviness, weight, touch, packedness, thread tightness, firmness, design accuracy, inputs and loom; no new quality result is shown.
See source →How
When to use
Measuring product quality in artisanal industries is difficult using sales prices alone. Researchers and program evaluators need an objective method to track technical product improvements over time. This approach deploys expert master craftspeople to evaluate physical goods across standardized quality criteria.
Evaluate manufacturing quality by using independent master craftspeople to score physical products along multiple specific criteria.
- Recruiter hires local master artisans who understand traditional manufacturing techniques and quality standards.
- Evaluator inspects produced goods intermittently during workshop visits.
- Evaluator scores each item across eleven distinct physical metrics on a 1 to 5 scale.
- Evaluator assesses structural metrics including corner alignment, waviness, weight, touch, firmness, and thread tightness.
- Evaluator assesses technical execution metrics including design accuracy, thread packedness, raw inputs, and loom setup.
Why it works
Scoring multiple structural metrics reveals exactly where producers improve their skills over time.
Example
In Fowa, Egypt, a master artisan measured rug quality across eleven dimensions on a 1 to 5 scale, finding that exporting firms scored 0.79 points higher than comparison firms.
About the study
Participants
N = 219 eligible small rug producers (74 treatment, 145 comparison) with fewer than 5 employees in Fowa, Egypt.
Study Design
Randomized Controlled Trial tracking intermittent quality evaluations across 74 treatment firms and 145 comparison firms from 2011 to 2014.
Results
Exporting firms achieved a quality score 0.79 points higher on a 1 to 5 scale relative to comparison firms, which averaged 2.96 points.