Within-School Exchangeable Rosters and Randomization Blocks

Download image · 1200 × 630 PNG

In Simple Words

Instead of shuffling players across an entire sports league where positions and rules differ, organizers only swap players between teams that play in the same division during the exact same match time, ensuring fair substitutes without breaking the game schedule.

Observed teachers before the trial

Later trial teachers
Math starting-score spread: 0.382
Other teachers in their schools
Math starting-score spread: 0.520

Pretrial teacher records within schools, in student standard deviations. This does not measure whether randomization removed sorting.

See source →

Research question

Field experiments in public school systems cannot randomly reassign teachers across different schools or non-certified subjects without violating administrative, labor, and credentialing constraints.

Participants

2,462 teachers requested across 316 urban public schools; 1,591 teachers randomly assigned rosters across 668 randomization blocks in 284 schools.

Study Design

Blocked randomized controlled trial grouping teachers into exchange groups based on subject certification, grade level, and common open class periods.

Results

668 randomization blocks were successfully formed across 284 schools. Standard deviation of baseline student sorting across classrooms within these blocks was 0.382 to 0.520 prior to randomization, demonstrating that blocked randomization successfully eliminated substantial pre-existing within-school student sorting.

Takeaway

Restrict random assignment blocks in educational field experiments to subset groups of instructors sharing identical grade, subject certification, and schedule period availability.

Source and citation

See source →

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Baseline

The starting measurements in a study. Researchers use these to compare what participants were like at the start with what happens later.

ExampleBefore a training programme starts, researchers measure workers’ earnings. That first measurement is the baseline.

GET-IT glossary · Baseline characteristics ↗Read more about baseline →
Randomized controlled trial

A study that uses chance, like drawing lots, to decide who receives each option being compared. Researchers compare the groups’ outcomes to estimate the effect of those options.

ExampleA lottery assigns volunteers to a training programme or a comparison group. Researchers then compare their outcomes.

GET-IT glossary · Randomized study ↗Read more about randomized controlled trial →

Related findings