Positional List-Order Choice Bias

Download image · 1200 × 630 PNG

In Simple Words

Imagine a restaurant menu where 30% of diners order the very first item listed at the top, regardless of what dish it is. The top slot grabs mental focus first, giving that option a built-in advantage over identical items placed further down the page.

Jobseekers on a Lahore job platform

Text-only outreach
31.3% of applications went to the first job
Assigned text plus calls
31.1% of applications went to the first job

Rounds with at least two matches. About 22% of matches were listed first. These are shares of submitted applications, not jobseeker rates.

See source →

Research question

When individuals are presented with a list of options sequentially, the placement of an item at the head of the list creates a systematic choice bias that attracts disproportionate attention and selection regardless of underlying match quality.

Participants

N = 1,116,952 jobseeker-vacancy matches across 9,838 jobseekers in Lahore, Pakistan.

Study Design

Observational choice tracking within an RCT analyzing application probability by vacancy presentation sequence across phone calls and text messages.

Results

Exactly 31.3% of control group applications and 31.1% of treatment group applications were directed to the first vacancy mentioned on the call or text message, despite first-listed vacancies comprising only 22% of all available matches.

Takeaway

Randomize or rotate the presentation sequence of options on decision platforms to prevent list-position bias from skewing user choices toward top-listed items.

Source and citation

See source →

Read alongside the research

Plain-English glossary

Original explanations, informed by the references below. Examples are illustrations, not data from the studies above. The research text stays unchanged.

Randomized controlled trial

A study that uses chance, like drawing lots, to decide who receives each option being compared. Researchers compare the groups’ outcomes to estimate the effect of those options.

ExampleA lottery assigns volunteers to a training programme or a comparison group. Researchers then compare their outcomes.

GET-IT glossary · Randomized study ↗Read more about randomized controlled trial →

Related findings