Position Bias

A documented systematic bias in LLM evaluation whereby models tend to favor options appearing at specific positions, such as first or last, in comparative assessments, independent of the actual quality of those options. The bias originates from language models' sensitivity to sequence position.