Unverified50% confidenceFactExact time
LLM judges exhibit position bias: in pairwise comparisons, judges tend to favor the answer in a certain position, usually the first; merely swapping the order of the candidate answers can flip the ranking (Wang et al.).
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
Unverified'Position bias' is a systematic bias documented in multiple studies: LLMs in two-option comparisons tend to favor the option listed first or last79% similarUnverifiedA single LLM judge exhibits position bias (a tendency to give higher scores to answers that appear first) and self-enhancement bias (a tendency to give higher scores to outputs in its own style).79% similarVerifiedLLM-as-a-Judge方法存在位置偏差、冗长偏差和自我偏好偏差等已知系统性偏差76% similarUnverifiedLLM-as-Judge存在位置偏见（Position Bias）和奉承偏见（Sycophancy Bias）等问题74% similarUnverifiedThe paired comparison design separates the two factors of modality preference and evidence position, allowing changes in answers after swapping the order to be directly attributed to position itself.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066479API
curl https://kongchang.com/api/v1/knowledge/claims/1066479MCP
get_claim(id=1066479)