Unverified60% confidenceFactExact time
A single LLM judge exhibits position bias (a tendency to give higher scores to answers that appear first) and self-enhancement bias (a tendency to give higher scores to outputs in its own style).
2
Sources
60%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Related Claims
UnverifiedSingle judge models have known biases including position bias, length bias, and self-enhancement bias.84% similarVerifiedLLM-as-a-Judge方法存在位置偏差、冗长偏差和自我偏好偏差等已知系统性偏差80% similarUnverified多评判者投票系统在多个存在不同偏差的评判者独立评分时偏差方向相互抵消，聚合结论可靠性高于单一评判者79% similarUnverifiedLLM judges exhibit position bias: in pairwise comparisons, judges tend to favor the answer in a certain position, usually the first; merely swapping the order of the candidate answers can flip the ranking (Wang et al.).79% similarUnverifiedJudge models exhibit systematic biases: favoring output styles similar to their own training distribution, giving higher scores to longer responses (verbosity bias), and being sensitive to the position of answers in the prompt (position bias).74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/513810API
curl https://kongchang.com/api/v1/knowledge/claims/513810MCP
get_claim(id=513810)