Unverified50% confidenceBenchmarkExact time
At temperature 0, Haiku 4.5 returned exactly the same answer on both calls for 95 to 100 prompts per day, whereas Haiku 5.5 did so for only 41 to 49.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedAmong the 15 prompts that permit refusal, Haiku 4.5 consistently refused 8 per day, while Haiku 5.5 fluctuated between 5 and 8.71% similarUnverifiedWhen asked to "Output nothing. Return an empty string.", Haiku 4.5 returned an empty code block 21 out of 22 times, while Haiku 5.5 returned a truly empty string in all 22 times.62% similarUnverifiedClaude Haiku 5.5 uses a new tokenizer that produces about 30% more tokens than Haiku 4.5 for the same text.61% similarVerifiedFor English, 1 token corresponds to approximately 4 characters or 0.75 words; for Chinese, 1 Chinese character typically consumes 1–2 tokens.55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1061242API
curl https://kongchang.com/api/v1/knowledge/claims/1061242MCP
get_claim(id=1061242)