Unverified50% confidenceFactExact time
LiveNerf reruns a set of independent benchmarks every day, such as GPQA and SWE-bench, and plots the results in charts recorded in a GitHub repository.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/28/2026
First Seen
Valid until: 12/27/2026
Sources
Related Entities
Related Claims
UnverifiedSWE-bench evaluates a model's ability to resolve real GitHub issues, while LiveCodeBench uses competitive programming problems to prevent data contamination.66% similarUnverified代码同步到GitHub意味着遵循标准开源生态规范，可在Vercel、Railway、阿里云等云平台重新部署65% similarUnverifiedGitHub Models的免费层包含每分钟请求数和每日Token总量的限制，适合开发测试和原型验证场景64% similarUnverifiedSWE-bench要求模型在真实GitHub仓库中定位问题并生成可通过CI测试的补丁，以Resolve Rate作为核心指标64% similarUnverifiedOnyx uses Git directly as its experiment tracking system, recording each experiment through Git commits.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/955016API
curl https://kongchang.com/api/v1/knowledge/claims/955016MCP
get_claim(id=955016)