Conceptliving benchmark
Living Benchmark
A benchmark design philosophy that maintains the freshness and difficulty of evaluation by periodically adding new items, retiring outdated items, and tracking the latest research results, thereby addressing data contamination and saturation in static benchmarks.
Timeline (last 90 days)
Oct 26
A living benchmark maintains the freshness and difficulty of the evaluation by periodically adding new questions, retiring outdated ones, and tracking the latest research results.
Unverified50%