[KongchangAI]
Benchmark

EvoArena

An AI agent evaluation benchmark proposed by the National University of Singapore, focused on assessing agents' continuous adaptation capabilities in dynamically evolving environments. It encompasses three scenarios: Terminal, Software Engineering (SWE), and personalized dialogue.

Timeline (last 90 days)

Sep 16

EvoArena was proposed by a team led by PhD student Xu Xundong from the National University of Singapore, and is used to evaluate the continuous adaptation ability of AI agents in dynamically changing environments.

Unverified50%
Sep 16

An agent's behavior is the result of the joint action of the model, tools, memory, and environmental state; even if the model, tools, memory, and task instructions remain unchanged, a change in the environment will cause behavioral changes.

Unverified50%
Sep 16

EvoArena focuses on Environment Evolution, which is distinct from Dynamic Task generation and Agent Evolution.

Unverified50%
Sep 16

EvoArena constructs three types of dynamic environment scenarios: Terminal-Bench Evolve (workflow scenario), SWE-Chain Evolve (software engineering scenario), and Persona-Mem Evolve (social intelligence scenario).

Unverified50%
Sep 16

In EvoArena testing, GPT-5.5, which achieved the highest Step Level score, had an accuracy of just over 50%, while Gemini-3.1 Pro and GLM-5.1, which performed best at the Chain Level, reached only approximately 28%–29%.

Unverified50%

All Facts (5)

Source Articles