HG2.9K
A benchmark for evaluating Python dependency repair systems, comprising 2,891 code snippets with dependency failures. The dataset is primarily sourced from competitive programming problem and solution databases.
Timeline (last 90 days)
The HG2.9K benchmark contains 2,891 code snippets with dependency failures.
On the HG2.9K benchmark, PLLM+ resolved 1,500 snippets while the baseline method PLLM resolved only 1,169, representing an improvement of approximately 28%.
The code snippets in the HG2.9K benchmark largely originate from programming competitions and are accompanied by a solution database.
All Facts (3)
The HG2.9K benchmark contains 2,891 code snippets with dependency failures.
50%UnverifiedOn the HG2.9K benchmark, PLLM+ resolved 1,500 snippets while the baseline method PLLM resolved only 1,169, representing an improvement of approximately 28%.
50%UnverifiedThe code snippets in the HG2.9K benchmark largely originate from programming competitions and are accompanied by a solution database.
50%