[KongchangAI]
Benchmark

MuSiQue

A standard benchmark dataset in the multi-hop question answering domain, focused on complex question answering tasks requiring reasoning across multiple documents. It is distinguished by its question complexity design, intended to probe deep multi-step reasoning capabilities in language models.

Timeline (last 90 days)

Oct 19

SAG2 uses no embeddings, adopting SQLite plus BM25 together with a lightweight "System One" model to make contextual evidence decisions at query time; indexing about 11,600 passages takes only 2.36 seconds with zero model calls, matching the recall level of dense retrieval on MuSiQue, 2Wiki, and HotpotQA.

Unverified50%
Oct 7

Multi-hop QA is a class of questions that require reasoning across multiple independent evidence fragments to answer, with mainstream benchmarks including HotpotQA, MuSiQue, and 2WikiMultiHopQA.

Unverified50%
Oct 2

The experiment was conducted on 400 samples drawn from three multi-hop QA datasets: MuSiQue, HotpotQA, and 2WikiMultiHopQA.

Unverified50%

All Facts (3)

Source Articles