Verified70% confidenceFactExact time
GPQA is a benchmark designed for PhD-level scientific question answering, with questions difficult enough that domain experts can only answer approximately 65% correctly.
4
Sources
70%
Confidence
Long-term
Relevance
7/18/2026
First Seen
Sources
Related Claims
UnverifiedGPQA is a PhD-level scientific question-answering benchmark designed by NYU researchers, with questions that avoid knowledge points answerable through simple searches.85% similarUnverifiedGPQA Diamond is the hardest and most strictly filtered subset of GPQA, with 198 questions written by PhD-level question writers in physics, chemistry, and biology, designed so that even non-experts allowed to use search engines would struggle to answer correctly in a short time.80% similarUnverifiedGPQA is a graduate-level scientific question-answering benchmark, and SWE-bench targets real-world software engineering tasks.79% similarUnverifiedGPQA Diamond is a multiple-choice question set targeting doctoral-level scientific knowledge, covering biology, chemistry, and physics, with domain experts averaging approximately 65% accuracy.77% similarUnverifiedQ&A.AI uses GPT-4 to provide instant answers and can resolve 80% of basic queries, but fails on complex questions because the algorithm oversimplifies them.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/554747API
curl https://kongchang.com/api/v1/knowledge/claims/554747MCP
get_claim(id=554747)