Unverified50% confidenceFactExact time
GPT-3 has 175B parameters and was trained on 300B tokens; Gopher has 280B parameters and was trained on 300B tokens — both are in an over-parameterized and under-trained state.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedClaude 3.5 Sonnet supports a 200K token context, and GPT-4 Turbo supports a 100K token context.67% similarUnverified以 GPT-3 为例，r=4 时 LoRA 可将可训练参数从 175B 降至约 4.7M，减少约 37,000 倍66% similarUnverifiedThe LLaMA series adopts an over-training strategy, training a 7B-parameter model on 1T tokens, far exceeding the Chinchilla-optimal ratio of 140B tokens66% similarUnverified千问3.8 27B基于千问3.5的整套架构体系，架构层面与3.5完全一致，仅做了继续预训练和后训练（含SFT与RL强化）65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/895883API
curl https://kongchang.com/api/v1/knowledge/claims/895883MCP
get_claim(id=895883)