[KongchangAI]
Unverified50% confidenceFactExact time

CLM's 8-billion-parameter backbone Qwen3-8B is frozen and serves only as a reader; what is actually trained are only the small projection heads on each side with approximately 20 million parameters each, and a complete pretraining run takes about one hour on a single RTX.

1
Sources
50%
Confidence
Long-term
Relevance
10/4/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/973479
API
curl https://kongchang.com/api/v1/knowledge/claims/973479
MCP
get_claim(id=973479)