[KongchangAI]
Unverified50% confidenceSolutionExact time

Zero-initialized QKV expansion initializes the weights corresponding to newly added dimensions to zero, ensuring that the model's behavior at the start of adaptation training is identical to that before the expansion.

1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/893134
API
curl https://kongchang.com/api/v1/knowledge/claims/893134
MCP
get_claim(id=893134)