Unverified50% confidenceFactExact time
When the activation function is ReLU, the target function is a pure spherical harmonic, and under Gaussian universality assumptions, the student's error scales approximately as the square of the teacher's error
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
Unverified多对一映射导致教师token间的不确定性在投影到学生第一个token时被直接加和抹平，这是投影方式的固有属性而非实现错误68% similarUnverifiedLogical fallacies in intermediate steps of mathematical derivations are harder for students lacking foundational knowledge to identify than obvious grammatical errors.68% similarUnverified该方法属于模仿学习中的行为克隆，其著名缺陷是复合误差问题62% similarUnverifiedSynthetic data distillation prevents the student model from learning the teacher's confidence distribution, resulting in relatively limited generalization ability on ambiguous samples.61% similarUnverifiedThe methodological flaw in Kaplan et al.'s approach was the failure to independently tune the learning rate schedule for each model scale, leading to an overestimation of the importance of parameter growth and an underestimation of the importance of data growth.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/986985API
curl https://kongchang.com/api/v1/knowledge/claims/986985MCP
get_claim(id=986985)