Unverified50% confidenceFactExact time
The sum of the negative log probabilities of each token output by a language model is an estimate of the encoding length of the sequence, which is the origin of the perplexity metric.
1
Sources
50%
Confidence
Long-term
Relevance
9/22/2026
First Seen
Sources
Related Entities
Related Claims
Unverified困惑度是测试集上每个token平均负对数似然的指数，值越低代表模型对语料的预测越准确75% similarUnverified同一段文字在不同模型中消耗的 token 数量可能相差 10%-30%69% similarUnverified文法约束采样在模型生成每个token前将非法token的logit值设为负无穷，使其softmax后概率归零，从而保证输出100%符合语法67% similarUnverifiedword2vec负采样中，对每个正样本随机采样k个（通常5-20个）负样本，采样概率通常按词频的3/4次方分布66% similarUnverifiedThe more detailed the answers provided to the AI during the requirements analysis phase, the lower the probability of bugs in the final product; the cost of fixing errors found in the requirements phase is only 1/10 to 1/100 of the cost of finding the same type of error in the coding phase.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/940782API
curl https://kongchang.com/api/v1/knowledge/claims/940782MCP
get_claim(id=940782)