Unverified50% confidenceFactExact time
Perplexity equals the exponential of the cross-entropy loss on the test set: PPL = exp(loss), where loss=1.77 corresponds to PPL≈5.86.
1
Sources
50%
Confidence
Long-term
Relevance
9/12/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe cross-entropy loss in classification tasks is essentially the negative of the log-likelihood function, and minimizing cross-entropy is equivalent to maximizing the log-likelihood of the model on the training data.76% similarUnverified交叉熵损失函数 H(p,q) = -Σp(x)log q(x) 的最小值在q=p时取到，等于真实分布的熵75% similarUnverified线性回归的最小二乘损失与逻辑回归的交叉熵损失分别对应高斯噪声假设与伯努利分布假设下的最大似然估计72% similarUnverifiedThe loss function (cross-entropy) of logistic regression is essentially negative log-likelihood.70% similarUnverified当模型对某个训练样本的预测概率接近1时，该样本对应的交叉熵损失趋近于零，模型几乎无法获得梯度更新信号69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/912650API
curl https://kongchang.com/api/v1/knowledge/claims/912650MCP
get_claim(id=912650)