Unverified50% confidenceFactExact time
DistilBERT's distillation process uses a triple loss function: distillation loss, masked language model loss, and cosine embedding loss.
1
Sources
50%
Confidence
Long-term
Relevance
9/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe algorithm's loss function consists of three components: Focal Loss (positive-negative sample balancing), similarity loss (adjacent point consistency constraint), and shape loss (second-order smoothness constraint).75% similarUnverified常见的对比学习损失函数包括 NT-Xent Loss 和 Triplet Loss69% similarUnverifiedThe training objective of Diffusion-LM includes three loss terms: the diffusion denoising loss, an embedding matching term, and a rounding loss.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/865895API
curl https://kongchang.com/api/v1/knowledge/claims/865895MCP
get_claim(id=865895)