Verified90% confidenceFactTime unknown
Large language models such as GPT and BERT are based on the self-supervised learning paradigm
8
Sources
90%
Confidence
Long-term
Relevance
6/2/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSelf-supervised learning is the training foundation of the GPT series of models, which learn by predicting the next masked word in text.82% similarUnverifiedLarge language models such as GPT and DeepSeek are fundamentally based on the Transformer architecture and learn linguistic patterns by predicting the probability distribution of the next token.79% similarUnverifiedGPT、BERT、CLIP等模型均建立在自监督学习思想之上78% similarVerifiedThe GPT series follows the decoder route, adhering to the autoregressive language model objective, and has revealed the phenomenon of emergent capabilities through scaling.78% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/36688API
curl https://kongchang.com/api/v1/knowledge/claims/36688MCP
get_claim(id=36688)