Verified80% confidenceFactTime unknown
大语言模型通过在数千亿乃至数万亿个词元（Token）的文本数据上进行自监督预训练
20
Sources
80%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedLarge language models are trained on vast corpora of text data and learn to predict the probability distribution of the next word81% similarUnverified当训练数据中某些文本出现频率极高时，大语言模型可能产生记忆化（Memorization）现象，能够近乎逐字输出特定段落79% similarUnverifiedAfter training on tens of trillions of tokens, language models exhibit emergent capabilities such as reasoning, creative writing, and programming.79% similarVerifiedThe internet's supply of high-quality text data for training large language models has been largely consumed.77% similarUnverifiedThe context window of large language models is limited, and the length of text that can be processed in a single inference is typically tens of thousands to hundreds of thousands of tokens.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/18904API
curl https://kongchang.com/api/v1/knowledge/claims/18904MCP
get_claim(id=18904)