GPT
GPT (Generative Pre-trained Transformer) is a series of large-scale pre-trained language models developed by OpenAI, built on the Transformer architecture. The models are trained via unsupervised pre-training on large text corpora and subsequently fine-tuned for specific applications. They support a range of natural language tasks including text completion, question answering, summarization, translation, and code generation, and are among the most representative foundation models in natural language processing.
Core Facts
Large language models such as GPT and BERT are based on the self-supervised learning paradigm
The in-context learning capability of Few-Shot prompting was first systematically described in the GPT-3 paper.
The core working principle of large language models such as GPT-4, Claude, and Gemini is next-token prediction based on the Transformer architecture.
Timeline (last 90 days)
In the boilerplate-phrase subcategory, GPT models score lowest (least filler), while Mistral Large 4 and DeepSeek V4 Flash use more verbose boilerplate.
First-version Neural Yap benchmark results show that GPT-series models have the least filler (lowest ranking), while Claude Opus 5.5 is the model with the most filler.
Based on anecdotal observation, the author believes Claude models are more willing than GPT models to follow conciseness requirements in system instruction files (such as CLAUDE.md and AGENTS.md), but this has not been quantified.
Legora is a legal AI platform that embeds the GPT series models into multiple parts of lawyers' daily work, for tasks such as contract review.
"Generative artificial intelligence" refers to a class of models capable of generating text, images, audio and other content based on prompts, represented by GPT and diffusion models.
The vision models bound to different coding agents are not the same; some rely on the Claude series, while others use the GPT series or other vision models.
BriLLM-MetaPred's predictive performance is comparable to GPT baselines of the same scale.
BriLLM-MetaPred is the first machine learning paradigm fully derived from mathematical theory, and it reaches the level of same-scale GPT on language modeling tasks.
GPT's top model consumes quota very quickly, and maxing out reasoning intensity may burn through the quota in a few minutes.
Newly registered GPT accounts are highly likely to still require phone number verification when logging into Codex even after subscribing to membership; accounts registered longer ago have a higher probability of skipping verification after subscribing.
40 more timeline events
All Facts (20)
Large language models such as GPT and BERT are based on the self-supervised learning paradigm
90%VerifiedThe in-context learning capability of Few-Shot prompting was first systematically described in the GPT-3 paper.
90%VerifiedThe core working principle of large language models such as GPT-4, Claude, and Gemini is next-token prediction based on the Transformer architecture.
90%VerifiedOpenAI builds an AI Agent tool ecosystem through ChatGPT's plugin system and the GPT Store.
90%VerifiedGPT-4 and Claude are large language models that can understand context, generate structured outputs, and execute multi-step reasoning
85%VerifiedAzure OpenAI Service provides enterprise customers with the ability to invoke models such as GPT-4, DALL-E, and Whisper in a compliant environment.
85%VerifiedWorkBuddy's interface is very similar to those of Qianwen, Doubao, and GPT.
80%VerifiedGPT is a series of large language models developed by OpenAI based on the Transformer architecture
80%VerifiedThe GPT series follows the decoder route, adhering to the autoregressive language model objective, and has revealed the phenomenon of emergent capabilities through scaling.
80%VerifiedThe GPT series uses tiktoken (based on BPE encoding) for tokenization.
80%VerifiedThe GPT series uses the Decoder-only variant of the Transformer, predicting the next Token autoregressively.
80%VerifiedVLMs (Vision Language Models) typically consist of a visual encoder (such as ViT), a language model, and a projection layer connecting the two, with representative models including GPT-4V/4o, Claude 3.5, the LLaVA series, and InternVL
80%VerifiedThe project connects to large language models via OpenRouter, which serves as an AI model gateway supporting unified API calls to multiple large models such as GPT-4, Claude, and Llama.
80%VerifiedSince 2024, OpenAI has reduced the API prices of the GPT series multiple times.
80%VerifiedThe Function Calling mechanism was first introduced into the GPT series of models by OpenAI in 2023.
80%Verified当前所有主流大模型（GPT、BERT、LLaMA等）都基于Transformer架构
80%VerifiedGLM采用了独特的自回归填空预训练范式，与GPT的纯自回归和BERT的纯掩码语言模型都有所不同
80%VerifiedThe context windows of current mainstream large language models (such as GPT-4, Claude, etc.) have been expanded to 128K or even longer tokens.
80%VerifiedFunction Calling is a feature first introduced by OpenAI in mid-2023 and subsequently adopted by major model vendors.
80%VerifiedGPT-series models use the Byte Pair Encoding (BPE) algorithm to segment text into tokens.
80%