Unverified50% confidenceFactExact time
PrefixLM (prefix language model) is an architecture design between autoencoding (such as BERT) and autoregressive (such as GPT): the input sequence is divided into a prefix part and a suffix part, tokens within the prefix part can see each other (bidirectional attention), and the suffix part can only see itself and preceding tokens (causal attention).
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedA classifier maps input to one of a finite set of predefined categories with a fixed, closed candidate space; a generative language model predicts the next token from the entire vocabulary at each step, with an open candidate space, building output autoregressively.60% similarUnverifiedTraditional stitched multimodal approaches typically connect a pretrained visual encoder (such as CLIP) to a language model via an adapter layer, resulting in relatively fragmented cross-modal understanding.60% similarUnverifiedAutoregressive generation is the foundational paradigm for virtually all current large language models, generating text sequences token by token; the GPT series, LLaMA, and Claude all adopt this paradigm.58% similarUnverifiedAutoregressive language models generate text token by token from left to right, with each step conditioned on the previously generated tokens.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1014222API
curl https://kongchang.com/api/v1/knowledge/claims/1014222MCP
get_claim(id=1014222)