Generative Model

A generative model is a machine learning model capable of generating entirely new content (such as text, images or audio) based on the distribution of its training data.

The capabilities Meta has built up in AI assistants and generative models provide the underlying support for the AI virtual pet experience.

Generative models may produce fields that "look like" turbulence while failing to correctly reproduce the energy cascade or structure functions.

Generative models are suited to open-ended tasks such as creation and conversation; non-generative models are better suited to scenarios such as classification, planning and verification that require reproducible, auditable results.

Generative models (such as LLMs like GPT and Claude) generate text word by word through probabilistic sampling, and their outputs are open-ended and diverse, but the same input may yield different results.

Generative models have inherent shortcomings in icon design scenarios, including difficulty guaranteeing output consistency and limited controllability.

Generative models must synthesize eye details that did not originally exist "out of thin air" based on existing pixels, including the iris, eyelashes, eyelid shadows and skin texture.

The key challenge in accelerating simulation with generative models is physical fidelity validation: generated samples must be statistically consistent with real physics, otherwise systematic biases are introduced.

Generative models usually learn occlusion patterns implicitly from large numbers of images, but spatial reasoning still relies on statistical priors rather than strict geometric computation.

Pure generative models tend to fabricate content, and their failures often go unnoticed; a traceable workflow instead exposes uncertainty for users to judge credibility themselves.

Neural network models tend to be overconfident, and their probability outputs do not faithfully reflect the credibility of predictions, exhibiting calibration problems.

Generative models have a happy-path bias, tending to produce clean, linear flows while neglecting defensive error-handling logic.

The output of a generative model is essentially a series of classification choices over a vast vocabulary, and the boundary between generation and classification is more blurred than product marketing would suggest.

For risk-neutral MDPs, the optimal sample complexity under the generative model assumption has been proven to be Õ(SA/((1-γ)^3·ε^2)), established by Azar et al. in 2013.

The generative model assumption was systematically introduced by Kakade et al. in 2003.

The paper assumes access to a generative model of the MDP, meaning the algorithm can query samples for any state-action pair.

Generative models excel at synthesizing language, explaining concepts, and writing code, but perform poorly on deterministic pipeline work in an Agent harness.

Relying on a generative model to check its own output is unreliable, because generative models have a natural tendency to advocate for their own completions.

Large language models use 'continuation' as their basic paradigm during generation, naturally tending to produce complete new content, whereas editing tasks require the model to target 'delta operations'.

AI Siri refers to the next-generation voice assistant with large language model capabilities integrated, with the core change being a shift from command matching to semantic understanding and generation.