DreamFusion
An AI method that generates three-dimensional models from text prompts, using two-dimensional diffusion models and NeRF optimization. It represents a research result in the text-to-3D generation direction.
Timeline (last 90 days)
Current text-to-3D generation models such as DreamFusion and Magic3D mainly focus on generation quality, and the generated results tend to be one-off, making it difficult for users to modify parts of them.
Google's DreamFusion (2022) uses a pretrained 2D diffusion model as a prior and optimizes 3D representations via a Score Distillation Sampling (SDS) loss function, enabling the generation of 3D objects without any 3D training data.
DreamFusion's SDS method introduces artifacts such as the "Janus problem" (multi-face problem) and oversaturation, and generating a single object typically requires GPU optimization time ranging from tens of minutes to hours.
All Facts (3)
Current text-to-3D generation models such as DreamFusion and Magic3D mainly focus on generation quality, and the generated results tend to be one-off, making it difficult for users to modify parts of them.
50%UnverifiedGoogle's DreamFusion (2022) uses a pretrained 2D diffusion model as a prior and optimizes 3D representations via a Score Distillation Sampling (SDS) loss function, enabling the generation of 3D objects without any 3D training data.
50%UnverifiedDreamFusion's SDS method introduces artifacts such as the "Janus problem" (multi-face problem) and oversaturation, and generating a single object typically requires GPU optimization time ranging from tens of minutes to hours.
50%