arXiv:2507.05256cs.CV2025-07ICCV被引 7

通过分段一致性轨迹蒸馏,提升文本生成3D的保真度和稳定性。

SegmentDreamer: Towards High-fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory Distillation

  • 提出分段一致性轨迹蒸馏,平衡自一致与跨一致关系。
  • 在3DGS下生成质量超越当前最优方法,实现高保真3D资产创建。
  • 适合需要高质量3D生成的创作者与工业级应用开发者。

近期文本到3D生成方法通过将一致性蒸馏(CD)直接连接到分数蒸馏,提升了得分蒸馏采样(SDS)及其变体的视觉质量。然而,由于自一致性和跨一致性之间的不平衡,这些基于CD的方法固有地存在条件引导不当的问题,导致生成效果不佳。为此,我们提出SegmentDreamer,一个旨在充分释放一致性模型潜力的新型框架,用于高保真文本到3D生成。具体而言,我们通过提出的分段一致性轨迹蒸馏(SCTD)重构SDS,明确界定自一致与跨一致的关系,有效缓解不平衡问题。此外,SCTD将概率流常微分方程(PF-ODE)轨迹划分为多个子轨迹,并保证每段内的一致性,理论上可提供更紧的蒸馏误差上界。同时,我们设计了一条更快速稳定的蒸馏流水线。大量实验表明,我们的SegmentDreamer在视觉质量上超越现有最优方法,支持通过3D高斯点云(3DGS)实现高保真3D资产生成。

原文摘要 · Abstract (English)

Recent advancements in text-to-3D generation improve the visual quality of Score Distillation Sampling (SDS) and its variants by directly connecting Consistency Distillation (CD) to score distillation. However, due to the imbalance between self-consistency and cross-consistency, these CD-based methods inherently suffer from improper conditional guidance, leading to sub-optimal generation results. To address this issue, we present SegmentDreamer, a novel framework designed to fully unleash the potential of consistency models for high-fidelity text-to-3D generation. Specifically, we reformulate SDS through the proposed Segmented Consistency Trajectory Distillation (SCTD), effectively mitigating the imbalance issues by explicitly defining the relationship between self- and cross-consistency. Moreover, SCTD partitions the Probability Flow Ordinary Differential Equation (PF-ODE) trajectory into multiple sub-trajectories and ensures consistency within each segment, which can theoretically provide a significantly tighter upper bound on distillation error. Additionally, we propose a distillation pipeline for a more swift and stable generation. Extensive experiments demonstrate that our SegmentDreamer outperforms state-of-the-art methods in visual quality, enabling high-fidelity 3D asset creation through 3D Gaussian Splatting (3DGS).

3D生成一致性模型文本生成3DGS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。