arXiv:2504.14975cs.CV2025-04AAAI被引 4

通过循环一致性提升3D生成的精细控制能力,让结果更贴合输入条件。

Cyc3D: Fine-grained Controllable 3D Generation via Cycle Consistency Regularization

  • 构建循环流程:从输入条件生成3D,再反推条件,反复校准以保持一致。
  • 在边缘和草图控制下,PSNR分别提升14.17%和6.26%,细节更精准。
  • 适合需要高精度几何控制的3D内容生成场景,如工业设计或虚拟现实。

尽管3D生成取得显著进展,但实现可控性——即生成内容与输入条件(如边缘、深度)的一致性——仍是重大挑战。现有方法常难以保持准确对齐,导致明显偏差。为此,我们提出 ame{},一种通过显式鼓励二阶3D内容与原始输入控制之间的循环一致性来增强可控3D生成的新框架。具体而言,采用高效前馈主干网络,从输入条件和文本提示生成3D对象;给定初始视角和控制信号后,从生成的3D内容渲染新视角,从中提取条件并重新生成3D内容。该再生成输出被渲染回初始视角,再次提取控制信号,形成包含双重一致性约束的循环过程。视图一致性通过语义相似度衡量,适应生成多样性;条件一致性确保最终提取信号与原始输入控制对齐,保留结构或几何细节。大量实验表明, ame{} 显著提升了可控性,尤其在细粒度细节方面表现突出,在多种条件下超越现有方法(如边缘控制下PSNR提升+14.17%,草图控制下+6.26%)。

原文摘要 · Abstract (English)

Despite the remarkable progress of 3D generation, achieving controllability, i.e., ensuring consistency between generated 3D content and input conditions like edge and depth, remains a significant challenge. Existing methods often struggle to maintain accurate alignment, leading to noticeable discrepancies. To address this issue, we propose \name{}, a new framework that enhances controllable 3D generation by explicitly encouraging cyclic consistency between the second-order 3D content, generated based on extracted signals from the first-order generation, and its original input controls. Specifically, we employ an efficient feed-forward backbone that can generate a 3D object from an input condition and a text prompt. Given an initial viewpoint and a control signal, a novel view is rendered from the generated 3D content, from which the extracted condition is used to regenerate the 3D content. This re-generated output is then rendered back to the initial viewpoint, followed by another round of control signal extraction, forming a cyclic process with two consistency constraints. \emph{View consistency} ensures coherence between the two generated 3D objects, measured by semantic similarity to accommodate generative diversity. \emph{Condition consistency} aligns the final extracted signal with the original input control, preserving structural or geometric details throughout the process. Extensive experiments on popular benchmarks demonstrate that \name{} significantly improves controllability, especially for fine-grained details, outperforming existing methods across various conditions (e.g., +14.17\% PSNR for edge, +6.26\% PSNR for sketch).

3D生成可控生成循环一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。