arXiv:2412.08152cs.GRcs.CV2024-12被引 3

无需反复训练,一键实现3D模型实时可控编辑。

ProGDF: Progressive Gaussian Differential Field for Controllable and Flexible 3D Editing

  • 提出渐进式高斯差分场,单次训练即可支持多种编辑结果。
  • 在两个新任务中实现可控3D编辑与精细调整,效果优于现有方法。
  • 用户界面友好,编辑过程实时响应,显著提升交互体验。

3D编辑在重用和修改现有3D资产中至关重要,能显著提升效率。近年来,基于3D高斯溅射(3DGS)的方法因其高效渲染和灵活性受到关注。然而,实现理想编辑效果通常需要多次迭代调整,每次尝试耗时数十分钟,形成繁琐的试错循环,用户体验差。为解决此问题,我们提出面向流程的3D编辑建模思想,构建了无需迭代训练的渐进式高斯差分场(ProGDF),仅需一次训练即可通过友好的界面实现实时可控编辑与多样化结果输出。ProGDF由两个核心组件构成:渐进式高斯溅射(PGS)与高斯差分场(GDF)。PGS引入渐进约束以提取编辑过程中的多样中间结果,并通过渲染质量正则化提升其保真度;基于这些中间结果,GDF利用轻量级神经网络建模整个编辑过程。大量实验在两个新任务——可控3D编辑与灵活细粒度3D操控——上验证了ProGDF的有效性、实用性和灵活性。

原文摘要 · Abstract (English)

3D editing plays a crucial role in editing and reusing existing 3D assets, thereby enhancing productivity. Recently, 3DGS-based methods have gained increasing attention due to their efficient rendering and flexibility. However, achieving desired 3D editing results often requires multiple adjustments in an iterative loop, resulting in tens of minutes of training time cost for each attempt and a cumbersome trial-and-error cycle for users. This in-the-loop training paradigm results in a poor user experience. To address this issue, we introduce the concept of process-oriented modelling for 3D editing and propose the Progressive Gaussian Differential Field (ProGDF), an out-of-loop training approach that requires only a single training session to provide users with controllable editing capability and variable editing results through a user-friendly interface in real-time. ProGDF consists of two key components: Progressive Gaussian Splatting (PGS) and Gaussian Differential Field (GDF). PGS introduces the progressive constraint to extract the diverse intermediate results of the editing process and employs rendering quality regularization to improve the quality of these results. Based on these intermediate results, GDF leverages a lightweight neural network to model the editing process. Extensive results on two novel applications, namely controllable 3D editing and flexible fine-grained 3D manipulation, demonstrate the effectiveness, practicality and flexibility of the proposed ProGDF.

3D编辑高斯溅射实时交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。