用拖拽方式高效编辑3D场景，支持形状调整与内容扩展。
3DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing
- 基于3D高斯点云，结合形变与扩散引导实现直观拖拽编辑。
- 单卡RTX 4090上10-20分钟完成复杂3D编辑任务。
- 适合需要快速修改3D几何结构的设计师与创作者。
3D内容创作的潜力正随生成模型发展逐步释放。尽管2D拖拽编辑已较成熟，3D场景的直观编辑仍具挑战。本文提出3DGS-Drag——一种基于点云的3D编辑框架，可高效实现真实3D场景的直观拖拽操作。该方法融合形变引导（利用3D高斯溅射保持几何一致性）与扩散引导（用于内容修正与视觉质量提升），并采用渐进式编辑策略支持激进拖拽操作。实验表明，该方法在多种场景下均能实现运动变化、形状调整、修复与内容扩展等多样化编辑，且在几何相关3D内容编辑中达到当前最优性能。整个编辑过程高效，仅需单张RTX 4090 GPU运行10至20分钟。
原文摘要 · Abstract (English)
The transformative potential of 3D content creation has been progressively unlocked through advancements in generative models. Recently, intuitive drag editing with geometric changes has attracted significant attention in 2D editing yet remains challenging for 3D scenes. In this paper, we introduce 3DGS-Drag -- a point-based 3D editing framework that provides efficient, intuitive drag manipulation of real 3D scenes. Our approach bridges the gap between deformation-based and 2D-editing-based 3D editing methods, addressing their limitations to geometry-related content editing. We leverage two key innovations: deformation guidance utilizing 3D Gaussian Splatting for consistent geometric modifications and diffusion guidance for content correction and visual quality enhancement. A progressive editing strategy further supports aggressive 3D drag edits. Our method enables a wide range of edits, including motion change, shape adjustment, inpainting, and content extension. Experimental results demonstrate the effectiveness of 3DGS-Drag in various scenes, achieving state-of-the-art performance in geometry-related 3D content editing. Notably, the editing is efficient, taking 10 to 20 minutes on a single RTX 4090 GPU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。