用拖拽方式高效编辑3D高斯点云，保持形状与视觉一致性。
ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Prior
- 基于ARAP原理直接对3D高斯点进行刚性变形，实现自然拖拽编辑。
- 引入扩散先验提升编辑后图像质量，多视角一致性更优。
- 单卡RTX 3090仅需10-20分钟，适合交互式设计应用。
拖拽编辑因其直观易用，已成为设计师修改复杂几何结构的流行方式，无需高技术门槛即可调整和重塑内容。该操作已广泛应用于2D图像与3D网格的编辑。然而，针对广泛使用的3D高斯点云（3DGS）表示，拖拽编辑研究仍较少，因在变形过程中保持形状连贯性与视觉连续性极具挑战。本文提出ARAP-GS，一种基于渐近刚性（ARAP）变形的拖拽式3DGS编辑框架。首次将ARAP变形直接应用于3D高斯点，实现灵活且直观的几何变换。为保持变形后的场景外观，我们在迭代优化中引入先进扩散先验进行图像超分辨率，显著提升视觉质量并维持多视角一致性。实验表明，ARAP-GS在多种3D场景下均优于现有方法，验证了其有效性与优越性。此外，该方法效率极高，单张RTX 3090 GPU仅需10至20分钟即可完成场景编辑。
原文摘要 · Abstract (English)
Drag-driven editing has become popular among designers for its ability to modify complex geometric structures through simple and intuitive manipulation, allowing users to adjust and reshape content with minimal technical skill. This drag operation has been incorporated into numerous methods to facilitate the editing of 2D images and 3D meshes in design. However, few studies have explored drag-driven editing for the widely-used 3D Gaussian Splatting (3DGS) representation, as deforming 3DGS while preserving shape coherence and visual continuity remains challenging. In this paper, we introduce ARAP-GS, a drag-driven 3DGS editing framework based on As-Rigid-As-Possible (ARAP) deformation. Unlike previous 3DGS editing methods, we are the first to apply ARAP deformation directly to 3D Gaussians, enabling flexible, drag-driven geometric transformations. To preserve scene appearance after deformation, we incorporate an advanced diffusion prior for image super-resolution within our iterative optimization process. This approach enhances visual quality while maintaining multi-view consistency in the edited results. Experiments show that ARAP-GS outperforms current methods across diverse 3D scenes, demonstrating its effectiveness and superiority for drag-driven 3DGS editing. Additionally, our method is highly efficient, requiring only 10 to 20 minutes to edit a scene on a single RTX 3090 GPU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。