实时重着色3D高斯点云,支持精准区域编辑
ReCoGS: Real-time ReColoring for Gaussian Splatting scenes
- 基于预训练高斯点云,实现交互式区域选中与重着色
- 支持实时操作,用户可即时预览修改效果
- 适合需要快速3D场景着色修改的设计师与开发者
高斯点云已成为新兴的新型视图合成方法,相比NeRF在训练效率和实时推理方面表现更优,同时保持高质量重建。除了视图合成,该3D表示也用于编辑任务。现有方法常借助2D扩散模型生成多视角数据集进行训练,但存在视角不一致、细粒度控制不足和计算开销大等问题。本文聚焦于重着色编辑任务,提出一个用户友好的流程,可在预训练的高斯点云场景中精确选择并重着色特定区域。为验证方法的实时性能,还开发了交互式工具供用户实际体验。代码已开源:https://github.com/loryruta/recogs。
原文摘要 · Abstract (English)
Gaussian Splatting has emerged as a leading method for novel view synthesis, offering superior training efficiency and real-time inference compared to NeRF approaches, while still delivering high-quality reconstructions. Beyond view synthesis, this 3D representation has also been explored for editing tasks. Many existing methods leverage 2D diffusion models to generate multi-view datasets for training, but they often suffer from limitations such as view inconsistencies, lack of fine-grained control, and high computational demand. In this work, we focus specifically on the editing task of recoloring. We introduce a user-friendly pipeline that enables precise selection and recoloring of regions within a pre-trained Gaussian Splatting scene. To demonstrate the real-time performance of our method, we also present an interactive tool that allows users to experiment with the pipeline in practice. Code is available at https://github.com/loryruta/recogs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。