arXiv:2603.02986cs.CVcs.GR2026-03TPAMI被引 2

快速实现3D高斯点云的视图依赖着色编辑,2秒完成全局颜色更新。

VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splats

  • 分离漫反射与视角依赖色彩,用多视角训练增强重建精度
  • 仅需一张用户编辑图,2秒内完成全场景着色传播
  • 支持实时交互,可调节镜面高光强度,适合内容创作者

3D高斯点云(3DGS)因其精确建模复杂三维场景和卓越渲染性能,已推动新视角合成与三维重建的发展。然而,高效且逼真的场景外观编辑仍是一大挑战。本文提出VIRGi,一种快速编辑3DGS场景颜色的新方法,同时保留镜面高光等视图依赖效果。核心在于将颜色分解为漫反射与视图依赖成分,并采用多视角图像块联合训练策略,相比传统单视角批处理,显著提升重建质量并增强编辑表现力。针对3DGS着色任务,我们设计了一种快速方案:仅需用户手动编辑一张图像,通过微调单个MLP权重及单次分割模块,即可在两秒内将颜色变化无缝传播至整个场景,支持实时交互并控制视图依赖效果强度。在多个数据集上的广泛验证表明,其在定量与定性指标上均显著优于基于神经辐射场的现有方法。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has recently transformed the fields of novel view synthesis and 3D reconstruction due to its ability to accurately model complex 3D scenes and its unprecedented rendering performance. However, a significant challenge persists: the absence of an efficient and photorealistic method for editing the appearance of the scene's content. In this paper we introduce VIRGi, a novel approach for rapidly editing the color of scenes modeled by 3DGS while preserving view-dependent effects such as specular highlights. Key to our method are a novel architecture that separates color into diffuse and view-dependent components, and a multi-view training strategy that integrates image patches from multiple viewpoints. Improving over the conventional single-view batch training, our 3DGS representation provides more accurate reconstruction and serves as a solid representation for the recoloring task. For 3DGS recoloring, we then introduce a rapid scheme requiring only one manually edited image of the scene from the end-user. By fine-tuning the weights of a single MLP, alongside a module for single-shot segmentation of the editable area, the color edits are seamlessly propagated to the entire scene in just two seconds, facilitating real-time interaction and providing control over the strength of the view-dependent effects. An exhaustive validation on diverse datasets demonstrates significant quantitative and qualitative advancements over competitors based on Neural Radiance Fields representations.

3D高斯着色编辑实时交互视图依赖

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。