arXiv:2604.19571cs.CV2026-04被引 1

用语义传输解决3D高斯点云编辑中的局部精度问题

TransSplat: Unbalanced Semantic Transport for Language-Driven 3DGS Editing

论文配图:TransSplat: Unbalanced Semantic Transport for Language-Driven 3DGS Editing
图 1 · 摘自论文原文
  • 将编辑任务建模为多视角语义不均衡传输问题
  • 通过跨视图共享编辑场提升结构一致性,误差残留抑制泄漏
  • 适合需要精细局部控制的VR/AR场景编辑

基于语言的3D高斯喷溅(3DGS)编辑为虚拟现实和增强现实中的复杂场景修改提供了更便捷的方法。标准流程通常采用两阶段策略:先编辑多个2D视图,再优化3D表示以匹配这些编辑结果。现有方法主要通过多视角特征融合、注意力过滤或迭代校准来提升视图一致性,但未能显式解决一个更根本的问题:编辑后的2D证据与3D高斯点之间的语义对应关系。为此,我们提出TransSplat,将语言驱动的3DGS编辑建模为多视图未平衡语义传输问题。具体而言,该方法在可见高斯点与视图特定的编辑原型之间建立对应关系,显式刻画2D编辑证据与3D高斯之间的语义关联。同时,恢复一个跨视图共享的标准化3D编辑场,以引导统一的3D外观更新。此外,利用传输残差抑制非目标区域的错误编辑,减轻编辑泄漏,提高局部控制精度。定性和定量结果表明,相较于以提升视图一致性为中心的现有3D编辑方法,TransSplat在局部编辑准确性和结构一致性方面均表现更优。

原文摘要 · Abstract (English)

Language-driven 3D Gaussian Splatting (3DGS) editing provides a more convenient approach for modifying complex scenes in VR/AR. Standard pipelines typically adopt a two-stage strategy: first editing multiple 2D views, and then optimizing the 3D representation to match these edited observations. Existing methods mainly improve view consistency through multi-view feature fusion, attention filtering, or iterative recalibration. However, they fail to explicitly address a more fundamental issue: the semantic correspondence between edited 2D evidence and 3D Gaussians. To tackle this problem, we propose TransSplat, which formulates language-driven 3DGS editing as a multi-view unbalanced semantic transport problem. Specifically, our method establishes correspondences between visible Gaussians and view-specific editing prototypes, thereby explicitly characterizing the semantic relationship between edited 2D evidence and 3D Gaussians. It further recovers a cross-view shared canonical 3D edit field to guide unified 3D appearance updates. In addition, we use transport residuals to suppress erroneous edits in non-target regions, mitigating edit leakage and improving local control precision. Qualitative and quantitative results show that, compared with existing 3D editing methods centered on enhancing view consistency, TransSplat achieves superior performance in local editing accuracy and structural consistency.

3D生成语言控制高斯喷溅局部编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。