arXiv:2507.04961cs.CV2025-07ICCV被引 25

用户交互式选择关键视图,实现3D高斯点云编辑的几何一致性提升。

InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Prior

  • 通过用户选定关键视图,自适应筛选语义一致参考视图。
  • 构建3D几何一致性注意力先验,显著减少非刚性变形区域的伪影。
  • 适合需要精细控制3D场景编辑的设计师与研究人员。

基于3D高斯点云的3D编辑近年来表现卓越,但多视角编辑常在非刚性形变区域出现显著局部不一致,导致局部伪影、纹理模糊或语义变化。现有方法完全依赖文本提示,编辑过程为“一次性操作”,难以灵活控制编辑程度。为此,我们提出InterGSEdit,一种通过用户偏好交互选择关键视图的高质量3DGS编辑框架。设计基于CLIP的语义一致性筛选策略(CSCS),为每个用户选定的关键视图自适应筛选一组语义一致的参考视图。利用参考视图生成的交叉注意力图,在加权高斯点云反投影中构建3D几何一致性注意力先验(GAP³D)。将GAP³D投影得到3D约束注意力,并通过注意力融合网络(AFN)与2D交叉注意力融合。AFN采用自适应策略:早期推理优先使用3D约束注意力以保证几何一致性,后期推理逐步转向2D交叉注意力以捕捉精细特征。大量实验表明,InterGSEdit达到当前最优性能,实现一致且高保真的3DGS编辑,显著提升用户体验。

原文摘要 · Abstract (English)

3D Gaussian Splatting based 3D editing has demonstrated impressive performance in recent years. However, the multi-view editing often exhibits significant local inconsistency, especially in areas of non-rigid deformation, which lead to local artifacts, texture blurring, or semantic variations in edited 3D scenes. We also found that the existing editing methods, which rely entirely on text prompts make the editing process a "one-shot deal", making it difficult for users to control the editing degree flexibly. In response to these challenges, we present InterGSEdit, a novel framework for high-quality 3DGS editing via interactively selecting key views with users' preferences. We propose a CLIP-based Semantic Consistency Selection (CSCS) strategy to adaptively screen a group of semantically consistent reference views for each user-selected key view. Then, the cross-attention maps derived from the reference views are used in a weighted Gaussian Splatting unprojection to construct the 3D Geometry-Consistent Attention Prior ($GAP^{3D}$). We project $GAP^{3D}$ to obtain 3D-constrained attention, which are fused with 2D cross-attention via Attention Fusion Network (AFN). AFN employs an adaptive attention strategy that prioritizes 3D-constrained attention for geometric consistency during early inference, and gradually prioritizes 2D cross-attention maps in diffusion for fine-grained features during the later inference. Extensive experiments demonstrate that InterGSEdit achieves state-of-the-art performance, delivering consistent, high-fidelity 3DGS editing with improved user experience.

3D编辑高斯点云交互式几何一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。