arXiv:2607.19777cs.CV2026-07

通过注意力引导相机布局与多视角对齐,实现精准3D场景编辑。

Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing

论文配图:Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing
图 1 · 摘自论文原文
  • 根据注意力分布自动选择最佳编辑相机位置,提升覆盖范围。
  • 多视角一致对齐,使编辑后3D场景保持外观与空间一致性。
  • 仅需5个视图即可完成高质量编辑,速度提升7倍。

基于文本的3D场景编辑通常依赖固定训练相机渲染的2D图像进行扩散模型编辑,限制了编辑的空间覆盖范围和用户对复杂场景中特定物体的精准控制。本文提出LB-Edit框架,解决两个耦合问题:如何为局部编辑确定最优相机位置,以及如何确保各视角编辑结果在3D空间中保持一致。首先,注意力引导的编辑相机放置(ACP)在多个候选相机距离上探测扩散模型的自注意力与交叉注意力,找到注意力集中于目标区域的位置,并在此距离上部署几何多样且紧凑的编辑相机集。其次,多视角注意力对齐(MAA)通过共享令牌级对应关系来对齐外观特征,并将交叉注意力图映射到3D高斯点云上作为共享的3D注意力场,有效抑制外观与空间漂移。在多物体与单物体场景上的实验表明,该方法在指令忠实度、多视角一致性与编辑局部性方面均优于现有方法,仅需5个编辑视图,且延迟降低高达7倍。

原文摘要 · Abstract (English)

Text-driven 3D scene editing with 3D Gaussian Splatting (3DGS) typically applies a 2D diffusion editor to views rendered from fixed training cameras, limiting both the spatial coverage of edits and the user's freedom to target specific objects in complex scenes. We present LB-Edit, a framework that addresses two coupled problems: where to place editing cameras for localized edits, and how to make per-view edits agree with one another so that the 3D scene remains consistent after fine-tuning. First, Attention-Guided Editing Camera Placement (ACP) probes the diffusion model's self- and cross-attention at multiple candidate camera distances to find where attention is well-contained in the region of interest, then places a compact, geometrically diverse editing camera set at that attention-optimal distance. Second, Multi-view Attention Alignment (MAA) steers the editor toward the same edit across views along two axes: it aligns appearance by sharing self-attention features via token-level correspondence, and aligns spatial location by lifting cross-attention maps onto the 3D Gaussians as a shared 3D attention field, suppressing both appearance and spatial drift. Experiments on multi-object and single-object scenes show that our method achieves the highest user preference in instruction fidelity, multi-view consistency, and editing locality, using as few as 5 editing views and reducing latency by up to 7x over existing methods.

3D生成图像编辑注意力机制多视角对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。