通过双路径机制实现多视角一致的3D场景编辑
View-Consistent 3D Scene Editing via Dual-Path Structural Correspondense and Semantic Continuity

- 引入双路径一致性机制,分别处理结构对应与语义连续性
- 在复杂场景下实现多视角编辑结果精确且一致
- 构建配对多视图编辑数据集,提升跨视角学习效果
文本驱动的3D场景编辑近期受到广泛关注。现有方法多采用渲染-编辑-优化流程,即从3D场景生成多视图图像,用2D图像编辑器修改后再优化底层3D表示。然而,跨视角不一致性仍是主要瓶颈。尽管近期方法引入几何线索、跨视图交互或视频先验来缓解该问题,仍依赖推理时同步,鲁棒性和泛化能力受限。本文从分布角度重新思考多视角一致3D编辑:本质上需对多视角建立联合分布建模。基于此,提出一种显式引入跨视角依赖的编辑框架。进一步观察到结构对应与语义连续性依赖不同跨视角线索,设计双路径一致性机制:投影引导的结构指引与局部补丁级语义传播。同时构建配对多视图编辑数据集,为学习编辑后场景的跨视角一致性提供可靠监督。大量实验表明,本方法在复杂场景中实现了更优的编辑性能,各视角结果精准且一致。
原文摘要 · Abstract (English)
Text-driven 3D scene editing has recently attracted increasing attention. Most existing methods follow a render-edit-optimize pipeline, where multi-view images are rendered from a 3D scene, edited with 2D image editors, and then used to optimize the underlying 3D representation. However, cross-view inconsistency remains a major bottleneck. Although recent methods introduce geometric cues, cross-view interactions, or video priors to mitigate this issue, they still largely rely on inference-time synchronization and thus remain limited in robustness and generalization.In this work, we recast multi-view consistent 3D editing from a distributional perspective: 3D scene editing essentially requires a joint distribution modeling across viewpoints.Based on this insight, we propose a view-consistent 3D editing framework that explicitly introduces cross-view dependencies into the editing process. Furthermore, motivated by the observation that structural correspondence and semantic continuity rely on different cross-view cues, we introduce a dual-path consistency mechanism consisting of projection-guided structural guidance and patch-level semantic propagation for effective cross-view editing. Further, we construct a paired multi-view editing dataset that provides reliable supervision for learning cross-view consistency in edited scenes. Extensive experiments demonstrate that our method achieves superior editing performance with precise and consistent views for complex scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。