arXiv:2508.13153cs.CV2025-08AAAI被引 3

通过多视角扫描融合,实现无需密集采样的高保真3D场景重建。

IGFuse: Interactive 3D Gaussian Scene Reconstruction via Multi-Scans Fusion

  • 利用多扫描间物体自然移动揭示被遮挡区域,融合构建感知分割的高斯场。
  • 在真实场景中实现高质量渲染与物体级操作,无需复杂处理流程。
  • 适合需要高效3D重建与仿真迁移的应用,如机器人导航、数字孪生。

三维场景的完整且可交互重建仍是计算机视觉与机器人领域的基本挑战,主要源于物体持续遮挡和传感器覆盖有限。单次扫描的多视角观测常无法捕捉全部结构细节。现有方法通常依赖多阶段流水线(如分割、背景补全、修复)或每个物体需密集扫描,易出错且难以扩展。本文提出IGFuse,一种通过融合多次扫描观测来重建可交互高斯场景的新框架。扫描间的自然物体重排能揭示先前被遮挡区域。方法构建感知分割的高斯场,并在各扫描间强制双向光度与语义一致性。为应对空间错位,引入伪中间场景状态进行统一对齐,并采用协同共剪枝策略优化几何结构。IGFuse可在无密集观测和复杂流水线的情况下实现高保真渲染与物体级场景操控。大量实验验证了该框架对新场景配置的强大泛化能力,证明其在真实3D重建与真实到仿真迁移中的有效性。

原文摘要 · Abstract (English)

Reconstructing complete and interactive 3D scenes remains a fundamental challenge in computer vision and robotics, particularly due to persistent object occlusions and limited sensor coverage. Multiview observations from a single scene scan often fail to capture the full structural details. Existing approaches typically rely on multi stage pipelines, such as segmentation, background completion, and inpainting or require per-object dense scanning, both of which are error-prone, and not easily scalable. We propose IGFuse, a novel framework that reconstructs interactive Gaussian scene by fusing observations from multiple scans, where natural object rearrangement between captures reveal previously occluded regions. Our method constructs segmentation aware Gaussian fields and enforces bi-directional photometric and semantic consistency across scans. To handle spatial misalignments, we introduce a pseudo-intermediate scene state for unified alignment, alongside collaborative co-pruning strategies to refine geometry. IGFuse enables high fidelity rendering and object level scene manipulation without dense observations or complex pipelines. Extensive experiments validate the framework's strong generalization to novel scene configurations, demonstrating its effectiveness for real world 3D reconstruction and real-to-simulation transfer. Our project page is available online.

3D重建高斯溅射多视角融合机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。