arXiv:2607.16805cs.CV2026-07

无需微调,多视角生成高质量3D场景资产

Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning

论文配图:Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning
图 1 · 摘自论文原文
  • 通过精选互补视图减少冗余,融合多视角信息生成场景
  • 在Replica和ScanNet++上场景级CD降低43.8%和30.9%
  • 200次迭代内优化布局,适合仿真与机器人应用

高质量3D场景资产对机器人操作、导航和仿真等沉浸式应用至关重要。尽管单图像3D生成模型如SAM3D具备强物体先验,但在真实场景中,严重遮挡、重复观察及跨视角不一致仍使可靠生成困难。我们提出Scene-SAM3D,一种无需训练的框架,将SAM3D从单视图物体生成拓展至校准多视图场景生成。该方法选取一组紧凑且互补的视图,在减少观察冗余的同时为遮挡区域提供额外证据。基于选定视图,通过步骤高效的潜在速度融合,整合多视角信息并抑制跨视角冲突。最后,轻量级刚性物体高斯优化在200次迭代内重构场景布局,同时保留生成物体几何结构。在Replica和ScanNet++上的实验表明,本方法在实例和场景层级均实现稳定提升,场景级CD分别降低43.8%和30.9%,且在相同多视图设置下,流模型采样FLOPs和运行时延迟均减少近20%。代码将发布于https://github.com/xibi777/Scene-SAM3D。

原文摘要 · Abstract (English)

High-quality 3D scene assets are critical for embodied applications such as robotic manipulation, navigation, and simulation. Despite their strong object priors, recent single-image 3D generation models such as SAM3D remain insufficient for real-world scenes, where severe occlusions, redundant observations, and cross-view inconsistencies make reliable scene generation challenging. We introduce Scene-SAM3D, a training-free framework that extends SAM3D from single-view object generation to calibrated multi-view scene asset generation. Scene-SAM3D selects a compact set of complementary views, reducing observation redundancy while providing additional evidence for regions occluded in individual views. Based on the selected views, it performs step-efficient latent velocity fusion to integrate multi-view evidence and suppress cross-view conflicts in canonical space. Finally, a lightweight rigid-object Gaussian optimization refines the scene layout within 200 iterations while preserving the generated object geometry. Experiments on Replica and ScanNet++ demonstrate consistent improvements at both instance and scene levels, with our method reducing scene-level CD by 43.8% on Replica and 30.9% on ScanNet++, while cutting flow-model sampling FLOPs and wall-time latency by nearly 20% under the same multi-view setting. Code will be released at https://github.com/xibi777/Scene-SAM3D.

3D生成多视图无微调场景重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。