arXiv:2606.03994cs.CVcs.RO2026-06被引 1

让3D场景重建结果能通过物理模拟,避免物体穿插或悬浮。

SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image

论文配图:SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image
图 1 · 摘自论文原文
  • 用物理引擎实时诊断生成过程中的形状错误
  • 通过重力下拉和全貌重采样修复几何缺陷
  • 适合机器人操控与仿真环境构建场景

从单张图像重建可交互、可仿真的3D场景是机器人操作的关键瓶颈。现有方法虽能恢复单个物体的合理形状,但组合后常因物体穿插、悬浮或下沉导致物理模拟崩溃。当前物理感知方法仅在后期修正布局,未解决根本几何误差。为此,我们提出SimuScene,一种将物理信息融入形状与布局估计的组合式3D重建流程。不把物理引擎仅用于事后清理,而是将其作为生成过程中的诊断工具:通过重力下的仿真,将穿透与支撑失败转化为量化修正信号,驱动沿重力轴拉伸与非遮挡形状重采样。该物理反馈机制有效缓解累积误差,生成稳定且仿真可用的3D场景。大量实验表明其在物理稳定性与几何对齐基准上达到顶尖水平。进一步验证了其在人形机器人控制与机械臂操作任务中的实用价值。

原文摘要 · Abstract (English)

Reconstructing interactive, simulation-ready 3D scenes from a single image is a critical bottleneck for robotic manipulation. While recent single-image lifters recover plausible per-object shapes, composing them yields scenes that collapse under physical simulation due to interpenetrating, hovering, or sinking objects. Existing physics-aware methods address this strictly as a post-hoc layout correction, leaving the underlying geometric errors unresolved. To address this, we introduce SimuScene, a compositional 3D reconstruction pipeline that puts physics in the loop of shape and layout estimation. Rather than using physics merely for layout cleanup, we utilize the physics engine as a diagnostic measurement tool during the generative process itself. By diagnostically simulating reconstructed objects under gravity, we convert penetration and support failures into quantitative correction signals that drive gravity-axis stretching and amodal shape resampling. This physics-informed feedback loop mitigates accumulated reconstruction errors and produces a stable, simulation-ready compositional 3D scene. Extensive experiments demonstrate state-of-the-art performance on physical stability and geometric alignment benchmarks. We further highlight SimuScene's utility by deploying reconstructed environments in humanoid control and robot-arm manipulation tasks.

3D重建物理仿真机器人单图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。