用视频生成可交互的逼真虚拟场景，支持游戏与机器人仿真。
DRAWER: Digital Reconstruction and Articulation With Environment Realism
- 双场景表征重建精细几何，还原真实环境细节
- 自动识别关节类型与位置，生成可模拟的动态物体
- 实时运行且兼容主流游戏与机器人平台
从静态室内场景的视频中构建虚拟数字副本具有广泛应用潜力，如游戏与机器人。本文提出DRAWER框架，将视频转化为逼真且可交互的虚拟环境。核心贡献包括：(i) 基于双场景表示的重建模块，实现高精度几何细节恢复；(ii) 关节识别与重建模块，自动确定铰接类型与转轴位置，生成可模拟的形状与外观，并集成至场景中。生成环境具备逼真视觉效果、实时交互能力，兼容Unreal Engine等游戏引擎及机器人仿真平台。我们展示了其在自动生成互动游戏以及实现真实-仿真-真实迁移中的应用潜力。
原文摘要 · Abstract (English)
Creating virtual digital replicas from real-world data unlocks significant potential across domains like gaming and robotics. In this paper, we present DRAWER, a novel framework that converts a video of a static indoor scene into a photorealistic and interactive digital environment. Our approach centers on two main contributions: (i) a reconstruction module based on a dual scene representation that reconstructs the scene with fine-grained geometric details, and (ii) an articulation module that identifies articulation types and hinge positions, reconstructs simulatable shapes and appearances and integrates them into the scene. The resulting virtual environment is photorealistic, interactive, and runs in real time, with compatibility for game engines and robotic simulation platforms. We demonstrate the potential of DRAWER by using it to automatically create an interactive game in Unreal Engine and to enable real-to-sim-to-real transfer for robotics applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。