用3D高斯点云模拟真实环境动态障碍,提升机器人导航鲁棒性。
ReaDy-Go: Real-to-Sim Dynamic 3D Gaussian Splatting Simulation for Environment-Specific Visual Navigation with Moving Obstacles
- 将动态人类动作融入重建的静态3D高斯场景,生成可动画化的真实感障碍物。
- 在多个目标环境中实现比基线更高的导航成功率,即使在未见过的环境也表现良好。
- 适合需要真实场景动态交互能力的机器人导航研究者使用。
视觉导航模型在真实动态环境中常因仿真到现实的差距以及难以适配特定部署环境(如家庭、餐厅、工厂)而表现不佳。尽管基于3D高斯点云(GS)的实转仿导航仿真可缓解此问题,但现有方法仅处理静态场景或非写实的人类障碍物。为此,我们提出ReaDy-Go,一种新颖的实转仿仿真流程,通过在重建的静态GS场景中加入动态人类GS障碍物,合成目标环境中的逼真动态场景,并训练导航策略。该流程包含三大贡献:(1)动态GS仿真器,整合静态场景与人体动画模块,支持可动画化的人类GS化身及从2D轨迹合成合理运动;(2)导航数据集生成框架,结合为动态GS表示设计的机器人专家规划器和人类规划器;(3)对仿真到现实差距与移动障碍物均具鲁棒性的导航策略。仿真生成数千个来自任意视角的逼真导航场景。实验表明,ReaDy-Go在多种目标环境的仿真与真实世界测试中均优于基线,在跨域迁移和动态障碍存在下仍保持优异性能。零样本仿真到现实部署于未知环境进一步验证其泛化能力。
原文摘要 · Abstract (English)
Visual navigation models often struggle in real-world dynamic environments due to limited robustness to the sim-to-real gap and the difficulty of training policies tailored to target deployment environments (e.g., households, restaurants, and factories). Although real-to-sim navigation simulation using 3D Gaussian Splatting (GS) can mitigate these challenges, prior GS-based works have considered only static scenes or non-photorealistic human obstacles built from simulator assets, despite the importance of safe navigation in dynamic environments. To address these issues, we propose ReaDy-Go, a novel real-to-sim simulation pipeline that synthesizes photorealistic dynamic scenarios in target environments by augmenting a reconstructed static GS scene with dynamic human GS obstacles, and trains navigation policies using the generated datasets. The pipeline provides three key contributions: (1) a dynamic GS simulator that integrates static scene GS with a human animation module, enabling the insertion of animatable human GS avatars and the synthesis of plausible human motions from 2D trajectories, (2) a navigation dataset generation framework that leverages the simulator along with a robot expert planner designed for dynamic GS representations and a human planner, and (3) robust navigation policies to both the sim-to-real gap and moving obstacles. The proposed simulator generates thousands of photorealistic navigation scenarios with animatable human GS avatars from arbitrary viewpoints. ReaDy-Go outperforms baselines across target environments in both simulation and real-world experiments, demonstrating improved navigation performance even after sim-to-real transfer and in the presence of moving obstacles. Moreover, zero-shot sim-to-real deployment in an unseen environment indicates its generalization potential. Project page: https://syeon-yoo.github.io/ready-go-site/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。