用物理真实模拟人群,提升机器人导航训练与评测效果
NavIsaacLab: Generating Realistic Crowd via Parallel Robot Learning for Benchmarking Human-aware Navigation

- 基于扩散模型与对抗学习生成逼真人流行为
- 支持GPU并行仿真,实现实时3D视觉反馈
- 提供多尺度场景,适合测试先进导航算法
机器人在人类共存环境中自主导航需兼顾安全与自然交互。仿真复杂多样的导航场景是训练可靠导航策略和评估算法性能的基础,可替代人工标注真实数据。然而当前研究受限于高质量、多样化场景数据稀缺,现有仿真平台多依赖手工规则模拟行人行为,且缺乏丰富传感器信号,常假设理想观测。为此,本文提出NavIsaacLab,一个基于Isaac Lab的物理驱动与照片级真实感仿真框架,用于训练与评测人机共融导航策略。该框架利用照片级场景渲染与GPU并行仿真能力,实现机器人实时准确的3D视觉反馈。通过引入轨迹扩散模型与对抗式运动控制器,实现可控、物理真实的行人行为建模,并集成多尺度交叉场景,为前沿人机导航方法提供稳健基准。
原文摘要 · Abstract (English)
Robot autonomous navigation that accounts for surrounding human activities is crucial for ensuring both safety and natural human-robot interaction in real-world environments shared by humans and robots. Simulation of complex and diverse navigation scenarios serves as the foundation for training reliable robot navigation policies and accurately evaluating the performance of algorithms, offering an efficient alternative to manual supervision of real data. However, current human-aware navigation research faces significant challenges due to the scarcity of diverse, high-quality scene data. Existing simulation platforms often rely on handcrafted rules to approximate pedestrian behavior and lack the capability to provide extensive sensor signals, typically assuming perfect observations. To address these limitations, this paper presents NavIsaacLab, a comprehensive framework for benchmarking and training human-aware navigation policies through physics-based and photo-realistic simulations of pedestrians and scenes. Based on Isaac Lab, the proposed framework employs photo-realistic scene rendering capabilities and supports parallel simulation on GPU, delivering real-time and accurate 3D visual feedback to robots. To enhance the realism of human behavior, a data-driven approach is employed that incorporates a trajectory diffusion model and an adversarial motion learning controller, enabling controllable, physics-based pedestrian simulation. Furthermore, the integration of diverse cross-scale scenes provides a robust benchmark for state-of-the-art human-aware navigation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。