构建虚拟现实数据集,让机器人在复杂3D环境中学习避障行走。
Moving Through Clutter: Scaling Data Collection and Benchmarking for 3D Scene-Aware Humanoid Locomotion via Virtual Reality
- 用虚拟现实采集人类在复杂场景中的全身运动数据。
- 生成145个不同杂乱度的3D场景,包含348条运动轨迹。
- 适合研究机器人避障、平衡控制与环境感知的团队使用。
近期人形机器人运动能力取得进展,可在开放平坦环境中完成跳舞、武术和跑酷等动态动作,但这些能力主要在无障碍环境下演示。真实世界如家庭、办公室和公共场所通常布满家具和杂物,具有三维结构和几何约束,需要全身协调、精准平衡控制以及对空间限制的推理能力。然而,人形机器人在复杂三维环境中的运动仍缺乏系统研究,且尚无公开数据集将完整人体运动与塑造其行为的场景几何信息关联起来。为此,我们提出「穿越杂乱」(Moving Through Clutter, MTC)框架,基于虚拟现实(VR)实现数据采集与评估。系统可程序化生成可控杂乱度的场景,通过沉浸式VR导航捕捉符合身体形态的全身人类运动,并自动映射到人形机器人模型。我们还设计了量化环境杂乱度与运动性能(包括稳定性与碰撞安全性)的基准测试。利用该框架,我们构建了包含348条轨迹、覆盖145个多样化3D杂乱场景的数据集,为研究几何约束下的运动适应性及开发场景感知规划与控制方法提供了基础。
原文摘要 · Abstract (English)
Recent advances in humanoid locomotion have enabled dynamic behaviors such as dancing, martial arts, and parkour, yet these capabilities are predominantly demonstrated in open, flat, and obstacle-free settings. In contrast, real-world environments such as homes, offices, and public spaces, are densely cluttered, three-dimensional, and geometrically constrained, requiring scene-aware whole-body coordination, precise balance control, and reasoning over spatial constraints imposed by furniture and household objects. However, humanoid locomotion in cluttered 3D environments remains underexplored, and no public dataset systematically couples full-body human locomotion with the scene geometry that shapes it. To address this gap, we present Moving Through Clutter (MTC), an opensource Virtual Reality (VR) based data collection and evaluation framework for scene-aware humanoid locomotion in cluttered environments. Our system procedurally generates scenes with controllable clutter levels and captures embodiment-consistent, whole-body human motion through immersive VR navigation, which is then automatically retargeted to a humanoid robot model. We further introduce benchmarks that quantify environment clutter level and locomotion performance, including stability and collision safety. Using this framework, we compile a dataset of 348 trajectories across 145 diverse 3D cluttered scenes. The dataset provides a foundation for studying geometry-induced adaptation in humanoid locomotion and developing scene-aware planning and control methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。