arXiv:2412.03353cs.RO2024-12ICRA被引 13

让四足机器人在视野受限时仍能多技能全向移动

MOVE: Multi-skill Omnidirectional Legged Locomotion with Limited View in 3D Environments

  • 用伪孪生网络融合视觉与本体感觉,实现跨视域环境感知
  • 实测可在仿真与真实场景中完成攀爬、跳跃、爬楼梯等复杂动作
  • 适合研究视觉受限环境下机器人自主运动的学者参考

四足机器人在复杂三维地形中具有天然优势。然而,以往基于前向视角的低成本四足机器人受制于狭窄视野和外部感知噪声,难以实现全向运动。尽管分层体素地图可提升外部感知,但带来显著计算开销、噪声和延迟。本文提出MOVE,一种单阶段端到端学习框架,使机器人在有限视野下具备多技能全向运动能力,如真实动物般灵活。当运动方向与视线一致时,利用外部感知增强运动表现,实现极端攀爬与跳跃;当视野被遮挡或运动方向超出视野范围时,依赖本体感觉完成爬行与爬楼梯等任务。通过引入结合监督与对比学习的伪孪生网络结构,将多种技能统一集成于单一神经网络中,使机器人可推断视野外环境信息。仿真与真实场景实验验证了方法的鲁棒性,显著拓展了带前向摄像头机器人的作业环境边界。

原文摘要 · Abstract (English)

Legged robots possess inherent advantages in traversing complex 3D terrains. However, previous work on low-cost quadruped robots with egocentric vision systems has been limited by a narrow front-facing view and exteroceptive noise, restricting omnidirectional mobility in such environments. While building a voxel map through a hierarchical structure can refine exteroception processing, it introduces significant computational overhead, noise, and delays. In this paper, we present MOVE, a one-stage end-to-end learning framework capable of multi-skill omnidirectional legged locomotion with limited view in 3D environments, just like what a real animal can do. When movement aligns with the robot's line of sight, exteroceptive perception enhances locomotion, enabling extreme climbing and leaping. When vision is obstructed or the direction of movement lies outside the robot's field of view, the robot relies on proprioception for tasks like crawling and climbing stairs. We integrate all these skills into a single neural network by introducing a pseudo-siamese network structure combining supervised and contrastive learning which helps the robot infer its surroundings beyond its field of view. Experiments in both simulations and real-world scenarios demonstrate the robustness of our method, broadening the operational environments for robotics with egocentric vision.

四足机器人视觉导航多技能运动本体感觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。