arXiv:2606.08253cs.ROcs.LG2026-06中稿 · RSS 2026

让机器人精准踩脚,安全走复杂地形。

Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking

论文配图:Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking
图 1 · 摘自论文原文
  • 用动态目标采样实现通用足位跟踪,不依赖特定地形。
  • 在仿真与真实环境均实现自然准确的行走表现。
  • 可对接多种高层规划器,适合复杂环境下的操作任务。

让类人机器人在复杂动态环境中运行仍是重大挑战,核心瓶颈在于导航的鲁棒性、安全性与精确性。尽管基于速度指令的强化学习已实现类人运动的高鲁棒性,但其缺乏对落脚点的显式控制,导致踩到人脚等危险行为或导航不准,影响后续操作任务。相反,显式足位跟踪策略可通过目标足姿直接控制,但现有方法常受限于不切实际的状态假设,或为分阶段流水线,仅适配特定下游任务。本文提出一种轻量级通用3D足位跟踪训练框架,通过动态提供步态支撑的目标采样器,使学习策略对具体地形无感。新目标表示有效缓解现实世界中姿态估计噪声、足部接触估计不准等问题。该策略设计用于直接现实迁移,作为独立底层控制器,可无缝对接各类高层足位生成器。我们在仿真和真实世界中广泛验证了该框架的有效性。结合不同上游规划器,实现在复杂场景中的自然且精确的运动,为复杂环境中的运动-操作一体化任务铺平道路。

原文摘要 · Abstract (English)

Enabling humanoid robots to operate in complex, dynamic environments remains a critical challenge, fundamentally limited by the ability to navigate robustly, safely, and accurately. While reinforcement learning with velocity-commanded policies has achieved remarkable robustness in humanoid locomotion, this approach lacks explicit control of the foothold placement, leading to unsafe behavior, such as stepping onto human feet, or imprecise navigation, hindering the following manipulation task. Conversely, explicit foothold-tracking policies offer a promising alternative by directly being commanded with target foot poses. However, existing approaches are often limited by unrealistic state assumptions, compromising real-world deployment, or they are part of staged pipelines, making them tied to specific downstream tasks. In this work, we introduce a novel, lightweight framework for training general-purpose 3D foothold-tracking policies. By dynamically providing footstep support through a goal sampler, this method enables the learned policy to be agnostic to specific terrains. Our new target representation effectively mitigates challenges arising in the real world, such as noisy and inaccurate pose estimation and foot contact estimation. Designed for direct real-world transfer, our policy acts as a standalone low-level controller that can be seamlessly paired with various high-level foothold generators. We demonstrate the effectiveness of our framework through extensive experiments in simulation and in the real world. By coupling our policy with different upstream planners, we achieve natural and accurate locomotion in challenging settings, paving the way for loco-manipulation tasks in complex environments.

类人机器人足位跟踪强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。