arXiv:2606.08059cs.RO2026-06

让机器人根据地形自动调整人类动作,实现自然行走。

Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain

论文配图:Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain
图 1 · 摘自论文原文
  • 用机器人感知的地形信息动态修正人类动作的落脚点和姿态
  • 通过动作合成技术生成符合地形的机器人可用动作参考
  • 适合需要在复杂环境中迁移人类动作的机器人研发人员

拟人化行为基础模型旨在从广泛的人类运动先验中学习可复用的全身控制策略,使单一控制器能生成多样且富有表现力的行为。然而,现有以运动为中心的基础策略大多假设参考动作已与机器人环境物理兼容。当示范者、操作员和机器人处于不同环境时,该假设失效:人类动作虽定义了意图,但未提供机器人所需落脚点、净空高度、身体高度或接触时机。本文提出感知行为基础模型(Perceptive BFM),一种将人类运动先验锚定于机器人感知的地形自适应控制框架。模型保留原始运动参考作为行为接口,利用局部地形观测自适应调整接触点、姿态与时间。为实现可扩展的地形监督,我们开发了地形一致参考生成(TCRS),通过接触感知落脚点构建、足部几何感知摆动优化、支撑感知根部重构、碰撞修复及多点逆运动学,将面向步行的人类动作片段转换为地形一致的参考。随后训练一个盲适配参考教师,并通过目标帧动作对齐将其地形一致行为迁移至部署的原始参考学生。学生为身份门控Transformer追踪器,其地形特征通过残差路径输入,初始设置保留运动追踪先验,仅在必要时进行局部修正。

原文摘要 · Abstract (English)

Humanoid behavior foundation models aim to acquire reusable whole-body control policies from broad human motion priors, enabling a single controller to produce diverse and expressive behaviors. However, existing motion-centric foundation policies largely assume that the reference motion is already physically compatible with the robot's surroundings. This assumption breaks when the demonstrator, operator, and robot inhabit different environments: a human motion may specify the intended behavior, but not the footholds, clearance, body height, or contact timing required by the robot's local terrain. We introduce \emph{Perceptive Behavior Foundation Model} (Perceptive BFM), a terrain-aware humanoid control framework that grounds human motion priors in robot-centric perception. The model preserves raw kinematic motion references as the behavioral interface, while using local terrain observations to adapt contacts, posture, and timing. To provide scalable terrain supervision, we develop \emph{terrain-conformal reference synthesis} (TCRS), which converts locomotion-oriented human motion clips into terrain-consistent references through contact-aware foothold construction, foot-geometry-aware swing optimization, support-aware root reconstruction, collision repair, and multi-point inverse kinematics. We then train a blind adapted-reference teacher and transfer its terrain-conformal behavior to a deployed raw-reference student through target-frame action alignment. The student is an identity-gated Transformer tracker whose terrain features enter through residual pathways initialized to preserve the motion-tracking prior and trained to produce local corrections only when needed.

机器人控制动作迁移地形感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。