arXiv:2606.25056cs.RO2026-06

用隐空间优化实现物理角色精准动作追踪,无需设计奖励函数。

BFMTrack: Latent Sequence Optimization for Physics-Based Motion Tracking with Behavioral Foundation Models

论文配图:BFMTrack: Latent Sequence Optimization for Physics-Based Motion Tracking with Behavioral Foundation Models
图 1 · 摘自论文原文
  • 通过策略梯度优化隐变量序列,实现动态动作追踪
  • 在密集追踪与稀疏关键帧下均保持高精度,误差低于15%
  • 适用于真实人形机器人部署,提升运动连贯性

行为基础模型(BFMs)通过大规模动作数据将丰富且物理合理的动作组织到隐空间中,为通用物理角色控制提供了新路径。尽管其在时间不变任务(如目标到达、状态奖励优化)上表现优异,但其隐空间无法直接支持时间变化的目标,如动作序列追踪。现有方法依赖滑动窗口平均,难以捕捉高度动态动作的细节。本文提出一种新的隐序列优化(LSO)方法,结合模拟轨迹与策略梯度更新,对一系列隐变量进行优化,使BFMs具备精确动作追踪能力,且无需奖励工程与调参。为确保隐变量轨迹平滑连贯,我们引入具有时序相关性的噪声建模。我们在密集追踪、稀疏关键帧及真实人形机器人部署场景中验证了该方法的有效性。

原文摘要 · Abstract (English)

Behavioral Foundation Models (BFMs) offer a promising path toward universal physics-based character control by organizing a rich repertoire of physically plausible behaviors into a latent space, guided by a large-scale motion dataset. While these models excel at time-invariant tasks, such as goal-reaching and state-based reward optimization, their latent space does not directly support time-varying objectives, such as tracking a motion sequence. For tracking, existing heuristics rely on moving-window-averaging that fails to capture the nuances of highly dynamic motions. In this work, we propose a novel Latent Sequence Optimization (LSO) to address these shortcomings. Our approach combines simulation rollouts with a policy gradient update to optimize over a sequence of latents, extending the capabilities of BFMs toward precise motion tracking without requiring reward engineering and tuning. To guide the optimization toward smooth, coherent latent trajectories, we model the latent sequence using temporally correlated noise. We validate our approach across dense tracking, sparse keyframing, and direct deployment onto a real humanoid robot.

动作追踪隐空间优化物理模拟人形机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。