arXiv:2607.17574cs.ROcs.AI2026-07

让四足机器人提前预判障碍物动向,提升避障能力

Predictive Training with Latent Imagination for Visual Quadruped Navigation

论文配图:Predictive Training with Latent Imagination for Visual Quadruped Navigation
图 1 · 摘自论文原文
  • 用预测信号训练时让模型预判障碍物下一状态
  • 仿真与实机测试中成功率显著提升,碰撞率下降
  • 无需额外计算开销,可直接部署到真实机器人

用于腿式机器人的强化学习导航策略通常基于当前观测和短期记忆进行反应式动作选择,难以预见动态障碍物在短期内的演化。在动态环境中,这种反应性导致机器人响应滞后,因为碰撞风险取决于短时场景结构,而不仅限于障碍物当前位置。通过在训练期间对策略的循环状态施加轻量级预测监督,可在不修改推理时控制器的前提下编码前瞻性的障碍物动态。我们为反应式LSTM-SRU导航主干增加一个类似JEPA的预测器和SIGReg正则化:训练时,预测器监督确定性隐藏状态以预判自身下一状态;推理时完全丢弃,计算开销为零。在含动态障碍物的仿真与真实世界导航基准测试中,仅靠预测训练信号即可显著提升导航成功率并降低碰撞率,且无需额外推理参数。真实机器人部署在Unitree Go2上实现零样本模拟到现实迁移:控制器在杂乱室内及动态室外环境均无需微调即可导航,避障行为与仿真中观察到的碰撞减少一致。

原文摘要 · Abstract (English)

Reinforcement-learning navigation policies for legged robots select actions reactively from current observations and short-term memory, with limited capacity to anticipate how moving obstacles will evolve in the near future. In dynamic environments, this reactivity causes the robot to respond too late because collision risk depends on short-horizon scene structure rather than on current obstacle positions alone. Lightweight predictive supervision applied to the policy's recurrent state during training can encode anticipatory obstacle dynamics without modifying the inference-time controller. We augment a reactive LSTM-SRU navigation backbone with an auxiliary JEPA-style predictor and SIGReg regularization: during training, the predictor supervises the deterministic hidden state to anticipate its own next state; at inference, it is fully discarded, incurring zero additional computational cost. On simulated and real-world navigation benchmarks with dynamic obstacles, our method substantially improves navigation success while reducing collision rates through the predictive training signal alone, without additional inference-time parameters. Real-robot deployment on a Unitree Go2 demonstrates zero-shot sim-to-real transfer: the controller navigates cluttered indoor and dynamic outdoor environments without fine-tuning, with evasive behavior consistent with the collision reduction observed in simulation.

四足机器人强化学习预测控制零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。