arXiv:2509.07593cs.ROcs.AI2025-09中稿 · Advanced Engineeri…被引 1

用新型架构融合视觉与本体感知,让机器人更稳更快学会运动控制。

Vision-Proprioception Fusion with Mamba2 in End-to-End Reinforcement Learning for Motion Control

  • 基于SSD-Mamba2的跨模态融合,实现高效低延迟状态更新。
  • 在复杂地形上比现有方法减少80%碰撞和跌倒,样本效率提升3倍。
  • 适合资源受限的机器人系统,尤其适用于实时运动控制场景。

端到端强化学习通过直接从传感器输入生成动作指令,实现对不同机器人和任务的统一控制。然而,现有方法或仅依赖本体感知(盲视),或使用计算-内存权衡不佳的融合主干。循环控制器难以处理长时序信用分配,而基于Transformer的融合在序列长度上具有二次复杂度,限制了时空上下文。本文提出一种视觉驱动的跨模态强化学习框架,基于SSD-Mamba2——一种利用状态空间对偶性(SSD)的可选状态空间主干,支持递归与卷积扫描,具备硬件感知流式处理和近线性扩展能力。本体状态与外部观测(如深度图)被编码为紧凑令牌,并通过堆叠的SSD-Mamba2层进行融合。选择性状态空间更新以显著更低的延迟和内存开销保留长程依赖,支持更长前瞻、更高分辨率令牌,且在有限算力下训练更稳定。策略在随机化地形与外观的课程中训练,奖励函数平衡任务进展、能效与安全。在多种运动控制场景中,该方法在回报、安全性(碰撞与跌倒)和样本效率上持续优于强基线,且在相同算力下收敛更快。结果表明,SSD-Mamba2为工程信息学中的资源受限机器人与自主系统提供了实用的融合主干。

原文摘要 · Abstract (English)

End-to-end reinforcement learning (RL) for motion control trains policies directly from sensor inputs to motor commands, enabling unified controllers for different robots and tasks. However, most existing methods are either blind (proprioception-only) or rely on fusion backbones with unfavorable compute-memory trade-offs. Recurrent controllers struggle with long-horizon credit assignment, and Transformer-based fusion incurs quadratic cost in token length, limiting temporal and spatial context. We present a vision-driven cross-modal RL framework built on SSD-Mamba2, a selective state-space backbone that applies state-space duality (SSD) to enable both recurrent and convolutional scanning with hardware-aware streaming and near-linear scaling. Proprioceptive states and exteroceptive observations (e.g., depth tokens) are encoded into compact tokens and fused by stacked SSD-Mamba2 layers. The selective state-space updates retain long-range dependencies with markedly lower latency and memory use than quadratic self-attention, enabling longer look-ahead, higher token resolution, and stable training under limited compute. Policies are trained end-to-end under curricula that randomize terrain and appearance and progressively increase scene complexity. A compact, state-centric reward balances task progress, energy efficiency, and safety. Across diverse motion-control scenarios, our approach consistently surpasses strong state-of-the-art baselines in return, safety (collisions and falls), and sample efficiency, while converging faster at the same compute budget. These results suggest that SSD-Mamba2 provides a practical fusion backbone for resource-constrained robotic and autonomous systems in engineering informatics applications.

强化学习机器人控制视觉融合Mamba2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。