arXiv:2505.12410cs.RO2025-05被引 12

用Mamba模型高效编码历史,让机器人学会长时序动作决策。

MTIL: Encoding Full History with Mamba for Temporal Imitation Learning

  • 采用线性复杂度的Mamba架构,实时处理长序列观察。
  • 在仿真与真实任务中超越ACT、扩散策略等主流方法。
  • 适合需要理解长期上下文的机器人操控场景。

传统模仿学习依赖马尔可夫假设,在长时序任务中因缺乏历史信息而表现不佳。现有Transformer架构受限于二次计算复杂度,难以处理高维长序列。为此,我们提出Mamba时序模仿学习(MTIL),将世界模型与动力系统思想融合。通过状态空间模型(SSMs)的线性递归动态,MTIL构建一个隐式的、以行动为导向的世界模型,将完整轨迹历史压缩为持续演化的状态表示,使策略能基于完整的时序上下文进行决策,突破马尔可夫限制。在ACT、Robomimic、LIBERO等仿真基准及真实世界挑战任务上,MTIL显著优于当前最优方法(如ACT、Diffusion Policy),尤其在解决长期时序模糊性方面表现突出。结果验证了完整时序上下文的必要性,并证明MTIL是一种高效可行的长时序非马尔可夫行为学习方案。

原文摘要 · Abstract (English)

Standard imitation learning (IL) methods have achieved considerable success in robotics, yet often rely on the Markov assumption, which falters in long-horizon tasks where history is crucial for resolving perceptual ambiguity. This limitation stems not only from a conceptual gap but also from a fundamental computational barrier: prevailing architectures like Transformers are often constrained by quadratic complexity, rendering the processing of long, high-dimensional observation sequences infeasible. To overcome this dual challenge, we introduce Mamba Temporal Imitation Learning (MTIL). Our approach represents a new paradigm for robotic learning, which we frame as a practical synthesis of World Model and Dynamical System concepts. By leveraging the linear-time recurrent dynamics of State Space Models (SSMs), MTIL learns an implicit, action-oriented world model that efficiently encodes the entire trajectory history into a compressed, evolving state. This allows the policy to be conditioned on a comprehensive temporal context, transcending the confines of Markovian approaches. Through extensive experiments on simulated benchmarks (ACT, Robomimic, LIBERO) and on challenging real-world tasks, MTIL demonstrates superior performance against SOTA methods like ACT and Diffusion Policy, particularly in resolving long-term temporal ambiguities. Our findings not only affirm the necessity of full temporal context but also validate MTIL as a powerful and a computationally feasible approach for learning long-horizon, non-Markovian behaviors from high-dimensional observations.

模仿学习长时序决策Mamba机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。