用状态空间模型让机器人记住全程历史,提升长任务决策能力
DSSP: Diffusion State Space Policy with Full-History Encoding

- 用状态空间模型压缩完整观测序列,生成紧凑上下文表示
- 在仿真和真实任务中表现优于现有方法,模型更小、效率更高
- 适合需要长期记忆的机器人操作任务,如复杂装配与多步规划
基于扩散模型的模仿学习在机器人操作中展现出强大潜力。然而,多数现有策略仅依赖当前观测或近期短窗口观测,难以解决长周期任务中的历史相关模糊性问题。为此,我们提出DSSP:一种全历史条件化的扩散状态空间策略,支持高效、完整的历史信息建模。利用状态空间模型(SSM)的连续序列建模能力,我们的历史编码器将整个观测流压缩为紧凑的上下文表示。为确保该上下文能保留对未来状态演变的关键信息,编码器采用动态感知的辅助训练目标进行优化。此高层上下文与近期状态观测融合,形成分层条件机制以生成动作。此外,为保持架构一致性并最小化显存开销,扩散主干也采用SSM实现。在多个仿真基准与真实世界操作任务上的大量实验表明,DSSP在模型规模显著减小的情况下达到当前最优性能,证明了分层条件机制在历史长度增加时对关键信息捕捉的优越性。
原文摘要 · Abstract (English)
Diffusion-based imitation learning has shown strong promise for robot manipulation. However, most existing policies condition only on the current observation or a short window of recent observations, limiting their ability to resolve history-dependent ambiguities in long-horizon tasks. To address this, we introduce DSSP, a history-conditioned Diffusion State Space Policy that enables efficient, full-history conditioning for robot manipulation. Leveraging the continuous sequence modeling properties of State Space Models (SSMs), our history encoder effectively compresses the entire observation stream into a compact context representation. To ensure this context preserves critical information regarding future state evolution, the encoder is optimized with a dynamics-aware auxiliary training objective. This high-level context representation is then seamlessly fused with recent state observations to form a hierarchical conditioning mechanism for action generation. Furthermore, to maintain architectural consistency and minimize GPU memory overhead, we also instantiate the diffusion backbone itself using an SSM. Extensive experiments across simulation benchmarks and real-world manipulation tasks show that DSSP achieves state-of-the-art performance with a significantly smaller model size, demonstrating superior efficiency of the hierarchical conditioning in capturing crucial information as the history length increases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。