通过自适应选样与动态想象,提升机器人移动操作的样本效率和空间泛化能力。
Spatially Generalizable Mobile Manipulation via Adaptive Experience Selection and Dynamic Imagination
- 自适应选样聚焦关键经验片段,缓解技能遗忘问题。
- 基于状态空间模型的动态预测规划,实现任务内强化与跨布局泛化。
- 在真实场景中验证有效,适用于复杂多阶段操作任务。
移动操作(MM)涉及导航与抓取等异构技能的长时程决策与多阶段组合。现有方法存在两大瓶颈:(i) 样本效率低,源于长期交互中冗余数据利用不当;(ii) 空间泛化差,训练于特定布局的策略难以迁移至新环境。本文提出自适应经验选择(AES)与基于模型的动态想象机制。AES使智能体关注影响任务成败的关键经验片段,提升技能链学习并缓解技能遗忘。在此基础上,引入循环状态空间模型(RSSM),用于建模移动基座与机械臂间的耦合动力学,并实现对未来操作的动态预测规划(MPFP)。该方法在当前任务上强化技能学习,同时支持对新空间布局的有效泛化。多组对比实验表明,本方法显著优于现有MM策略。真实世界实验进一步验证了其可行性与实用性。
原文摘要 · Abstract (English)
Mobile Manipulation (MM) involves long-horizon decision-making over multi-stage compositions of heterogeneous skills, such as navigation and picking up objects. Despite recent progress, existing MM methods still face two key limitations: (i) low sample efficiency, due to ineffective use of redundant data generated during long-term MM interactions; and (ii) poor spatial generalization, as policies trained on specific tasks struggle to transfer to new spatial layouts without additional training. In this paper, we address these challenges through Adaptive Experience Selection (AES) and model-based dynamic imagination. In particular, AES makes MM agents pay more attention to critical experience fragments in long trajectories that affect task success, improving skill chain learning and mitigating skill forgetting. Based on AES, a Recurrent State-Space Model (RSSM) is introduced for Model-Predictive Forward Planning (MPFP) by capturing the coupled dynamics between the mobile base and the manipulator and imagining the dynamics of future manipulations. RSSM-based MPFP can reinforce MM skill learning on the current task while enabling effective generalization to new spatial layouts. Comparative studies across different experimental configurations demonstrate that our method significantly outperforms existing MM policies. Real-world experiments further validate the feasibility and practicality of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。