仅用少量观察实现零样本动作泛化,让机器人快速适应新动作。
Zero-Shot Action Generalization with Limited Observations
- 从有限动作观测中学习动作表征,构建可扩展的通用动作模型。
- 在多个基准任务上超越现有方法,仅需少量观测即实现高效泛化。
- 适合缺乏大量动作数据的真实场景,如家庭服务机器人应用。
强化学习在解决序列决策问题上表现卓越,但在现实场景中,当面对训练时未见过的新动作时,往往难以泛化。以往的零样本动作泛化方法依赖大规模动作观测数据来捕捉新动作行为,难以应用于真实环境。本文提出一种新型零样本框架——受限观测下的动作泛化(AGLO),包含动作表征学习模块与策略学习模块。前者从有限观测中提取具有区分性的动作嵌入,后者利用学习到的动作表征及增强的合成表征,训练出能应对未见动作的任务策略。实验表明,该框架在多个基准任务上显著优于当前最优方法,证明其在极小动作观测条件下仍具备强泛化能力。
原文摘要 · Abstract (English)
Reinforcement Learning (RL) has demonstrated remarkable success in solving sequential decision-making problems. However, in real-world scenarios, RL agents often struggle to generalize when faced with unseen actions that were not encountered during training. Some previous works on zero-shot action generalization rely on large datasets of action observations to capture the behaviors of new actions, making them impractical for real-world applications. In this paper, we introduce a novel zero-shot framework, Action Generalization from Limited Observations (AGLO). Our framework has two main components: an action representation learning module and a policy learning module. The action representation learning module extracts discriminative embeddings of actions from limited observations, while the policy learning module leverages the learned action representations, along with augmented synthetic action representations, to learn a policy capable of handling tasks with unseen actions. The experimental results demonstrate that our framework significantly outperforms state-of-the-art methods for zero-shot action generalization across multiple benchmark tasks, showcasing its effectiveness in generalizing to new actions with minimal action observations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。