arXiv:2605.27762cs.AI2026-05被引 2

让游戏智能体学会从失败中自我进化,记忆直接存成参数。

PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft

论文配图:PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft
图 1 · 摘自论文原文
  • 用对比学习把经验固化为参数化技能,避免遗忘。
  • 失败轨迹与修正动作一起训练,提升纠错能力。
  • 自触发机制无需调参,适合长期自主学习场景。

我们提出PEAM,一种在Minecraft中实现参数化具身智能体记忆的框架,将记忆从推理时检索转变为通过经验内化的参数驻留技能。PEAM结合慢速的开放推理大模型与快速的参数化模块,实现反思性执行。快速模块采用多模态专家混合LoRA架构,每类任务使用物理隔离的适配器,支持参数级持续学习且无灾难性遗忘。我们将失败视为首要训练信号:失败-修正轨迹对通过联合行为克隆与对比目标进行内化,使智能体不仅学习成功策略,还掌握失败与修正动作的差异。为控制整合过程,PEAM引入参数化价值评分以决定哪些经验应被内化,并设计无尺度自触发整合机制以决定何时内化,无需任务特定的调参阈值,使智能体能在跨任务分布中自演化。Minecraft实验表明,PEAM提升了长时程任务表现,缓解了已有技能遗忘问题,并在参数化与检索效率上优于基于检索的具身智能体及参数记忆变体。

原文摘要 · Abstract (English)

We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft that transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience. PEAM pairs a slow deliberative LLM for open-ended reasoning with a fast parametric module for reflexive execution of consolidated skills. The fast module is a multimodal Mixture-of-Experts LoRA architecture with per-category physically isolated adapters, enabling parameter-level continual learning without catastrophic forgetting. We treat failure as a first-class training signal: failure--correction trajectory pairs are internalized through a joint behavioral-cloning and contrastive objective, so the agent learns not only what succeeds but also how corrected actions differ from failed ones. To govern consolidation, PEAM introduces a parameterization-worthiness score for deciding which experience should be internalized, and a scale-free self-triggered consolidation mechanism for deciding when to internalize without task-specific hand-tuned thresholds, making the agent self-evolving as the trigger transfers across task distributions without re-tuning. Experiments in Minecraft show that PEAM improves long-horizon task performance, mitigates forgetting on previously consolidated skills, and improves parametric-versus-retrieval efficiency over retrieval-based embodied agents and parametric memory variants.

具身智能持续学习对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。