让智能体持续学习不遗忘,通过分离通用知识与任务冲突知识。
Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning
- 用几何共识过滤冲突梯度,分离共享与任务特有知识。
- 在GUI和工具使用任务上实现优异持续学习性能,开销极小。
- 适合研究智能体持续学习或需要稳定更新的AI系统开发者。
基于大语言模型(LLM)的智能体通过与动态环境交互显著扩展了LLM的应用能力。然而,如何在不产生灾难性遗忘的前提下持续学习新任务,仍是关键挑战,即稳定性-可塑性困境。本文认为该困境的根本原因在于未能显式区分跨任务共享的通用知识与任务特定干扰带来的冲突知识。为此,我们提出Agent-Dice,一种基于方向共识评估的参数融合框架。具体地,Agent-Dice通过两阶段过程解耦知识更新:几何共识过滤以剔除冲突梯度,曲率重要性加权以强化共享语义。我们提供了严格的理论分析,揭示了所提融合方案的有效性,并深入阐释了稳定性-可塑性困境的根源。在GUI智能体与工具使用智能体领域的大量实验表明,Agent-Dice在极低计算开销和参数更新量下展现出卓越的持续学习性能。代码已公开于https://github.com/Wuzheng02/Agent-Dice。
原文摘要 · Abstract (English)
Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments. However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge, known as the stability-plasticity dilemma. In this work, we argue that this dilemma fundamentally arises from the failure to explicitly distinguish between common knowledge shared across tasks and conflicting knowledge introduced by task-specific interference. To address this, we propose Agent-Dice, a parameter fusion framework based on directional consensus evaluation. Concretely, Agent-Dice disentangles knowledge updates through a two-stage process: geometric consensus filtering to prune conflicting gradients, and curvature-based importance weighting to amplify shared semantics. We provide a rigorous theoretical analysis that establishes the validity of the proposed fusion scheme and offers insight into the origins of the stability-plasticity dilemma. Extensive experiments on GUI agents and tool-use agent domains demonstrate that Agent-Dice exhibits outstanding continual learning performance with minimal computational overhead and parameter updates. The codes are available at https://github.com/Wuzheng02/Agent-Dice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。