无需训练,通过记忆迭代实现智能代理主动推理
PRIME: Training Free Proactive Reasoning via Iterative Memory Evolution for User-Centric Agent
- 用记忆演化代替参数优化,基于交互经验生成可读的策略
- 在多轮人机交互中准确捕捉用户偏好与失败模式
- 适合需要低成本、可解释性协作代理的应用场景
自主工具使用代理在复杂、长时程任务中与人类用户协同,已成为智能体研究前沿。在多轮人机交互中,用户需求动态且不确定,代理不仅需调用工具,还需通过有效沟通迭代理解用户意图。尽管强化学习取得进展,现有方法仍需高昂训练成本,且难以在长交互序列中进行逐轮信用分配。为此,我们提出PRIME(Proactive Reasoning via Iterative Memory Evolution),一种无梯度学习框架,通过显式积累经验实现代理持续演化,而非昂贵的参数优化。PRIME将多轮交互轨迹提炼为结构化、人类可读的经验,分属三个语义区:成功策略、失败模式与用户偏好。这些经验通过元级操作演化,并通过检索增强生成引导未来行为。在多个用户中心环境中的实验表明,PRIME性能媲美基于梯度的方法,同时具备成本效益与可解释性。整体上,PRIME为构建无需梯度训练即可从人机交互中学习的主动协作代理提供了一种实用范式。
原文摘要 · Abstract (English)
The development of autonomous tool-use agents for complex, long-horizon tasks in collaboration with human users has become the frontier of agentic research. During multi-turn Human-AI interactions, the dynamic and uncertain nature of user demands poses a significant challenge; agents must not only invoke tools but also iteratively refine their understanding of user intent through effective communication. While recent advances in reinforcement learning offer a path to more capable tool-use agents, existing approaches require expensive training costs and struggle with turn-level credit assignment across extended interaction horizons. To this end, we introduce PRIME (Proactive Reasoning via Iterative Memory Evolution), a gradient-free learning framework that enables continuous agent evolvement through explicit experience accumulation rather than expensive parameter optimization. PRIME distills multi-turn interaction trajectories into structured, human-readable experiences organized across three semantic zones: successful strategies, failure patterns, and user preferences. These experiences evolve through meta-level operations and guide future agent behavior via retrieval-augmented generation. Our experiments across several diverse user-centric environments demonstrate that PRIME achieves competitive performance with gradient-based methods while offering cost-efficiency and interpretability. Together, PRIME presents a practical paradigm for building proactive, collaborative agents that learn from Human-AI interaction without the computational burden of gradient-based training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。