让智能体动态学习该共享还是个性化记忆,提升对话连贯性。
Learning What to Share and What to Personalize: Hierarchical Strategy Co-Evolution for Agent Memory

- 分层设计:全局共享策略+用户专属自适应规则
- 跨层级规则流动,自动调节共享与个性边界
- 策略随任务优化同步进化,适合长期对话场景
增强记忆的智能体通过维护紧凑的用户画像,在不处理完整对话历史的前提下实现个性化和一致性的回应。用户画像的质量取决于底层的记忆管理策略:每一步需判断保留、压缩或丢弃信息。然而现有方法通常采用训练前固定的单一策略。实际上,最优记忆决策具有用户特异性,并随策略优化动态演进。为此,本文提出HiPS(分层个性化策略)框架,将记忆管理解耦为全局共享基础层与用户自适应层。其中,通用策略从跨角色轨迹中提取共性规律,人格差值蒸馏则为行为偏离普遍模式的用户提供定制化规则。跨层级规则流动机制动态校准两者边界,促进广泛验证的个性化规则,淘汰冲突的全局规则。架构建立协同进化循环,确保所有策略更新均以任务表现为导向。大量实验表明,其性能持续优于现有记忆增强基线。
原文摘要 · Abstract (English)
Memory-augmented agents maintain compact user profiles throughout extended conversations, enabling personalized and consistent responses without the need to process the entire dialogue history. The quality of these user profiles relies on the underlying memory management strategy: at each step, the agent must determine what to retain, compress, or discard. However, existing methods typically employ a static, one-size-fits-all strategy established before training. In practice, the optimal memory decision is inherently user-specific and dynamically evolves alongside policy optimization. To address this, we propose \textbf{HiPS} (\textbf{Hi}erarchical \textbf{P}ersonalized \textbf{S}trategy), a framework that decouples memory management into a globally shared foundation and a user-specific adaptive tier. Specifically, HiPS employs \textbf{Universal Strategy} to extract shared principles from cross-persona trajectories, alongside \textbf{Persona Delta Distillation} to generate tailored rules for users whose behaviors diverge from general patterns. \textbf{Cross-Level Rule Flow} dynamically calibrates their boundary by promoting broadly validated personal rules and demoting contradicted global ones. The architecture establishes a co-evolution loop where a mechanism guarantees that all strategy refinements are anchored to task outcomes. Extensive experiments demonstrate consistent improvements over memory-augmented baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。