用真实人生记忆让大模型更像真人,行为更自然。
MemoryForge: Synthesize Lifelong Memory for Human-Like LLM Agents

- 用自传式记忆替代静态描述,动态影响模型行为
- 在角色扮演和用户模拟任务中表现优于传统方法
- 适合需要拟人化交互的智能体应用
赋予大语言模型类人人格对代理应用(如角色扮演和用户模拟)至关重要。传统基于提示的方法依赖静态文本描述,常导致行为泛化。为此,我们提出基于记忆的条件化范式,受认知心理学启发,以自传式记忆库替代抽象身份描述,使冻结的大模型能动态检索情境相关记忆以指导行为。我们形式化该任务为定制化终身记忆合成,并提出MemoryForge框架,从简短目标人格生成终身记忆。其包含三部分:用于社会历史定位的上下文生成器、确保发展连贯性的生命组织器,以及平衡时间概览与高保真情景体验的多分辨率模拟器。在PersonaGym和SimulatorArena上的实验表明,MemoryForge生成的记忆基可使冻结大模型在多个指标和大模型架构下表现出更类人的行为,优于强基线描述性条件化方法。
原文摘要 · Abstract (English)
Equipping Large Language Models (LLMs) with human-like personas is crucial for agentic applications, such as role-play and user simulation. Traditional prompt-based methods rely on descriptive conditioning by injecting static textual profiles, which often makes agents show generic behaviors due to a lack of realistic life memory. To fill this gap, we introduce memory-based conditioning, a paradigm inspired by the cognitive psychology, which replaces abstract profiles with an autobiographical memory base, enabling frozen LLMs to dynamically retrieve situation-relevant memory to guide their behaviors. We formalize its enabling task as customized lifelong memory synthesis and propose MemoryForge, a novel framework to synthesize such lifelong memory from brief target personas. MemoryForge has three key components: a context generator for socio-historical grounding, a life organizer for developmental coherence toward the target identity, and a multi-resolution simulator that balances broad temporal summaries with high-fidelity episodic experiences. Experiments on PersonaGym for role-play and SimulatorArena for user-simulation, show that the synthesized memory base by MemoryForge enables frozen LLMs to exhibit more human-like behaviors than strong descriptive conditioning baselines across multiple metrics and LLM backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。