用局部与全局记忆结合,提升大模型个性化表现
From Personal to Collective: On the Role of Local and Global Memory in LLM Personalization
- 设计局部-全局记忆框架,融合个人历史与群体共性
- 冷启动用户个性化效果提升,偏倚用户预测更均衡
- 适合需要精准用户建模的智能客服、推荐系统
大语言模型个性化旨在根据用户历史交互调整模型行为。但其效果常受两大挑战制约:冷启动问题(历史数据不足导致个性化不准)和偏倚问题(历史数据丰富但分布单一导致过拟合)。我们发现两者均源于无法建模跨用户的集体知识。为此,提出局部-全局记忆框架(LoGo),将个人局部记忆与捕捉群体共性特征的全局记忆相结合,并引入中介模块以调和两者信号冲突。在多个基准上的实验表明,LoGo能持续提升个性化质量,既缓解冷启动问题,又减轻偏倚预测。结果凸显了融入集体知识对增强大模型个性化的重要性。
原文摘要 · Abstract (English)
Large language model (LLM) personalization aims to tailor model behavior to individual users based on their historical interactions. However, its effectiveness is often hindered by two key challenges: the \textit{cold-start problem}, where users with limited history provide insufficient context for accurate personalization, and the \textit{biasing problem}, where users with abundant but skewed history cause the model to overfit to narrow preferences. We identify both issues as symptoms of a common underlying limitation, i.e., the inability to model collective knowledge across users. To address this, we propose a local-global memory framework (LoGo) that combines the personalized local memory with a collective global memory that captures shared interests across the population. To reconcile discrepancies between these two memory sources, we introduce a mediator module designed to resolve conflicts between local and global signals. Extensive experiments on multiple benchmarks demonstrate that LoGo consistently improves personalization quality by both warming up cold-start users and mitigating biased predictions. These results highlight the importance of incorporating collective knowledge to enhance LLM personalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。