用局部编辑提升大模型个性化,更准更快还防遗忘。
Towards Effective Model Editing for LLM Personalization
- 将个性化视为模型编辑任务,通过聚类偏好表示实现精准更新。
- 在多轮对话和隐式查询中表现优于微调与提示基线。
- 构建UPQA数据集,直接评估模型对用户偏好的记忆与应用能力。
个性化已成为大语言模型适应个体用户偏好与需求的必要手段。然而现有方法普遍存在计算成本高、数据依赖性强、易导致灾难性遗忘,且在多轮交互或处理隐式查询时性能下降的问题。为此,我们提出将个性化视为模型编辑任务,引入个人化编辑框架(Personalization Editing),该框架基于聚类后的偏好表征进行局部编辑,可在保持模型整体能力的同时实现精准偏好对齐。此外,现有个性化基准多依赖模型间角色扮演对话,或仅关注风格模仿,忽视需准确回忆用户特定偏好的信息检索任务。为此,我们构建了用户偏好问答(UPQA)数据集,基于真实用户查询生成,涵盖不同难度的简答问题。实验表明,个人化编辑在编辑精度与计算效率上优于微调,在多轮对话与隐式偏好问题场景中超越提示基线。
原文摘要 · Abstract (English)
Personalization is becoming indispensable for LLMs to align with individual user preferences and needs. Yet current approaches are often computationally expensive, data-intensive, susceptible to catastrophic forgetting, and prone to performance degradation in multi-turn interactions or when handling implicit queries. To address these challenges, we conceptualize personalization as a model editing task and introduce Personalization Editing, a framework that applies localized edits guided by clustered preference representations. This design enables precise preference-aligned updates while preserving overall model capabilities. In addition, existing personalization benchmarks frequently rely on persona-based dialogs between LLMs rather than user-LLM interactions, or focus primarily on stylistic imitation while neglecting information-seeking tasks that require accurate recall of user-specific preferences. We introduce User Preference Question Answering (UPQA), a short-answer QA dataset constructed from in-situ user queries with varying levels of difficulty. Unlike prior benchmarks, UPQA directly evaluates a model's ability to recall and apply specific user preferences. Across experimental settings, Personalization Editing achieves higher editing accuracy and greater computational efficiency than fine-tuning, while outperforming prompting-based baselines in multi-turn conversations and implicit preference questions settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。