arXiv:2608.27816cs.CL2026-08中稿 · EMNLP

通过聚类选代表样本,让大模型个性化编辑更高效

PersonaEdit: Representative Sample Selection for Personalized Model Editing

论文配图:PersonaEdit: Representative Sample Selection for Personalized Model Editing
图 1 · 摘自论文原文
  • 用隐藏表示聚类+分层采样,选最具代表性用户数据
  • 只需原样本15%数量,性能损失小于3%(实测)
  • 适合需要长期个性化且算力有限的场景

个性化在大模型应用中日益重要,但现有基于检索的方法依赖检索质量,在长期交互中表现下降。模型编辑通过直接修改内部参数引入新知识,在事实性知识编辑任务中表现良好,或可为个性化提供解决方案。然而将模型编辑扩展至个性化面临挑战:大量用户数据导致计算成本高且编辑间相互干扰。为此,我们提出PersonaEdit,一种基于隐藏表示聚类的代表性样本选择策略,采用比例分层抽样筛选关键编辑样本。实验表明,模型编辑对个性化有效,且该策略在显著减少所需编辑样本数的同时保持大部分性能。此外,结合模型编辑与检索增强提示可进一步提升个性化效果,因编辑知识与检索上下文互补。结果表明,模型编辑是高效、可扩展的大模型个性化方法。

原文摘要 · Abstract (English)

Personalization has attracted growing interest in LLM applications, yet existing retrieval-based approaches depend heavily on retrieval quality and degrade in long-term interactions. Model editing, which directly modifies internal model parameters to incorporate new knowledge, has demonstrated effective knowledge modification capabilities in factual knowledge editing tasks and may provide a potential solution for personalization. However, scaling model editing to personalization is non-trivial. Editing large amounts of user data increases computational cost and causes interference among edits, motivating the need for effective sample selection. To address this issue, we propose, PersonaEdit, a hidden representation clustering strategy that selects representative editing samples through proportional stratified sampling. Experiments show that model editing is effective for personalization, and that our selection strategy preserves most of the performance while substantially reducing the number of required editing samples. Beyond standalone editing, we find that combining model editing with retrieval-based prompt augmentation further improves personalization, as edited knowledge and retrieved context provide complementary information. These results demonstrate the potential of model editing as an efficient and scalable approach for LLM personalization.

大模型个性化模型编辑样本选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。