arXiv:2409.11901cs.CL2024-09ACL被引 34

用用户嵌入让大模型更懂个人偏好,不需微调也能个性化输出。

LLMs + Persona-Plug = Personalized LLMs

  • 通过轻量级嵌入模块建模用户全部历史上下文,生成专属用户向量。
  • 在LaMP基准上显著优于现有方法,实现更高个性化性能。
  • 无需参数微调,适合快速部署到实际应用中。

个性化在诸多语言任务中至关重要,因为相同需求的用户可能因兴趣不同而偏好各异的输出。为此,研究者提出了多种个性化方法,将大语言模型(LLMs)适配为符合用户偏好的定制化输出。部分方法为每个用户微调独立的个性化模型,但成本过高难以普及;另一些方法通过检索用户历史文本作为示范进行个性化,但可能破坏历史连续性,难以捕捉整体风格模式,导致性能不佳。为此,我们提出新型个性化大模型PPlug:通过轻量级插件式用户嵌入模块,对每位用户的全部历史上下文建模,生成其专属嵌入表示,并将其附加至任务输入,使大模型能更好地理解用户习惯与偏好,从而生成更个性化的输出,且无需调整自身参数。在语言模型个性化(LaMP)基准上的大量实验表明,该模型显著优于现有个性化大模型方法。

原文摘要 · Abstract (English)

Personalization plays a critical role in numerous language tasks and applications, since users with the same requirements may prefer diverse outputs based on their individual interests. This has led to the development of various personalized approaches aimed at adapting large language models (LLMs) to generate customized outputs aligned with user preferences. Some of them involve fine-tuning a unique personalized LLM for each user, which is too expensive for widespread application. Alternative approaches introduce personalization information in a plug-and-play manner by retrieving the user's relevant historical texts as demonstrations. However, this retrieval-based strategy may break the continuity of the user history and fail to capture the user's overall styles and patterns, hence leading to sub-optimal performance. To address these challenges, we propose a novel personalized LLM model, PPlug. It constructs a user-specific embedding for each individual by modeling all her historical contexts through a lightweight plug-in user embedder module. By attaching this embedding to the task input, LLMs can better understand and capture user habits and preferences, thereby producing more personalized outputs without tuning their own parameters. Extensive experiments on various tasks in the language model personalization (LaMP) benchmark demonstrate that the proposed model significantly outperforms existing personalized LLM approaches.

个性化大模型嵌入零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。