arXiv:2411.00027cs.CL2024-11中稿 · the Transactions o…综述被引 132

系统梳理大模型个性化研究,统一分类框架。

Personalization of Large Language Models: A Survey

  • 提出个性化大模型的系统分类体系
  • 涵盖个性化粒度、技术、评估等五类标准
  • 适合研究者快速掌握该领域全貌

大语言模型(LLMs)的个性化近年来日益重要,应用广泛。尽管已有进展,现有工作多集中于个性化文本生成或利用大模型进行推荐等下游应用,两者分离。本文首次弥合这一鸿沟,提出个性化大模型使用分类体系,厘清关键差异与挑战。通过形式化定义个性化基础,拓展了个性化、使用方式及理想特性等新维度。进一步构建了针对个性化粒度、技术、数据集、评估方法和应用场景的系统性分类。最后,指出现有挑战与未解决问题。通过整合并基于新分类体系综述近期研究,旨在为研究人员与实践者提供清晰的文献指引,全面理解大模型个性化各面向。

原文摘要 · Abstract (English)

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely on (a) personalized text generation or (b) leveraging LLMs for personalization-related downstream applications, such as recommendation systems. In this work, we bridge the gap between these two separate main directions for the first time by introducing a taxonomy for personalized LLM usage and summarizing the key differences and challenges. We provide a formalization of the foundations of personalized LLMs that consolidates and expands notions of personalization of LLMs, defining and discussing novel facets of personalization, usage, and desiderata of personalized LLMs. We then unify the literature across these diverse fields and usage scenarios by proposing systematic taxonomies for the granularity of personalization, personalization techniques, datasets, evaluation methods, and applications of personalized LLMs. Finally, we highlight challenges and important open problems that remain to be addressed. By unifying and surveying recent research using the proposed taxonomies, we aim to provide a clear guide to the existing literature and different facets of personalization in LLMs, empowering both researchers and practitioners.

大模型个性化综述分类体系

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。