用小模型+低秩适配器模拟用户行为,更高效准确。
Personas within Parameters: Fine-Tuning Small Language Models with Low-Rank Adapters to Mimic User Behaviors
- 用冻结大模型提取用户文本特征,再微调小模型生成行为。
- 多组用户用低秩适配器建模,支持百万级用户扩展。
- 在离线指标与真实表现间建立桥梁,适合推荐系统优化。
推荐系统长期面临用户行为模拟难题,主要源于用户交互的复杂性和随机性。现有方法多依赖大语言模型(LLM)进行行为模拟,但需持续处理大规模表格型用户-物品交互数据,克服预训练带来的归纳偏置,并实现对数百万用户的可扩展学习。本文提出新思路:利用冻结的LLM提取鲁棒的用户文本表征,再通过微调小型语言模型(SLM)构建低成本、高效率的用户代理。进一步提出为用户群体(即“人格”)训练多个低秩适配器的方法,在可扩展性与性能间取得平衡。实验表明,该方法显著提升推荐系统在离线指标与真实场景表现之间的对齐度。
原文摘要 · Abstract (English)
A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large Language Models (LLMs) for simulating user behavior. However, aligning these general-purpose large pre-trained models with user preferences necessitates: (i) effectively and continously parsing large-scale tabular user-item interaction data, (ii) overcoming pre-training-induced inductive biases to accurately learn user specific knowledge, and (iii) achieving the former two at scale for millions of users. While most previous works have focused on complex methods to prompt an LLM or fine-tune it on tabular interaction datasets, our approach shifts the focus to extracting robust textual user representations using a frozen LLM and simulating cost-effective, resource-efficient user agents powered by fine-tuned Small Language Models (SLMs). Further, we showcase a method for training multiple low-rank adapters for groups of users or \textit{persona}, striking an optimal balance between scalability and performance of user behavior agents. Our experiments provide compelling empirical evidence of the efficacy of our methods, demonstrating that user agents developed using our approach have the potential to bridge the gap between offline metrics and real-world performance of recommender systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。