基于用户交互数据,用图模型实现个性化大模型选择。
PersonalizedRouter: Personalized LLM Routing via Graph-based User Preference Modeling
- 构建异构图捕捉用户查询与最优模型间上下文关系。
- 在1000名模拟用户上比现有方法最高提升59.69%。
- 仅需少量数据即可适应新用户和新模型,效果接近全训练。
随着具备不同能力与响应风格的大语言模型数量增加,用户面临如何选择合适模型的挑战,因个体偏好在性能、成本和风格上存在差异。现有方法通常优化单一目标(如性能或成本),无法从交互数据中学习个性化偏好。为此,我们提出 PersonalizedRouter,一个基于图的框架,通过包含任务上下文、查询、候选模型及用户决策的交互数据建模多样化的用户画像,并实现个性化模型选择。该框架将交互数据转化为异构图,用边表示不同类型节点间的关联。为评估跨用户适应性,设计了多成本效率模拟策略和模型即裁判策略。此外,构建 PersonaRoute-Bench 基准,包含1000名模拟用户和10个大模型。实验表明,PersonalizedRouter 显著优于现有方法,在两种模拟策略下分别领先15.38%和9.83%;在1000用户基准上进一步超越最佳方法16.19%和59.69%,同时保持更高效率。此外,其具备强少样本泛化能力,对新用户和新模型的适应性能达到全训练模型的64.81%和85.80%。
原文摘要 · Abstract (English)
The growing number of Large Language Models (LLMs) with diverse capabilities and response styles provides users with a wider range of choices, which presents challenges in selecting appropriate LLMs, as user preferences vary in terms of performance, cost, and response style. Current LLM selection methods typically optimize for a single fixed objective, such as performance, cost, or a trade-off between them, and fail to learn individual user preferences from interaction data. To address these limitations, we propose PersonalizedRouter, a graph-based framework that models diverse user profiles and performs personalized LLM selection by leveraging interaction data that includes task context, queries, candidate LLMs, and user decisions. To capture contextual information between user queries and optimal LLMs, PersonalizedRouter converts the interaction data into a heterogeneous graph, where the relationships between different types of nodes are represented by edges. To evaluate adaptability across users, we design two strategies: the multi-cost-efficiency simulation strategy and the LLM-as-a-Judge strategy. In addition, we construct PersonaRoute-Bench, a large-scale benchmark with 1,000 simulated users and 10 LLMs. Experimental results show that PersonalizedRouter significantly outperforms existing LLM selection methods and surpasses the strongest methods by a large margin of 15.38% and 9.83% under two simulation strategies. On the PersonaRoute-Bench with 1,000 users, it further surpasses the best methods by 16.19% and 59.69% while maintaining higher efficiency. Moreover, PersonalizedRouter demonstrates strong few-shot generalization, achieving 64.81% and 85.80% of the fully trained model's performance when adapting to new users and new LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。