用图模型个性化路由大模型,少样本也能精准匹配用户偏好。
GMTRouter: Personalized LLM Router over Multi-turn User Interactions
- 将多轮对话建模为异构图,融合用户、模型、问题和回复四类节点。
- 在多个数据集上准确率提升0.9%至21.6%,AUC提升0.006至0.309。
- 仅需少量数据即可适应新用户或变化偏好,无需大量微调。
大语言模型路由在平衡响应质量与计算成本方面表现出色。由于用户偏好各异,个性化路由日益受到关注,因为相同问题可能需要不同模型生成符合个人需求的回复。然而,现有方法个性化程度不足,难以捕捉用户与模型间复杂互动关系。此外,用户偏好数据通常稀疏、嘈杂且格式不一,限制了依赖用户特定数据的方法效果。为此,我们提出GMTRouter,将多轮用户-大模型交互表示为包含用户、大模型、查询和回复四类节点的异构图,以保留丰富的关系结构。通过定制的消息传递机制,GMTRouter在轻量级归纳图学习框架内从少样本数据中学习用户偏好,实现有效个性化。大量实验表明,GMTRouter持续优于强基线,在多个数据集上准确率提升0.9%至21.6%,AUC提升0.006至0.309。更重要的是,我们证明其可仅用少样本数据适应新用户及演化中的偏好,无需大量微调。GMTRouter代码已公开于https://github.com/ulab-uiuc/GMTRouter。
原文摘要 · Abstract (English)
Large Language Model (LLM) routing has demonstrated strong capability in balancing response quality with computational cost. As users exhibit diverse preferences, personalization has attracted increasing attention in LLM routing, since even identical queries may require different models to generate responses tailored to individual needs. However, existing approaches are not fully personalized and often fail to capture the complex interactions between specific users and LLMs. Moreover, user preference data is typically scarce, noisy, and inconsistent in format, which limits the effectiveness of methods that rely solely on user-specific data. To address these challenges, we propose GMTRouter, which represents multi-turn user-LLM interactions as a heterogeneous graph with four node types: user, LLM, query, and response, thereby preserving the rich relational structure of the interaction. Through a tailored message-passing mechanism, GMTRouter learns to capture user preferences from few-shot data within a lightweight inductive graph learning framework, enabling effective personalization. Extensive experiments demonstrate that GMTRouter consistently outperforms strong baselines, achieving 0.9 to 21.6 percent higher accuracy and 0.006 to 0.309 higher AUC across multiple datasets. More importantly, we demonstrate that GMTRouter can adapt to new users and evolving preferences using only few-shot data, without extensive fine-tuning. The code for GMTRouter is publicly available at https://github.com/ulab-uiuc/GMTRouter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。