arXiv:2510.13738cs.IR2025-10被引 9

用轻量模型+大模型结合,更好捕捉用户多样长期兴趣。

HyMiRec: A Hybrid Multi-interest Learning Framework for LLM-based Sequential Recommendation

  • 先用轻量模型提取长序列粗粒度兴趣,再由大模型细化。
  • 在工业数据集上点击率提升3.8%,优于现有方法。
  • 适合需要兼顾效率与推荐多样性的实际系统使用。

大型语言模型(LLMs)在序列推荐中展现出强大潜力,但现有方法在建模用户长期、多元兴趣方面存在明显不足。一方面,受限于推理延迟和特征获取带宽,现有方法通常截断用户行为序列,仅保留最近交互,导致长程偏好信号丢失;另一方面,多数方法依赖单个预测嵌入的下一步物品预测,忽视用户兴趣的多面性,限制了推荐多样性。为此,我们提出HyMiRec,一种混合多兴趣序列推荐框架,通过轻量推荐器从长用户序列中提取粗粒度兴趣嵌入,并由基于LLM的推荐器捕获精细化兴趣嵌入。为降低特征获取开销,引入基于余弦相似度的残差码本,实现用户历史嵌入的高效压缩与复用。为建模用户多样化偏好,设计解耦多兴趣学习模块,利用多个兴趣查询自适应地学习分离的兴趣信号,从而捕捉用户意图的不同方面。在基准数据集和收集的工业数据集上进行了大量实验,结果表明该方法在效果上优于现有最先进方法。此外,线上A/B测试显示HyMiRec在真实推荐系统中带来持续性能提升。代码已开源:https://github.com/FireRedTeam/FireRedSeqRec。

原文摘要 · Abstract (English)

Large language models (LLMs) have recently demonstrated strong potential for sequential recommendation. However, current LLM-based approaches face critical limitations in modeling users' long-term and diverse interests. First, due to inference latency and feature fetching bandwidth constraints, existing methods typically truncate user behavior sequences to include only the most recent interactions, resulting in the loss of valuable long-range preference signals. Second, most current methods rely on next-item prediction with a single predicted embedding, overlooking the multifaceted nature of user interests and limiting recommendation diversity. To address these challenges, we propose HyMiRec, a hybrid multi-interest sequential recommendation framework, which leverages a lightweight recommender to extracts coarse interest embeddings from long user sequences and an LLM-based recommender to captures refined interest embeddings. To alleviate the overhead of fetching features, we introduce a residual codebook based on cosine similarity, enabling efficient compression and reuse of user history embeddings. To model the diverse preferences of users, we design a disentangled multi-interest learning module, which leverages multiple interest queries to learn disentangles multiple interest signals adaptively, allowing the model to capture different facets of user intent. Extensive experiments are conducted on both benchmark datasets and a collected industrial dataset, demonstrating our effectiveness over existing state-of-the-art methods. Furthermore, online A/B testing shows that HyMiRec brings consistent improvements in real-world recommendation systems. Code is available at https://github.com/FireRedTeam/FireRedSeqRec.

序列推荐多兴趣大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。