arXiv:2608.09605cs.IRcs.AI2026-08

用偏好优化选关键词,让大模型推荐更准更快

TSPORec: Token Selection via Preference Optimization for LLM-Based Sequential Recommendation

  • 通过三阶段流程选关键文本片段,精准定位有用信息
  • 性能提升最高达31.25%,推理效率提高最多63.4%
  • 适合追求高效高精度推荐系统的开发者

大语言模型(LLM)在推荐系统中展现出强大潜力,能利用丰富文本信息并建模用户多样化偏好。然而,由于模型规模庞大,基于LLM的序列推荐通常带来高昂的推理开销,导致投入产出比低。现有方法常仅使用商品描述的前几个词,无意中丢弃了全文有价值信息,影响推荐效果。为此,我们提出一种面向推荐的偏好优化式标记选择方法(TSPORec),可准确识别完整文本中的关键信息片段,从而提升推荐性能。具体地,设计了三阶段流程并引入新型代理奖励函数以支持实现。实验表明,该方法在两个模型和数据集上均显著优于六种基线方法,性能最高提升31.25%,计算效率最高提升63.4%。代码已开源。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have emerged as powerful tools for improving recommendation systems. The effectiveness of LLMs arises from their ability to harness rich textual information and their capacity to model heterogeneous user preferences based on users' interaction history. However, due to the large-scale and deep architectures, LLM-based sequential recommendation approaches generally incur high inference costs, resulting in a low return on investment. To mitigate this cost, many existing approaches resort to using only the first few tokens of item descriptions, which inadvertently discards valuable information contained in the full text, thereby leading to suboptimal recommendation performance. To address this limitation, we propose a novel Token Selection approach for Preference Optimization in LLM-based sequential Recommendation, i.e., TSPORec, which accurately pinpoints informative tokens throughout the entire textual content to improve recommendation performance. Specifically, we design a three-stage pipeline to select informative tokens and introduce a novel proxy reward to facilitate the implementation. TSPORec not only enhances recommendation performance but also improves computational efficiency. Extensive experiments across two models and datasets demonstrate the superb performance (up to 31.25%) and efficiency (up to 63.4%) of our approach compared with six baseline approaches. Code is available at https://github.com/WNQzhu/TSPORec.git.

大模型推荐文本选择效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。