arXiv:2601.18457cs.IR2026-01被引 3

让大模型生成推荐时,能直接用用户行为数据精准调控内容。

Token-level Collaborative Alignment for LLM-based Generative Recommendation

  • 将用户行为信号转为令牌级分布,与大模型训练对齐。
  • 在多个推荐场景下提升准确率,且生成内容更可控。
  • 适配任意传统推荐模型和大模型架构,即插即用。

大语言模型在生成式推荐中展现出强大潜力,但现有方法难以有效融合协同过滤(CF)信号,因CF以物品级偏好建模,而大模型优化目标是令牌级下一令牌预测(NTP),二者存在根本性不匹配。以往方法将CF视为上下文提示或表征偏置,依赖多阶段训练缓解行为语义空间差异,导致CF无法显式调控生成过程。本文提出一种模型无关、即插即用的框架TCA4Rec,建立CF监督与大模型生成间的显式优化接口。TCA4Rec包含:(i) 协同分词器,将原始物品级CF logits映射至与大模型令牌空间对齐的令牌级分布;(ii) 软标签对齐,将这些受CF启发的分布与one-hot监督结合,优化软化后的下一令牌预测目标。该设计在保持大模型生成能力的同时,实现与用户偏好强关联的协同对齐。TCA4Rec兼容任意传统CF模型,并可泛化至多种基于解码器的大模型推荐架构。此外,它提供显式机制平衡行为对齐与语义流畅性,生成推荐兼具准确性与可控性。大量实验表明,TCA4Rec在多种CF模型与大模型推荐系统中持续提升性能。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong potential for generative recommendation by leveraging rich semantic knowledge. However, existing LLM-based recommender systems struggle to effectively incorporate collaborative filtering (CF) signals, due to a fundamental mismatch between item-level preference modeling in CF and token-level next-token prediction (NTP) optimization in LLMs. Prior approaches typically treat CF as contextual hints or representation bias, and resort to multi-stage training to reduce behavioral semantic space discrepancies, leaving CF unable to explicitly regulate LLM generation. In this work, we propose Token-level Collaborative Alignment for Recommendation (TCA4Rec), a model-agnostic and plug-and-play framework that establishes an explicit optimization-level interface between CF supervision and LLM generation. TCA4Rec consists of (i) Collaborative Tokenizer, which projects raw item-level CF logits into token-level distributions aligned with the LLM token space, and (ii) Soft Label Alignment, which integrates these CF-informed distributions with one-hot supervision to optimize a soft NTP objective. This design preserves the generative nature of LLM training while enabling collaborative alignment with essential user preference of CF models. We highlight TCA4Rec is compatible with arbitrary traditional CF models and generalizes across a wide range of decoder-based LLM recommender architectures. Moreover, it provides an explicit mechanism to balance behavioral alignment and semantic fluency, yielding generative recommendations that are both accurate and controllable. Extensive experiments demonstrate that TCA4Rec consistently improves recommendation performance across a broad spectrum of CF models and LLM-based recommender systems.

生成推荐协同过滤大模型对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。