arXiv:2508.15388cs.IR2025-08被引 10

用双向反馈让大模型更准地推理用户偏好,提升推荐效果。

TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendation

  • 通过生成与验证交替优化,让模型逐步产出更符合用户偏好的推理链条。
  • 在真实广告平台测试中,推荐效果显著优于现有方法。
  • 适合关注大模型可解释推荐与工业级落地的工程师和研究者。

大型语言模型(LLM)的强大世界知识和推理能力正受到推荐系统(RS)领域的广泛关注。链式思维(CoT)已被证明能提升LLM在复杂推理任务中的表现。然而,由于LLM常出现幻觉问题,其生成的推理过程未必有效。如何通过有效的链式思维增强推荐能力成为关键挑战。为此,我们提出TrackRec框架,旨在通过基于偏好对齐的链式思维推理(RecCoT)精准捕捉用户偏好。RecCoT既可作为推荐任务完成的解释,也可作为辅助特征支持推荐模型。TrackRec由一个RecCoT生成器(G)和一个验证器(V)构成,设计了交替反馈学习机制:G通过V的反馈进行直接偏好优化,生成更符合标准的RecCoT;同时,V利用G的推理反馈进行微调,以增强其验证能力。二者通过迭代交替学习,持续提升生成与验证性能。大量实验表明该方法优于当前最优方案。此外,TrackRec已在包含数亿用户的大型广告平台部署,取得显著收益。

原文摘要 · Abstract (English)

The extensive world knowledge and powerful reasoning capabilities of large language models (LLMs) have attracted significant attention in recommendation systems (RS). Specifically, The chain of thought (CoT) has been shown to improve the performance of LLMs on complex reasoning tasks for RS. However, due to the fact that LLMs often suffer from hallucination issues, there is no guarantee that their reasoning CoT is effective. A key challenge is to further enhance the recommendation capabilities of LLMs through effective CoT reasonings. Therefore, we propose \textbf{TrackRec}, a framework designed to enhance reasoning capabilities of LLMs for RS. TrackRec specifically focuses on accurately inferring recommendation CoT \textbf{(RecCoT)} for user preference using the knowledge from LLMs. This RecCoT can serve both as an explanation for the LLM's completion of recommendation tasks and as auxiliary features to assist recommendation models in accomplishing recommendation tasks. TrackRec consists of a RecCoT generator $(G)$ and a RecCoT validator $(V)$. Furthermore, we design alternating feedback learning mechanism that $G$ undergoes direct preference optimization via feedback from $V$ to produce increasingly accurate RecCoT aligned with $V$'s standards. Meanwhile, $V$ is fine-tuned using the inference feedback from $G$ to enhance its validation capabilities in alignment with recommendation tasks. Through iterative alternating feedback learning between $G$ and $V$, TrackRec continuously improves the user preference analysis capability of $G$ and the validation capacity of $V$. Extensive experiments demonstrate the effectiveness of our approach, showing that it surpasses state-of-the-art methods. Moreover, TrackRec has been deployed on a lagre advertising platform with hundreds of millions of users, achieving substantial gains.

推荐系统大模型链式思维双循环优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。