通过深度循环隐式推理提升推荐系统表现
LARES: Latent Reasoning for Sequential Recommendation
- 采用递归架构实现无参数增加的深层推理
- 在多个真实数据集上显著优于现有方法
- 适合需要高精度动态兴趣建模的推荐场景
序列推荐系统在建模用户行为序列以预测偏好方面日益重要。然而,现有方法多依赖非推理范式,限制了模型计算能力并导致推荐性能不佳。为此,我们提出LARES——一种新型可扩展的隐式推理框架,通过深度递归隐式推理提高参数计算密度,增强模型表征能力。该方法采用递归结构,在不增加参数复杂度的前提下灵活扩展推理深度,有效捕捉动态复杂的用户兴趣模式。关键创新在于每轮隐式推理步骤中对所有输入标记进行精炼,提升计算利用率。为充分释放模型推理潜力,设计两阶段训练策略:(1) 带双重对齐目标的自监督预训练;(2) 强化学习后训练。第一阶段引入轨迹级与步级对齐目标,使模型在无需额外标注数据下学习面向推荐的隐式推理模式。第二阶段利用强化学习激发模型探索能力,进一步优化推理能力。在真实世界基准上的全面实验表明,LARES表现优异,并能无缝兼容现有先进模型,进一步提升其推荐性能。代码已公开于https://anonymous.4open.science/r/LARES-E458/。
原文摘要 · Abstract (English)
Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on non-reasoning paradigms, which may limit the model's computational capacity and result in suboptimal recommendation performance. To address these limitations, we present LARES, a novel and scalable LAtent REasoning framework for Sequential recommendation that enhances model's representation capabilities through increasing the computation density of parameters by depth-recurrent latent reasoning. Our proposed approach employs a recurrent architecture that allows flexible expansion of reasoning depth without increasing parameter complexity, thereby effectively capturing dynamic and intricate user interest patterns. A key difference of LARES lies in refining all input tokens at each implicit reasoning step to improve the computation utilization. To fully unlock the model's reasoning potential, we design a two-phase training strategy: (1) Self-supervised pre-training (SPT) with dual alignment objectives; (2) Reinforcement post-training (RPT). During the first phase, we introduce trajectory-level alignment and step-level alignment objectives, which enable the model to learn recommendation-oriented latent reasoning patterns without requiring supplementary annotated data. The subsequent phase utilizes reinforcement learning (RL) to harness the model's exploratory ability, further refining its reasoning capabilities. Comprehensive experiments on real-world benchmarks demonstrate our framework's superior performance. Notably, LARES exhibits seamless compatibility with existing advanced models, further improving their recommendation performance. Our code is available at https://anonymous.4open.science/r/LARES-E458/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。