让推荐系统像人一样深思熟虑,提升精准度与适应性。
STARec: An Efficient Agent Framework for Recommender Systems via Autonomous Deliberate Reasoning
- 采用快慢双思维模式,慢思考生成推理链提升决策质量。
- 仅用0.4%数据训练,性能超越主流基线模型。
- 适合追求高可靠推荐、重视可解释性的工业场景。
当前推荐系统受限于静态用户建模和被动响应机制,基于大语言模型的智能体仍依赖启发式匹配,导致推荐结果易受浅层相关性偏差影响,缺乏因果推理能力,且在稀疏数据下表现脆弱。我们提出STARec,一种通过自主深思推理增强的高效推荐智能体框架。每个用户被建模为具有并行认知能力的智能体:快速响应即时交互,慢速推理则执行链式思考推导。为培养内在慢思考能力,我们设计了锚定强化训练——结合先进推理模型的知识蒸馏与偏好对齐的奖励塑造。该混合方法帮助智能体习得基础能力(偏好总结、理由生成),并通过模拟反馈环实现动态策略调整。在MovieLens 1M和Amazon CDs数据集上的实验表明,尽管仅使用0.4%的全量训练数据,STARec仍显著优于现有最先进基线模型。
原文摘要 · Abstract (English)
While modern recommender systems are instrumental in navigating information abundance, they remain fundamentally limited by static user modeling and reactive decision-making paradigms. Current large language model (LLM)-based agents inherit these shortcomings through their overreliance on heuristic pattern matching, yielding recommendations prone to shallow correlation bias, limited causal inference, and brittleness in sparse-data scenarios. We introduce STARec, a slow-thinking augmented agent framework that endows recommender systems with autonomous deliberative reasoning capabilities. Each user is modeled as an agent with parallel cognitions: fast response for immediate interactions and slow reasoning that performs chain-of-thought rationales. To cultivate intrinsic slow thinking, we develop anchored reinforcement training - a two-stage paradigm combining structured knowledge distillation from advanced reasoning models with preference-aligned reward shaping. This hybrid approach scaffolds agents in acquiring foundational capabilities (preference summarization, rationale generation) while enabling dynamic policy adaptation through simulated feedback loops. Experiments on MovieLens 1M and Amazon CDs benchmarks demonstrate that STARec achieves substantial performance gains compared with state-of-the-art baselines, despite using only 0.4% of the full training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。