根据用户行为动态选择快慢推理,提升推荐精度与效率
TwiSTAR:Think Fast, Think Slow, Then Act,Generative Recommendation with Adaptive Reasoning

- 用快检索、轻排序、慢推理三工具自适应分配计算资源
- 在三个数据集上准确率超越基线,推理延迟降低40%以上
- 适合对实时性与推荐质量都有要求的场景
基于语义ID(SIDs)的生成式推荐成为新范式,但现有方法对所有用户历史采用固定推理策略:要么快速直接生成,要么缓慢链式思考,造成两难:快速模型在困难样本上精度不足,始终使用慢推理则导致高延迟且浪费算力。为此,我们提出TwiSTAR框架,实现按用户序列动态分配推理强度。系统为大语言模型配备三种互补工具:基于SID的快速检索器、轻量级候选排序器,以及生成显式推理过程的慢速推理模型。关键创新在于将物品间知识转化为自然语言解释,注入协同常识。通过监督预热后结合智能体强化学习训练的规划器,动态决定调用哪个工具。三组实验表明,该方法在保持高精度的同时,相比统一慢推理显著降低推理延迟。
原文摘要 · Abstract (English)
Generative recommendation with Semantic IDs (SIDs) has emerged as a promising paradigm, yet existing methods apply a fixed inference strategy, either fast direct generation or slow chain-of-thought reasoning, uniformly across all user histories. This approach creates a trade-off: fast recommendation model produces suboptimal accuracy on hard samples, while always invoking slow reasoning incurs prohibitive latency and wastes computation on easy cases. To address this, we propose Think Fast, Think Slow, Then Act, a framework that learns to adaptively allocate reasoning effort per user sequence. Our system equips an LLM with three complementary tools: a fast SID-based retriever, a lightweight candidate ranker, and a slow reasoning model that generates explicit rationales before recommending. Crucially, we inject collaborative commonsense into the slow model by transforming item-to-item knowledge into natural language explanations. A planner, trained through supervised warm-up followed by agentic reinforcement learning, dynamically decides which tool to invoke. Experiments on three datasets demonstrate that our method outperforms strong baselines, achieving consistent accuracy gains while reducing inference latency compared to uniform slow reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。