用快慢思维融合模型,实现电商推荐的精准推理与多场景复用。
OxygenREC: An Instruction-Following Generative Framework for E-commerce Recommendation
- 采用快慢思维架构:慢速用大模型生成推理指令,快速用轻量模型实时推荐。
- 通过语义对齐和查询-商品一致性损失,提升指令对推荐结果的引导效果。
- 将不同场景转为可控指令,支持一次训练多场景部署,降低维护成本。
传统推荐系统在多阶段优化目标上存在不一致问题。生成式推荐(GR)虽以端到端框架缓解此问题,但现有方法仍依赖归纳式匹配机制,难以挖掘需基于世界知识进行演绎推理的复杂用户意图。尽管大语言模型(LLM)具备强大深度推理能力,其延迟与计算开销限制了工业应用。更关键的是,多场景可扩展性存在瓶颈:如图1所示,现有方案需为每种场景独立训练与部署,导致资源利用率低、维护成本高,该问题在GR文献中尚未解决。为此,我们提出OxygenREC,一个基于快慢思维的工业级推荐系统,兼顾深度推理、严格延迟要求与多场景适应性。首先,采用快慢思维架构:慢思考使用近线大模型流水线生成上下文推理指令,快思考则利用高效编码器-解码器骨干网络实现实时生成。其次,为确保推理指令有效提升推荐质量,引入语义对齐机制,结合指令引导检索(IGR)筛选相关历史行为,并采用查询-物品(Q2I)损失保证指令与推荐物品的一致性。最后,为解决多场景可扩展性问题,将场景信息转化为可控指令,通过统一奖励映射与软自适应组裁剪策略优化(SA-GCPO),使策略适配多样化业务目标,实现‘训练一次、处处部署’的范式。
原文摘要 · Abstract (English)
Traditional recommendation systems suffer from inconsistency in multi-stage optimization objectives. Generative Recommendation (GR) mitigates them through an end-to-end framework; however, existing methods still rely on matching mechanisms based on inductive patterns. Although responsive, they lack the ability to uncover complex user intents that require deductive reasoning based on world knowledge. Meanwhile, LLMs show strong deep reasoning capabilities, but their latency and computational costs remain challenging for industrial applications. More critically, there are performance bottlenecks in multi-scenario scalability: as shown in Figure 1, existing solutions require independent training and deployment for each scenario, leading to low resource utilization and high maintenance costs-a challenge unaddressed in GR literature. To address these, we present OxygenREC, an industrial recommendation system that leverages Fast-Slow Thinking to deliver deep reasoning with strict latency and multi-scenario requirements of real-world environments. First, we adopt a Fast-Slow Thinking architecture. Slow thinking uses a near-line LLM pipeline to synthesize Contextual Reasoning Instructions, while fast thinking employs a high-efficiency encoder-decoder backbone for real-time generation. Second, to ensure reasoning instructions effectively enhance recommendation generation, we introduce a semantic alignment mechanism with Instruction-Guided Retrieval (IGR) to filter intent-relevant historical behaviors and use a Query-to-Item (Q2I) loss for instruction-item consistency. Finally, to resolve multi-scenario scalability, we transform scenario information into controllable instructions, using unified reward mapping and Soft Adaptive Group Clip Policy Optimization (SA-GCPO) to align policies with diverse business objectives, realizing a train-once-deploy-everywhere paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。