将大模型的上下文工程与多步推理引入工业级推荐系统,提升搜索转化效果。
OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System

- 用结构化上下文增强用户历史行为,统一输入到检索与排序模块。
- 通过分块潜空间推理实现多步优化,支持可扩展的推理能力。
- 利用用户反馈链训练多阶段推理,适合高精度推荐场景落地。
尽管大型语言模型(LLMs)在工业搜索与推荐系统中的规模化成功备受关注,但现有实践大多仅移植Transformer架构,对深度学习推荐模型(DLRMs)的改进有限。从基础原理看,LLMs的突破不仅源于其架构,更依赖两种互补机制:上下文工程(丰富原始查询的上下文线索以激发模型能力)与多步推理(通过中间推理路径迭代优化输出)。然而这些机制在工业排序系统中尚未被充分探索。本文提出OnePiece,一个统一框架,将大模型风格的上下文工程与推理无缝集成至工业级级联式排序管道的检索与排序模型中。OnePiece基于纯Transformer架构,引入三项关键创新:(1) 结构化上下文工程,将偏好与场景信号融合进交互历史,并统一为结构化标记序列用于检索与排序;(2) 分块潜空间推理,赋予模型多步表示精炼能力,通过调整块大小控制推理带宽;(3) 渐进式多任务训练,利用用户反馈链监督训练过程中的推理步骤。OnePiece已部署于Shopee主个性化搜索场景,在多个核心业务指标上实现持续线上收益,包括超过+2%的GMV/UU增长及广告收入+2.90%的提升。
原文摘要 · Abstract (English)
Despite the growing interest in replicating the scaled success of large language models (LLMs) in industrial search and recommender systems, most existing industrial efforts remain limited to transplanting Transformer architectures, which bring only incremental improvements over strong Deep Learning Recommendation Models (DLRMs). From a first principle perspective, the breakthroughs of LLMs stem not only from their architectures but also from two complementary mechanisms: context engineering, which enriches raw input queries with contextual cues to better elicit model capabilities, and multi-step reasoning, which iteratively refines model outputs through intermediate reasoning paths. However, these two mechanisms and their potential to unlock substantial improvements remain largely underexplored in industrial ranking systems. In this paper, we propose OnePiece, a unified framework that seamlessly integrates LLM-style context engineering and reasoning into both retrieval and ranking models of industrial cascaded pipelines. OnePiece is built on a pure Transformer backbone and further introduces three key innovations: (1) structured context engineering, which augments interaction history with preference and scenario signals and unifies them into a structured tokenized input sequence for both retrieval and ranking; (2) block-wise latent reasoning, which equips the model with multi-step refinement of representations and scales reasoning bandwidth via block size; (3) progressive multi-task training, which leverages user feedback chains to effectively supervise reasoning steps during training. OnePiece has been deployed in the main personalized search scenario of Shopee and achieves consistent online gains across different key business metrics, including over $+2\%$ GMV/UU and a $+2.90\%$ increase in advertising revenue.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。