用配置化框架解耦特征与模型,提升搜索推荐系统迭代与部署效率。
Prompt Generation Technical Report

- 通过声明式JSON配置文件分离特征处理与模型架构,实现统一管理。
- 在淘宝搜索上实现交易量+0.47%、GMV+0.51%的显著线上提升。
- 支持快速实验、跨场景复用,适合工业级生成式检索系统的迭代需求。
生成式检索已成为工业搜索、推荐与广告系统中日益普及的范式,带来显著的在线收益。现有方法通常结合用户行为序列与大语言模型(LLMs)来建模用户偏好。实践中,特征工程对模型效果至关重要,但其复杂性导致离线迭代缓慢,线上部署沉重且难以复用,受限于严格的在线延迟预算。根本原因在于特征处理逻辑与模型架构紧密耦合,每次特征变更都需修改训练与服务代码,阻碍跨场景复用。为打破此耦合,我们提出提示生成(Prompt Generation, PG),一种基于高阶分词器与配置驱动的框架,通过两个声明式JSON文件将特征处理逻辑与模型架构解耦,作为离线训练与线上服务的单一事实来源,确保两阶段特征一致性。该框架将特征分为四类,使用三种可组合的处理组件对异构特征进行组装与压缩,实现三层次加速:(1) 快速训练迭代:特征实验仅需修改配置,内置令牌压缩支持超长序列;(2) 快速部署:新场景只需符合PG schema并接入通用流水线,无需场景专属工程;(3) 快速在线推理:引擎对标准化配置应用统一优化,使PG开销降至可忽略水平。PG已在淘宝搜索上线,带来统计显著的线上A/B测试提升:交易量+0.47%,GMV+0.51%,并被多个淘宝搜索与推荐团队采纳为生成式检索的迭代框架。
原文摘要 · Abstract (English)
Generative retrieval has become an increasingly adopted paradigm for industrial search, recommendation, and advertising systems, delivering significant online gains. Most existing work combines user behavior sequences with large language models (LLMs) to model user preferences. In practice, feature engineering remains critical to model effectiveness, yet its complexity slows offline iteration and makes online deployment heavy and hard to reuse, all under tight online latency budgets. The root cause is a tight coupling between feature-processing logic and model architecture, where every feature change touches the training and serving code and resists reuse across scenarios. To break this coupling, we present Prompt Generation (PG), a high-level tokenizer and configuration-driven framework that decouples feature-processing logic from model architecture through two declarative JSON files, which serve as the single source of truth for both offline training and online serving, ensuring feature consistency across the two stages. Organizing features under four types with three composable processing components to assemble and compress heterogeneous features, PG delivers acceleration at three levels: (1)fast training iteration: feature experiments require only configuration changes, with built-in token compression for ultra-long sequences; (2)fast deployment: a new scenario only needs to conform to the PG schema and plug into a universal pipeline, with no scenario-specific engineering; (3)fast online inference: engine applies unified optimizations over the standardized configuration, reducing PG's overhead to a negligible level. PG has been deployed on Taobao Search with statistically significant online A/B uplifts of +0.47% in transaction count and +0.51% in GMV, and has been applied across multiple Taobao search and recommendation teams as the iteration framework for generative retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。