用可编辑生成模型统一电商搜索多分支,兼顾召回效果与实时更新能力。
OneRetrieval: Unifying Multi-Branch E-commerce Retrieval with an Editable Generative Model

- 基于关键词对齐编码,将每个标识位绑定可解释属性词,实现可编辑生成检索
- 在五百万真实请求上召回效果媲美最强基线,新词干预命中率超闭合码本十倍以上
- 支持部署后无需重训即可注入新词,适合需要快速响应的工业级电商搜索场景
工业级电商搜索通过融合多个分支检索阶段服务数亿商品,该阶段依赖人工调参合并,缺乏联合优化。生成式检索(GR)有望将其简化为单一模型,但统一面临不止于召回质量的挑战:倒排索引分支虽召回低于平台均值,却因可在不更新模型的前提下数小时内注入新词而持续保留;单模型替代方案必须保持这种实时可编辑性。现有生成方法结构上缺失此能力:闭合码本方法在训练时固定每个槽位为量化嵌入,开放词汇方法则依赖模型泛化处理新词路由。本文提出 OneRetrieval,一种基于关键词对齐编码(KAE)的一体化生成检索框架,将每个标识位置绑定可解释属性词,实现与倒排索引相当的可编辑性,据我们所知是首个具备编辑能力的生成检索方法。信息论驱动的融合机制将18个属性类别聚为6组非均匀容量码本,每组预留槽位可在部署后绑定新词而无需重训;四阶段微调流程同时保障性能与可编辑性。在五百万真实流量请求上,OneRetrieval 达到最强生成基线的深度召回水平,新词干预命中率超过闭合码本编码一个数量级以上。线上实验表明,替换倒排索引分支显著提升订单量;扩展至几乎整个检索阶段,在保持转化率的同时改善点击率。系统已在快手部署,日均服务数亿次页面浏览。
原文摘要 · Abstract (English)
Industrial e-commerce search serves hundreds of millions of items through a multi-branch retrieval stage fused by hand-tuned merging without joint optimization. Generative retrieval (GR) raises the prospect of collapsing this stage into a single model, yet unification is gated by more than retrieval quality: the inverted-index branch converts below the platform average yet persists because it is almost the only branch where operations can inject a new term within hours without any model update; a one-model substitute must preserve this real-time editability. Existing GR methods structurally lack it: closed-codebook methods fix each slot to a quantized embedding at training, while open-vocabulary methods leave new-term routing to model generalization. We present OneRetrieval, a one-model GR framework built on Keyword-Aligned Encoding (KAE), which ties each identifier position to an interpretable attribute word, pairing competitive recall quality with the editability of the inverted index -- to our knowledge the first editable generative retrieval method. An information-theoretic merging organizes 18 attribute categories into six codebook groups with non-uniform capacity; reserved slots in each codebook can be bound to new words after deployment without retraining; and a four-stage fine-tuning pipeline secures quality and editability jointly. On five million real-traffic requests, OneRetrieval matches the deep recall of the strongest generative baseline, with an intervention hit rate over an order of magnitude above closed-codebook encodings. Online, replacing the inverted-index branch significantly lifts order volume; extending to nearly the entire stage holds conversion while improving CTR. The system is deployed at Kuaishou, serving hundreds of millions of PVs daily.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。