arXiv:2607.13398cs.IR2026-07KDD

TmallGS提升电商搜索点击率预测,通过分层特征建模实现高效训练与精准排序。

TMallGS: Scaling Unified Feature and Sequence Modeling for Generative E-commerce Search

论文配图:TMallGS: Scaling Unified Feature and Sequence Modeling for Generative E-commerce Search
图 1 · 摘自论文原文
  • 分层特征映射结合重要性重加权与分布校准,优化异构特征表示
  • 训练吞吐量提升2.3倍,线上点击率和成交额显著增长
  • 适合高并发电商搜索场景的模型设计,对特征工程敏感者尤具参考价值

在工业级搜索与排序系统中,点击率(CTR)预测正从传统深度学习推荐模型转向统一、计算密集型的Transformer架构。这一转变旨在提升模型浮点运算利用率(MFU),并借助缩放定律实现可预测的性能提升。然而,现有方法如OneTrans和Climber在适配大语言模型架构时,常采用全量标记化策略,忽略了排序特征的异质性。为此,我们提出TmallGS,一种面向天猫搜索的可扩展排序架构。该架构包含五个关键组件:(1) 分层分布校准标记化,结合字段重要性重加权(FSR)与分布校准投影(DCP),将多样特征映射至优化子空间;(2) 字段自适应门控Transformer主干,支持字段级QKV投影与噪声自适应门控,增强语义交互精度;(3) 解耦式FiLM后期融合,保留显式高频信号;(4) 上下文感知偏置网络,分离系统性偏差与用户意图;(5) 误差感知渐进式训练,采用动态加权损失实现稳健学习。大规模离线实验与线上A/B测试表明,TmallGS显著提升训练吞吐量,并在UCTCVR与GMV上取得显著增益。

原文摘要 · Abstract (English)

In industrial search and ranking systems, Click-Through Rate (CTR) prediction is shifting from traditional Deep Learning Recommendation Models (DLRM) toward unified, compute-intensive Transformer architectures. This transition is driven by the need to improve Model FLOPs Utilization (MFU) and achieve predictable gains through scaling laws. However, existing approaches such as OneTrans and Climber often adopt an all-in-tokenization strategy when adapting Large Language Model (LLM) architectures, overlooking the heterogeneous nature of ranking features. We propose TmallGS, a scalable ranking architecture for Tmall search. TmallGS includes five key components: (1) Hierarchical Distribution-Calibrated Tokenization, which combines Field-wise Saliency Reweighting (FSR) and Distribution-Calibrated Projection (DCP) to map diverse features into optimized subspaces; (2) a Field-Adaptive Gated Transformer Backbone with per-field QKV projections and noise-adaptive gating for refined semantic interaction; (3) Decoupled FiLM Late Fusion to preserve explicit high-frequency signals; (4) a Context-Aware Bias Net to decouple systemic bias from user intent; and (5) Error-Aware Progressive Training with dynamically weighted losses for robust learning. Extensive offline experiments and online A/B tests on Tmall Search show that TmallGS improves training throughput and achieves substantial gains in UCTCVR and GMV.

电商搜索TransformerCTR预测特征建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。