通过数据与模型协同设计,提升搜索排序的可扩展性。
UniScale: Synergistic Entire Space Data and Model Scaling for Search Ranking
- 构建数据与模型联合优化框架,突破单一模型调优瓶颈。
- 在真实电商搜索平台上线测试,购买率和GMV分别提升1.70%和2.04%。
- 适合追求工业级推荐系统性能极限的算法工程师。
大语言模型的发展推动了工业搜索、广告与推荐系统的规模化研究。然而,现有方法多关注架构改进,忽视了数据与架构设计间的协同效应。我们发现,仅扩大模型参数会带来边际收益递减,且复杂异构数据分布导致的性能退化难以通过模型设计修复。为此,本文提出UniScale,一种数据与架构联合优化的新框架。其核心包括:(1) ES³(全空间采样系统),通过域内分层标签分配与跨域搜索化,扩展训练信号;(2) HHSFT(异构层次样本融合变换器),通过异构层次特征交互与全空间用户兴趣融合,有效建模扩大的异构数据分布,突破结构调优的性能上限。大规模工业数据集实验表明,UniScale显著提升性能并呈现清晰的可扩展趋势。在线A/B测试在真实电商平台中验证,相比强基线模型,用户购买率与商品交易总额(GMV)分别提升1.70%和2.04%。
原文摘要 · Abstract (English)
Recent advances in Large Language Models (LLMs) have inspired a surge of scaling research in industrial search, advertising, and recommendation systems. However, existing approaches focus mainly on architectural improvements, overlooking the critical synergy between data and architecture design. We observe that scaling model parameters alone exhibits diminishing returns, and that the performance degradation caused by complex heterogeneous data distributions is often irrecoverable through model design alone. In this paper, we propose UniScale, a novel co-design framework that jointly optimizes data and architecture to unlock the full potential of model scaling. UniScale includes two core parts: (1) ES$^3$ (Entire-Space Sample System), a high-quality data scaling system that expands the training signal beyond conventional sampling strategies through intra-domain expansion with hierarchical label attribution and cross-domain searchification; and (2) HHSFT (Heterogeneous Hierarchical Sample Fusion Transformer), a novel architecture that effectively models the complex heterogeneous distribution of scaled data via Heterogeneous Hierarchical Feature Interaction and Entire Space User Interest Fusion, thereby surpassing the performance ceiling of structure-only model tuning. Extensive experiments on large-scale industrial datasets demonstrate that UniScale achieves significant improvements and exhibits clear scaling trends. Online A/B tests on a real-world E-commerce search platform confirm that UniScale consistently outperforms strong production baselines, achieving 1.70% and 2.04% increases in user purchase and Gross Merchandise Value (GMV).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。