arXiv:2607.19987cs.IR2026-07

开源基准UniRank统一评估排序模型的序列建模与特征交互能力

UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction

论文配图:UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction
图 1 · 摘自论文原文
  • 采用时间点自回归监督,统一建模序列与特征交互
  • 在超7亿样本数据上评测15个模型,最长序列超10万次交互
  • 提供可复现的训练工具包,适合学术与工业研究对比

排序是在线广告和推荐系统的核心环节。现代排序模型越来越多地融合序列建模与特征交互,但许多进展依赖专有数据、封闭实现和大规模工业基础设施,限制了可复现性比较,也阻碍了对缩放定律、长序列建模和多任务排序的研究。为此,本文提出UniRank——一个面向统一序列建模与特征交互的排序模型开源基准。UniRank采用时间点自回归监督,标准化反馈任务评估,并提供包含分布式数据并行、算子优化、混合精度训练、注意力优化等技术的PyTorch工具包,显著降低硬件需求。我们在来自短视频、广告和电商的五个大规模公开数据集上评估了15个代表性统一排序模型,最大数据集含超7亿实例,最长行为序列超过10^5次交互。UniRank为可复现的模型比较、有限算力下的缩放规律研究,以及缩小学术与工业差距提供了基础支持。代码与数据已开源。

原文摘要 · Abstract (English)

Ranking is a core stage in online advertising and recommender systems. Modern ranking models increasingly unify sequential modeling and feature interaction, yet many advances rely on proprietary data, closed implementations, and large-scale industrial infrastructure. This setting limits reproducible comparison and hinders academic study of scaling laws, long-sequence modeling, and multi-task ranking. To address these limitations, this paper proposes UniRank, an open benchmark for ranking models that unify sequential modeling and feature interaction. UniRank uses chronological pointwise autoregressive supervision, standardizes evaluation across feedback tasks, and provides a PyTorch toolkit with Distributed Data Parallel training, operator optimization, mixed-precision training, attention optimization, and other efficiency techniques that reduce hardware requirements. We benchmark 15 representative unified ranking models on five large-scale public datasets from short-video, advertising, and e-commerce platforms, with the largest dataset containing over 700 million instances and the longest behavior sequence exceeding 10^5 interactions. UniRank provides a reproducible basis for comparing unified ranking models, studying scaling laws under limited compute, and narrowing the gap between academic and industrial ranking research. We believe UniRank benefits researchers, practitioners, and beginners through reproducible experiments, production-oriented evaluation, and accessible implementations. Code and data are available at https://github.com/salmon1802/UniRank.

排序模型序列建模开源基准推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。