arXiv:2505.16752cs.IRcs.AI2025-05被引 4

提出双流生成排序网络,提升推荐系统效率与效果。

Action is All You Need: Dual-Flow Generative Ranking Network for Recommendation

  • 用真实与伪造行为流设计双流机制,优化交互建模
  • 在多个数据集上超越基线模型,训练与推理更高效
  • 适合追求高效率与可扩展性的工业推荐系统

深度学习推荐模型(DLRMs)通常依赖大量人工特征工程以提升精度和用户体验,导致系统复杂度上升,且性能随计算资源增长受限。最近,Meta提出基于HSTU模块的生成式排序范式,实现从原始用户行为序列端到端学习,并在大规模数据集上展现出可扩展性,被视为当前最优(SOTA)。然而,将用户行为拆分为交错的物品与动作信息显著增加输入序列长度,影响训练与推理效率。为此,我们提出双流生成排序网络(DFGR),采用双流机制优化交互建模,通过端到端令牌处理实现高效训练与推理。DFGR将原始用户行为序列复制为真实流与虚假流,基于动作信息真伪划分,并在自注意力机制的QKV模块中设计新颖的流间交互方式。该设计降低计算开销,相比Meta的HSTU模型提升训练效率与推理性能。在开源及真实工业数据集上的实验表明,DFGR优于采用大量特征工程的工业在线基线模型DLRM,以及Meta的HSTU和其他常见推荐模型如DIN、DCN、DIEN、DeepFM。此外,我们在计算约束下研究最优参数分配策略,确立了DFGR作为下一代高效生成式排序范式的能力。

原文摘要 · Abstract (English)

Deep Learning Recommendation Models (DLRMs) often rely on extensive manual feature engineering to improve accuracy and user experience, which increases system complexity and limits scalability of model performance with respect to computational resources. Recently, Meta introduced a generative ranking paradigm based on HSTU block that enables end-to-end learning from raw user behavior sequences and demonstrates scaling law on large datasets that can be regarded as the state-of-the-art (SOTA). However, splitting user behaviors into interleaved item and action information significantly increases the input sequence length, which adversely affects both training and inference efficiency. To address this issue, we propose the Dual-Flow Generative Ranking Network (DFGR), that employs a dual-flow mechanism to optimize interaction modeling, ensuring efficient training and inference through end-to-end token processing. DFGR duplicates the original user behavior sequence into a real flow and a fake flow based on the authenticity of the action information, and then defines a novel interaction method between the real flow and the fake flow within the QKV module of the self-attention mechanism. This design reduces computational overhead and improves both training efficiency and inference performance compared to Meta's HSTU-based model. Experiments on both open-source and real industrial datasets show that DFGR outperforms DLRM, which serves as the industrial online baseline with extensive feature engineering, as well as Meta's HSTU and other common recommendation models such as DIN, DCN, DIEN, and DeepFM. Furthermore, we investigate optimal parameter allocation strategies under computational constraints, establishing DFGR as an efficient and effective next-generation generative ranking paradigm.

推荐系统生成式模型双流机制高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。