统一建模特征交互与多域行为序列,提升广告点击后转化率预测
Topology-Masked Unified Backbone for Joint Feature Interaction and Multi-Domain Sequence Modeling

- 将异构特征与多域行为序列统一为令牌表示,通过结构化注意力掩码控制信息流动
- 在腾讯广告竞赛数据集上超越基线,实现稳定性能提升
- 适合工业级推荐系统中需要联合建模的场景
大规模点击后转化率(CVR)预测需同时建模异构特征交互与多域用户行为序列依赖。现有工业排名模型通常用独立模块处理这两方面。近期统一架构尝试将其整合至单一框架,但常依赖模块间协调,未能充分在统一交互空间组织所有信息源。为此,我们提出MaskRec,一种拓扑掩码统一令牌交互架构,用于特征交互与多域序列建模。MaskRec将异构特征、多域行为序列和上下文信号转换为统一令牌表示,并引入可学习的全局记忆令牌与域级记忆令牌作为信息聚合节点。基于此统一令牌空间,设计结构化注意力掩码TopoMask,根据不同信息源的结构差异与建模需求选择性启用或阻断注意力连接。由此,异构特征交互与多域序列建模在相同的拓扑约束注意力过程中完成。此外,MaskRec还引入双路径交互查询生成模块,在统一骨干网络前注入候选项条件化的用户-物品交互信号。在腾讯广告算法竞赛数据集上的实验表明,MaskRec相较官方基线实现稳定提升,验证了所提统一框架在工业级CVR预测中的有效性。
原文摘要 · Abstract (English)
Large-scale post-click conversion rate (CVR) prediction requires jointly modeling heterogeneous feature interactions and dependencies over multi-domain user behavior sequences. Existing industrial ranking models usually handle these two aspects with separate modules. Recent unified architectures attempt to incorporate them into a single framework, but such unification often relies on coordination between modules and does not fully organize all information sources within the same interaction space. To address this problem, we propose MaskRec, a topology-masked unified token interaction architecture for feature interaction and multi-domain sequence modeling. MaskRec transforms heterogeneous features, multi-domain behavior sequences, and contextual signals into unified token representations, and further introduces learnable global memory tokens and domain-level memory tokens as information aggregation nodes. Based on this unified token space, MaskRec designs a structured attention mask, TopoMask, which selectively enables or blocks attention connections according to the structural differences and modeling requirements of different information sources. In this way, heterogeneous feature interaction and multi-domain sequence modeling are performed within the same topology-constrained attention process. In addition, MaskRec incorporates a dual-path interactive query generation module to inject candidate-conditioned user--item interaction signals before the unified backbone. Experiments on the Tencent Advertising Algorithm Competition dataset show that MaskRec achieves stable improvements over the official baseline, validating the effectiveness of the proposed unified framework for industrial CVR prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。