提出动态融合框架,提升点击率预测中显式与隐式交互建模效果。
DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction
- 设计残差感知低阶交互网络,保留低阶信号并减少冗余。
- 引入网络感知注意力融合模块,动态整合多层特征表示。
- 在多个公开数据集上达到领先性能,适合推荐系统优化场景。
点击率(CTR)预测是在线广告和推荐系统中的关键任务,依赖于对特征交互的有效建模。显式交互通过预定义关系(如内积)捕捉信息,但常受数据稀疏性影响;隐式交互则通过非线性变换学习复杂模式,却缺乏高效建模低阶关系的归纳偏置。现有双流架构存在信息共享有限、梯度不平衡及稀疏数据中低阶信号难以保留等问题。本文提出动态低阶感知融合框架(DLF),包含两个核心组件:残差感知低阶交互网络(RLI)和网络感知注意力融合模块(NAF)。RLI 显式保留低阶信号,同时缓解残差连接带来的冗余;NAF 在每一层动态融合显式与隐式表示,增强信息共享并缓解梯度不平衡。二者协同平衡低阶与高阶交互,提升模型表达能力。在多个公开数据集上的大量实验表明,DLF 实现了当前最优的 CTR 预测性能。代码已开源:https://github.com/USTC-StarTeam/DLF。
原文摘要 · Abstract (English)
Click-through rate (CTR) prediction is a critical task in online advertising and recommender systems, relying on effective modeling of feature interactions. Explicit interactions capture predefined relationships, such as inner products, but often suffer from data sparsity, while implicit interactions excel at learning complex patterns through non-linear transformations but lack inductive biases for efficient low-order modeling. Existing two-stream architectures integrate these paradigms but face challenges such as limited information sharing, gradient imbalance, and difficulty preserving low-order signals in sparse CTR data. We propose a novel framework, Dynamic Low-Order-Aware Fusion (DLF), which addresses these limitations through two key components: a Residual-Aware Low-Order Interaction Network (RLI) and a Network-Aware Attention Fusion Module (NAF). RLI explicitly preserves low-order signals while mitigating redundancy from residual connections, and NAF dynamically integrates explicit and implicit representations at each layer, enhancing information sharing and alleviating gradient imbalance. Together, these innovations balance low-order and high-order interactions, improving model expressiveness. Extensive experiments on public datasets demonstrate that DLF achieves state-of-the-art performance in CTR prediction, addressing key limitations of existing models. The implementation is publicly available at https://github.com/USTC-StarTeam/DLF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。