用二次交互网络提升多模态点击率预测精度
Quadratic Interest Network for Multimodal Click-Through Rate Prediction
- 引入自适应稀疏目标注意力提取用户行为特征
- 通过二次神经网络捕捉高阶特征交互,AUC达0.9798
- 适合工业级推荐系统中多模态建模的工程优化
多模态点击率(CTR)预测是工业推荐系统的关键技术,利用文本、图像和行为日志等异构模态,捕捉用户与物品间的高阶特征交互,从而增强对用户兴趣的理解和点击行为预测能力。该领域的主要挑战在于如何有效利用多模态丰富的语义信息,同时满足真实应用场景中在线推理的低延迟要求。为推动该方向发展,WWW 2025 EReL@MIR Workshop 设立了多模态 CTR 预测挑战赛,分为两个任务:(1) 多模态物品嵌入任务,探索多模态信息提取与物品表征学习方法;(2) 多模态 CTR 预测任务,探索能有效利用多模态嵌入特征的推荐模型。本文针对第二项任务,提出一种新模型——二次兴趣网络(Quadratic Interest Network, QIN)。QIN 采用自适应稀疏目标注意力机制提取多模态用户行为特征,并利用二次神经网络捕捉高阶特征交互。实验结果表明,QIN 在排行榜上取得 0.9798 的 AUC,排名第二。模型代码、训练日志、超参数配置及检查点已公开于 https://github.com/salmon1802/QIN。
原文摘要 · Abstract (English)
Multimodal click-through rate (CTR) prediction is a key technique in industrial recommender systems. It leverages heterogeneous modalities such as text, images, and behavioral logs to capture high-order feature interactions between users and items, thereby enhancing the system's understanding of user interests and its ability to predict click behavior. The primary challenge in this field lies in effectively utilizing the rich semantic information from multiple modalities while satisfying the low-latency requirements of online inference in real-world applications. To foster progress in this area, the Multimodal CTR Prediction Challenge Track of the WWW 2025 EReL@MIR Workshop formulates the problem into two tasks: (1) Task 1 of Multimodal Item Embedding: this task aims to explore multimodal information extraction and item representation learning methods that enhance recommendation tasks; and (2) Task 2 of Multimodal CTR Prediction: this task aims to explore what multimodal recommendation model can effectively leverage multimodal embedding features and achieve better performance. In this paper, we propose a novel model for Task 2, named Quadratic Interest Network (QIN) for Multimodal CTR Prediction. Specifically, QIN employs adaptive sparse target attention to extract multimodal user behavior features, and leverages Quadratic Neural Networks to capture high-order feature interactions. As a result, QIN achieved an AUC of 0.9798 on the leaderboard and ranked second in the competition. The model code, training logs, hyperparameter configurations, and checkpoints are available at https://github.com/salmon1802/QIN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。