arXiv:2603.21209cs.IR2026-03中稿 · CIKM 2023被引 2

用互信息优化参数生成,让推荐模型低成本适配多场景

MI-DPG: Decomposable Parameter Generation Network Based on Mutual Information for Multi-Scenario Recommendation

  • 通过分解低秩矩阵生成场景动态权重,高效调节主模型参数
  • 在三个真实数据集上显著提升多场景转化率预测效果
  • 适合需要轻量级多场景推荐的工业系统应用

转化率(CVR)预测在推荐与广告系统中至关重要。现有研究表明,统一模型服务多个场景能有效提升整体性能,但如何以低参数成本提升跨场景预测能力,且稳健建模多场景差异仍具挑战。本文提出MI-DPG,用于多场景CVR预测,通过辅助网络生成场景相关的动态权重矩阵,结合分解后的场景专属与共享低秩矩阵,实现参数高效建模。每个场景的权重矩阵对主模型参数进行加权,使模型参数自适应不同场景,既可调控全参数空间,又能提升模型有效性。此外,设计互信息正则化项,最大化场景感知输入与场景条件权重矩阵间的互信息,增强跨场景参数多样性。在三个真实数据集上的实验表明,MI-DPG显著优于现有方法。

原文摘要 · Abstract (English)

Conversion rate (CVR) prediction models play a vital role in recommendation and advertising systems. Recent research on multi-scenario recommendation shows that learning a unified model to serve multiple scenarios is effective for improving overall performance. However, it remains challenging to improve model prediction performance across scenarios at low model parameter cost, and current solutions are hard to robustly model multi-scenario diversity. In this paper, we propose MI-DPG for the multi-scenario CVR prediction, which learns scenario-conditioned dynamic model parameters for each scenario in a more efficient and effective manner. Specifically, we introduce an auxiliary network to generate scenario-conditioned dynamic weighting matrices, which are obtained by combining decomposed scenario-specific and scenario-shared low-rank matrices with parameter efficiency. For each scene, weighting the backbone model parameters by the weighting matrix helps to specialize the model parameters for different scenarios. It can not only modulate the complete parameter space of the backbone model but also improve the model effectiveness. Furthermore, we design a mutual information regularization to enhance the diversity of model parameters across different scenarios by maximizing the mutual information between the scenario-aware input and the scene-conditioned dynamic weighting matrix. Experiments from three real-world datasets show that MI-DPG significantly outperforms previous multi-scenario recommendation models.

多场景推荐参数高效互信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。