自动筛选推荐系统中的信息流,提升多场景多任务推荐效果
Automated Information Flow Selection for Multi-scenario Multi-task Recommendation
- 用低秩适配解耦四类信息单元,轻量融合信息
- 自动过滤无效信息流,提升关键关系影响力
- 适合追求高效、可解释性推荐系统的开发者
多场景多任务推荐(MSMTR)需在多种场景下同时优化点击率、转化率等目标。现有模型包含场景共享、场景专属、任务共享、任务专属四类网络,生成四种信息流。但存在两大问题:一是架构复杂(如混合专家模型),增加参数与训练成本;二是全量提取信息流,引入噪声。为此,本文提出轻量级自动化信息流选择(AutoIFS)框架:通过低秩适配(LoRA)解耦四类网络,实现灵活高效融合;设计信息流选择网络,基于性能反馈自动剔除无效流,采用简单剪枝函数消除冗余信息。在两个公开数据集和线上A/B测试中验证,显著提升模型性能。
原文摘要 · Abstract (English)
Multi-scenario multi-task recommendation (MSMTR) systems must address recommendation demands across diverse scenarios while simultaneously optimizing multiple objectives, such as click-through rate and conversion rate. Existing MSMTR models typically consist of four information units: scenario-shared, scenario-specific, task-shared, and task-specific networks. These units interact to generate four types of relationship information flows, directed from scenario-shared or scenario-specific networks to task-shared or task-specific networks. However, these models face two main limitations: 1) They often rely on complex architectures, such as mixture-of-experts (MoE) networks, which increase the complexity of information fusion, model size, and training cost. 2) They extract all available information flows without filtering out irrelevant or even harmful content, introducing potential noise. Regarding these challenges, we propose a lightweight Automated Information Flow Selection (AutoIFS) framework for MSMTR. To tackle the first issue, AutoIFS incorporates low-rank adaptation (LoRA) to decouple the four information units, enabling more flexible and efficient information fusion with minimal parameter overhead. To address the second issue, AutoIFS introduces an information flow selection network that automatically filters out invalid scenario-task information flows based on model performance feedback. It employs a simple yet effective pruning function to eliminate useless information flows, thereby enhancing the impact of key relationships and improving model performance. Finally, we evaluate AutoIFS and confirm its effectiveness through extensive experiments on two public benchmark datasets and an online A/B test.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。