提出可扩展至数十个领域的自适应推荐框架,解决小领域数据稀疏问题
One for Dozens: Adaptive REcommendation for All Domains with Counterfactual Augmentation
- 用分层专家网络结构降低参数量,支持多领域知识捕获
- 通过反事实数据增强和动态剪枝,提升小领域训练效果
- 适合需覆盖大量领域的工业级推荐系统使用
多领域推荐(MDR)旨在提升跨多个领域的推荐性能。然而,现实中的在线平台常需处理数十甚至上百个领域,远超传统MDR算法通常仅支持少于五个领域的能力。主要挑战包括参数量激增、维护成本高以及领域间复杂的知识迁移模式。此外,小领域普遍存在数据稀疏问题,导致经典方法训练不足。为此,我们提出基于反事实增强的自适应全领域推荐框架(AREAD)。AREAD采用分层结构,仅在多层中配置有限数量的专家网络,以有效捕捉不同粒度的领域知识。为自适应学习领域间知识迁移模式,我们在训练过程中生成并迭代剪枝各领域的分层专家选择掩码。同时,利用反事实假设对小领域数据进行增强,支持其掩码的迭代剪枝。在两个包含超过二十个领域的公开数据集上的实验表明,AREAD在数据稀疏领域表现尤为出色。源代码见:https://github.com/Chrissie-Law/AREAD-Multi-Domain-Recommendation。
原文摘要 · Abstract (English)
Multi-domain recommendation (MDR) aims to enhance recommendation performance across various domains. However, real-world recommender systems in online platforms often need to handle dozens or even hundreds of domains, far exceeding the capabilities of traditional MDR algorithms, which typically focus on fewer than five domains. Key challenges include a substantial increase in parameter count, high maintenance costs, and intricate knowledge transfer patterns across domains. Furthermore, minor domains often suffer from data sparsity, leading to inadequate training in classical methods. To address these issues, we propose Adaptive REcommendation for All Domains with counterfactual augmentation (AREAD). AREAD employs a hierarchical structure with a limited number of expert networks at several layers, to effectively capture domain knowledge at different granularities. To adaptively capture the knowledge transfer pattern across domains, we generate and iteratively prune a hierarchical expert network selection mask for each domain during training. Additionally, counterfactual assumptions are used to augment data in minor domains, supporting their iterative mask pruning. Our experiments on two public datasets, each encompassing over twenty domains, demonstrate AREAD's effectiveness, especially in data-sparse domains. Source code is available at https://github.com/Chrissie-Law/AREAD-Multi-Domain-Recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。