提出可解释的数据价值评估框架,提升推荐系统对不同指标的适应性。
Beyond Models! Explainable Data Valuation and Metric Adaption for Recommendation
- 基于博弈论计算数据的谢尔平利值,实现可解释的质量评估
- 通过强化学习适配不同指标,支持可微与不可微评价标准
- 在多个数据集上提升推荐效果,最高增益达34.7%(NDCG)
用户行为数据是推荐系统的基础,但质量参差不齐。现有方法虽用数据估值区分优劣,却多为黑箱设计,缺乏可解释性,且通常只针对特定评估指标,泛化能力弱。为此,本文提出可解释、通用的DVR框架,能根据模型架构和评估指标灵活优化数据利用效率。在可解释数据估值方面,引入基于博弈论的数值评估器,通过计算数据的谢尔平利值(Shapley value),保证数学严谨性与可靠性。为适配多样化评估指标(包括可微与不可微),设计基于强化学习的度量适配器,将评估指标视为奖励信号指导模型优化。在多个基准数据集上的广泛实验表明,该框架能有效提升现有推荐算法在排序准确率、多样性与公平性等指标上的表现。具体而言,在代表性指标NDCG上,性能相比现有方法最高提升34.7%。代码已开源于https://github.com/renqii/DVR。
原文摘要 · Abstract (English)
User behavior records serve as the foundation for recommender systems. While the behavior data exhibits ease of acquisition, it often suffers from varying quality. Current methods employ data valuation to discern high-quality data from low-quality data. However, they tend to employ black-box design, lacking transparency and interpretability. Besides, they are typically tailored to specific evaluation metrics, leading to limited generality across various tasks. To overcome these issues, we propose an explainable and versatile framework DVR which can enhance the efficiency of data utilization tailored to any requirements of the model architectures and evaluation metrics. For explainable data valuation, a data valuator is presented to evaluate the data quality via calculating its Shapley value from the game-theoretic perspective, ensuring robust mathematical properties and reliability. In order to accommodate various evaluation metrics, including differentiable and non-differentiable ones, a metric adapter is devised based on reinforcement learning, where a metric is treated as the reinforcement reward that guides model optimization. Extensive experiments conducted on various benchmarks verify that our framework can improve the performance of current recommendation algorithms on various metrics including ranking accuracy, diversity, and fairness. Specifically, our framework achieves up to 34.7\% improvements over existing methods in terms of representative NDCG metric. The code is available at https://github.com/renqii/DVR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。