提出高效近似算法IPSS,让联邦学习数据估值更实用。
Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach
- 基于分层采样框架,选择最优计算方案
- 发现关键组合仅占少数但影响大,显著降低计算量
- 在多个基准数据集上比现有方法更快更准
联邦学习通过整合多方数据提升模型性能,但跨组织数据提供方常因无法公平评估数据价值而不愿共享高质量数据。当前主流的数据估值方法——谢林值(Shapley Value, SV)虽具理论优势,但因需对指数级数据组合进行建模训练与评估,计算开销过大。现有方法在精度与效率间难以兼顾,主要因未针对联邦学习场景选择合适的近似计算方案,且忽视了联邦学习中效用函数的特性。本文首先构建统一的分层采样框架,覆盖两种主流采样策略;在线性回归假设下分析并优选更具潜力的策略;进一步发现‘关键组合’现象:仅有少量数据组合对最终估值有显著影响。基于此,提出实用近似算法IPSS,主动筛选高影响组合,避免全枚举,大幅降低时间成本,误差可控。在多个联邦学习基准数据集上的实验表明,IPSS在效率和效果上均优于代表性基线方法。
原文摘要 · Abstract (English)
Federated learning paradigm to utilize datasets across multiple data providers. In FL, cross-silo data providers often hesitate to share their high-quality dataset unless their data value can be fairly assessed. Shapley value (SV) has been advocated as the standard metric for data valuation in FL due to its desirable properties. However, the computational overhead of SV is prohibitive in practice, as it inherently requires training and evaluating an FL model across an exponential number of dataset combinations. Furthermore, existing solutions fail to achieve high accuracy and efficiency, making practical use of SV still out of reach, because they ignore choosing suitable computation scheme for approximation framework and overlook the property of utility function in FL. We first propose a unified stratified-sampling framework for two widely-used schemes. Then, we analyze and choose the more promising scheme under the FL linear regression assumption. After that, we identify a phenomenon termed key combinations, where only limited dataset combinations have a high-impact on final data value. Building on these insights, we propose a practical approximation algorithm, IPSS, which strategically selects high-impact dataset combinations rather than evaluating all possible combinations, thus substantially reducing time cost with minor approximation error. Furthermore, we conduct extensive evaluations on the FL benchmark datasets to demonstrate that our proposed algorithm outperforms a series of representative baselines in terms of efficiency and effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。