基于瓦瑟斯坦距离的联邦学习数据估值方法,提升数据市场可信度。
Data Valuation and Selection in a Federated Model Marketplace
- 用瓦瑟斯坦距离估算联邦学习中数据对模型性能的影响。
- 在标签偏斜等复杂场景下准确选出高性能数据组合。
- 无需原始数据即可计算,适合隐私敏感的数据市场应用。
在人工智能时代,数据市场已成为促进数据产品交易与共享的重要平台。模型交易为数据市场提供经济激励,提升数据可重用性并确保数据所有权可追溯。为建立可信数据市场,联邦学习(FL)作为保护数据隐私的协同学习范式受到关注。然而,在异构数据源中实现有效的数据估值与选择仍是关键挑战。本文提出一个以瓦瑟斯坦距离为基础的综合框架,该估计算法不仅能预测模型在未见数据组合上的表现,还能揭示数据异质性与联邦聚合算法之间的兼容性。为保障隐私,我们设计了一种分布式方法,无需访问原始数据即可近似计算瓦瑟斯坦距离。此外,实验表明,在神经网络扩展规律下,模型性能可被可靠外推,从而实现无需全量训练的有效数据选择。在标签偏斜、误标及无标签数据等多种场景下的大量实验显示,该方法始终能识别出高性能数据组合,为更可靠的基于联邦学习的模型市场铺平道路。
原文摘要 · Abstract (English)
In the era of Artificial Intelligence (AI), marketplaces have become essential platforms for facilitating the exchange of data products to foster data sharing. Model transactions provide economic solutions in data marketplaces that enhance data reusability and ensure the traceability of data ownership. To establish trustworthy data marketplaces, Federated Learning (FL) has emerged as a promising paradigm to enable collaborative learning across siloed datasets while safeguarding data privacy. However, effective data valuation and selection from heterogeneous sources in the FL setup remain key challenges. This paper introduces a comprehensive framework centered on a Wasserstein-based estimator tailored for FL. The estimator not only predicts model performance across unseen data combinations but also reveals the compatibility between data heterogeneity and FL aggregation algorithms. To ensure privacy, we propose a distributed method to approximate Wasserstein distance without requiring access to raw data. Furthermore, we demonstrate that model performance can be reliably extrapolated under the neural scaling law, enabling effective data selection without full-scale training. Extensive experiments across diverse scenarios, such as label skew, mislabeled, and unlabeled sources, show that our approach consistently identifies high-performing data combinations, paving the way for more reliable FL-based model marketplaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。