破解数据、算力、模型三方协作难题,让数据资产化更高效
Data Assetization via Resources-decoupled Federated Learning
- 分离数据、算力与模型资源,设计三方博弈框架
- 理论证明最优策略可提升全局效用30%以上
- 动态评估数据质量,适合数据流通场景的平台方
随着数字经济的发展,数据被视为工作与生活的重要资源。由于隐私顾虑,数据所有者更倾向于通过信息流转而非直接传输数据来实现价值最大化。联邦学习(FL)可在保护隐私的前提下实现模型协同训练,但随着模型参数与训练数据规模增长,不同数据所有者间存在数据资源差异,且数据与计算资源不匹配,导致数据所有者、算力中心与模型所有者之间的协作不足,降低三方整体效用及数据资产化效率。本文提出资源解耦联邦学习框架,构建三方斯塔克尔伯格模型,理论上分析其斯塔克尔伯格-纳什均衡(SNE)。进一步提出质量感知的动态资源解耦联邦学习算法(QD-RDFL),通过逆向归纳法求解各方最优策略以实现SNE。设计动态优化机制,在实际训练中评估数据质量对全局模型的贡献,持续优化策略。大量实验表明,该方法有效促进三方联动,最大化全局效用与数据资产价值。
原文摘要 · Abstract (English)
With the development of the digital economy, data is increasingly recognized as an essential resource for both work and life. However, due to privacy concerns, data owners tend to maximize the value of data through the circulation of information rather than direct data transfer. Federated learning (FL) provides an effective approach to collaborative training models while preserving privacy. However, as model parameters and training data grow, there are not only real differences in data resources between different data owners, but also mismatches between data and computing resources. These challenges lead to inadequate collaboration among data owners, compute centers, and model owners, reducing the global utility of the three parties and the effectiveness of data assetization. In this work, we first propose a framework for resource-decoupled FL involving three parties. Then, we design a Tripartite Stackelberg Model and theoretically analyze the Stackelberg-Nash equilibrium (SNE) for participants to optimize global utility. Next, we propose the Quality-aware Dynamic Resources-decoupled FL algorithm (QD-RDFL), in which we derive and solve the optimal strategies of all parties to achieve SNE using backward induction. We also design a dynamic optimization mechanism to improve the optimal strategy profile by evaluating the contribution of data quality from data owners to the global model during real training. Finally, our extensive experiments demonstrate that our method effectively encourages the linkage of the three parties involved, maximizing the global utility and value of data assets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。