arXiv:2509.05833cs.LGcs.GT2025-09

为去中心化梯度市场设计综合评估框架,解决成本、公平与稳定性难题。

Benchmarking Robust Aggregation in Decentralized Gradient Marketplaces

  • 构建模拟市场动态的环境,支持买家私有基线与多样卖家分布。
  • 引入经济效率、公平性等新指标,量化评估梯度聚合方法表现。
  • 实证分析MartFL框架,揭示性能、成本与公平性的权衡关系。

分布式与隐私保护机器学习的发展催生了去中心化梯度市场,参与者交易梯度等中间产物。然而现有联邦学习(FL)基准忽略了此类市场特有的经济与系统因素——成本效益、对卖方的公平性及市场稳定性,尤其当买方依赖私有基线数据集进行评估时。本文提出一个全面的基准框架,用于在依赖买方基线的市场中整体评估鲁棒梯度聚合方法。贡献包括:(1) 模拟市场动态的仿真环境,支持可变买方基线与多样化卖家分布;(2) 增强标准FL指标的评估方法,加入经济效率、公平性与选择动态等市场核心维度;(3) 对现有分布式梯度市场框架MartFL进行深入实证分析,集成并对比评估适配后的FLTrust与SkyMask作为替代聚合策略的效果;(4) 覆盖多种数据集、本地攻击及针对市场选择过程的Sybil攻击,提供性能、鲁棒性、成本、公平性与稳定性的权衡洞察。该基准为社区提供关键工具与实证依据,助力设计更鲁棒、公平且经济可行的去中心化梯度市场。

原文摘要 · Abstract (English)

The rise of distributed and privacy-preserving machine learning has sparked interest in decentralized gradient marketplaces, where participants trade intermediate artifacts like gradients. However, existing Federated Learning (FL) benchmarks overlook critical economic and systemic factors unique to such marketplaces-cost-effectiveness, fairness to sellers, and market stability-especially when a buyer relies on a private baseline dataset for evaluation. We introduce a comprehensive benchmark framework to holistically evaluate robust gradient aggregation methods within these buyer-baseline-reliant marketplaces. Our contributions include: (1) a simulation environment modeling marketplace dynamics with a variable buyer baseline and diverse seller distributions; (2) an evaluation methodology augmenting standard FL metrics with marketplace-centric dimensions such as Economic Efficiency, Fairness, and Selection Dynamics; (3) an in-depth empirical analysis of the existing Distributed Gradient Marketplace framework, MartFL, including the integration and comparative evaluation of adapted FLTrust and SkyMask as alternative aggregation strategies within it. This benchmark spans diverse datasets, local attacks, and Sybil attacks targeting the marketplace selection process; and (4) actionable insights into the trade-offs between model performance, robustness, cost, fairness, and stability. This benchmark equips the community with essential tools and empirical evidence to evaluate and design more robust, equitable, and economically viable decentralized gradient marketplaces.

联邦学习梯度市场鲁棒聚合经济公平

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。