arXiv:2501.16519cs.LGcs.DC2025-01

优化去中心化学习中权重与奖励的参数配置,提升回归与分类任务性能。

Optimizing Decentralized Online Learning for Supervised Regression and Classification Problems

  • 通过数值实验优化性能映射斜率、评估周期和奖励机制参数。
  • 不同网络结构与任务类型下,最优参数配置存在差异且可量化。
  • 结果适用于基于推理融合的去中心化AI系统设计与优化。

去中心化学习网络旨在从多个参与者的原始预测中合成单一模型输出。为确定联合预测,需建立历史表现到参与方权重的映射,并建立表现到公平奖励的映射以激励贡献。尽管去中心化学习日益普及,但尚无系统性研究对相关自由参数进行校准。本文提出针对监督回归与分类任务的去中心化在线学习关键参数优化框架,涉及表现-权重映射斜率、表现评估时间窗、表现-奖励映射斜率等参数。通过模拟Allora Network架构并扩展至分类任务,开展多组数值实验,实现两类问题下的参数调优与网络性能(损失最小化)对比分析。结果表明,最优性能-权重映射、评估周期及表现-奖励映射随网络组成与任务类型动态变化。研究为去中心化学习协议优化提供实证依据,并讨论其在任意基于推理融合的去中心化AI网络中的通用性。

原文摘要 · Abstract (English)

Decentralized learning networks aim to synthesize a single network inference from a set of raw inferences provided by multiple participants. To determine the combined inference, these networks must adopt a mapping from historical participant performance to weights, and to appropriately incentivize contributions they must adopt a mapping from performance to fair rewards. Despite the increased prevalence of decentralized learning networks, there exists no systematic study that performs a calibration of the associated free parameters. Here we present an optimization framework for key parameters governing decentralized online learning in supervised regression and classification problems. These parameters include the slope of the mapping between historical performance and participant weight, the timeframe for performance evaluation, and the slope of the mapping between performance and rewards. These parameters are optimized using a suite of numerical experiments that mimic the design of the Allora Network, but have been extended to handle classification tasks in addition to regression tasks. This setup enables a comparative analysis of parameter tuning and network performance optimization (loss minimization) across both problem types. We demonstrate how the optimal performance-weight mapping, performance timeframe, and performance-reward mapping vary with network composition and problem type. Our findings provide valuable insights for the optimization of decentralized learning protocols, and we discuss how these results can be generalized to optimize any inference synthesis-based, decentralized AI network.

去中心化学习在线学习参数优化推理融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。