提出新算法解决动态参与的多智能体系统优化问题
Optimization and Learning in Open Multi-Agent Systems
- 基于开放算子理论设计可适应动态变化的分布式算法
- 首次实现对任意时刻距离最优解的精确性能评估
- 适用于资源不均或遭攻击的开放网络,适合工业协作系统
现代人工智能依赖于由多个智能体构成的网络,这些智能体自主收集数据、处理信息并与其他邻近智能体交换信息,以协同解决优化与学习问题。本文针对‘开放网络’中参与智能体数量可能因自主决策、资源异构性或拒绝服务(DoS)攻击而动态变化的情况,提出一种新型分布式算法。该算法的收敛性分析建立在新发展的‘开放算子理论’之上:当需更新的组件集合随时间改变时,算子即被视为‘开放’,从而形成作用于不同维度和组成序列点的时间变算子。所发展出的数学工具与收敛结果为评估开放网络中的分布式算法提供了通用框架,能够以瞬时距离最优解的精度来刻画性能,区别于传统基于累积遗憾度量的有限时间性能评估。作为示例,该算法被用于求解不同指标下的动态一致性或跟踪问题,如平均值、中位数、极值,以及具有逻辑损失函数的分类问题。
原文摘要 · Abstract (English)
Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed algorithm to address a broad class of these problems in "open networks", where the number of participating agents may vary due to several factors, such as autonomous decisions, heterogeneous resource availability, or DoS attacks. Extending the current literature, the convergence analysis of the proposed algorithm is based on the newly developed "Theory of Open Operators", which characterizes an operator as open when the set of components to be updated changes over time, yielding to time-varying operators acting on sequences of points of different dimensions and compositions. The mathematical tools and convergence results developed here provide a general framework for evaluating distributed algorithms in open networks, allowing to characterize their performance in terms of the punctual distance from the optimal solution, in contrast with regret-based metrics that assess cumulative performance over a finite-time horizon. As illustrative examples, the proposed algorithm is used to solve dynamic consensus or tracking problems on different metrics of interest, such as average, median, and min/max value, as well as classification problems with logistic loss functions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。