arXiv:2502.05028cs.MAcs.LG2025-02ICLR被引 6

新算法让多智能体协作最大化非凸函数,通信更高效且逼近效果更好。

Near-Optimal Online Learning for Multi-Agent Submodular Coordination: Tight Approximation and Communication Efficiency

  • 用连续优化替代离散问题,通过共识机制降低通信依赖。
  • 理论证明算法逼近比达(1−e⁻ᶜ)/ᶜ,优于现有最优算法的1/(1+c)。
  • 无需复杂投影操作,适合分布式系统,尤其适用于动态追踪任务。

在不可预测环境中协调多个智能体共同最大化子模函数是一项关键任务,广泛应用于机器学习、机器人规划与控制。现有方法如OSG算法受限于较差的近似保证和对全连接通信图的刚性要求。为此,我们提出MA-OSMA算法,利用多线性扩展将离散子模最大化转化为连续优化,通过共识技术减少对完全图的依赖;同时引入新型代理梯度以避开次优驻点。为消除MA-OSMA中计算昂贵的投影操作,我们进一步提出无投影的MA-OSEA算法,通过混合均匀分布有效利用KL散度。理论上,两者均实现关于历史最优解的$ ilde{O}( rac{C_T T}{1-eta})$遗憾界,逼近比达到$( rac{1-e^{-c}}{c})$,其中$C_T$为最大化序列偏差,$eta$为网络谱隙,$c$为子模目标的联合曲率。该结果显著优于当前最优算法的$( rac{1}{1+c})$逼近比。最后,仿真验证了算法在多目标追踪任务中的有效性。

原文摘要 · Abstract (English)

Coordinating multiple agents to collaboratively maximize submodular functions in unpredictable environments is a critical task with numerous applications in machine learning, robot planning and control. The existing approaches, such as the OSG algorithm, are often hindered by their poor approximation guarantees and the rigid requirement for a fully connected communication graph. To address these challenges, we firstly present a $\textbf{MA-OSMA}$ algorithm, which employs the multi-linear extension to transfer the discrete submodular maximization problem into a continuous optimization, thereby allowing us to reduce the strict dependence on a complete graph through consensus techniques. Moreover, $\textbf{MA-OSMA}$ leverages a novel surrogate gradient to avoid sub-optimal stationary points. To eliminate the computationally intensive projection operations in $\textbf{MA-OSMA}$, we also introduce a projection-free $\textbf{MA-OSEA}$ algorithm, which effectively utilizes the KL divergence by mixing a uniform distribution. Theoretically, we confirm that both algorithms achieve a regret bound of $\widetilde{O}(\sqrt{\frac{C_{T}T}{1-β}})$ against a $(\frac{1-e^{-c}}{c})$-approximation to the best comparator in hindsight, where $C_{T}$ is the deviation of maximizer sequence, $β$ is the spectral gap of the network and $c$ is the joint curvature of submodular objectives. This result significantly improves the $(\frac{1}{1+c})$-approximation provided by the state-of-the-art OSG algorithm. Finally, we demonstrate the effectiveness of our proposed algorithms through simulation-based multi-target tracking.

多智能体子模优化在线学习通信效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。