用共享评估提升多任务学习中关键伙伴的识别效率
Semi-overlapping Multi-bandit Best Arm Identification for Sequential Support Network Learning
- 提出半重叠多臂老虎机模型,利用任务间共享结构实现高效评估
- 新算法误差界改进常数项,样本复杂度随重叠度线性下降
- 适用于多任务、联邦学习等场景,理论性能更优
许多现代人工智能与机器学习问题需通过共享但不对称、计算密集的流程评估合作方贡献,并同时选择最优候选者。这类问题可统一为序列支持网络学习(SSNL)框架,目标是通过试错学习一个代表最优贡献的有向图。本文提出一种新型纯探索模型——半重叠多臂老虎机(SOMMAB),其中单次评估可为多个老虎机提供不同反馈,因各臂存在结构重叠。我们开发了SOMMAB的广义GapE算法,推导出新的指数型误差界,改进了多臂老虎机最优臂识别中最优常数项。该界与重叠度呈线性关系,揭示了共享评估带来的显著样本复杂度优势。从应用角度看,本工作为多任务学习(MTL)、辅助任务学习(ATL)、联邦学习(FL)及多智能体系统(MAS)中从稀疏候选列表中识别支持网络提供了理论基础与更强的性能保证。
原文摘要 · Abstract (English)
Many modern AI and ML problems require evaluating partners' contributions through shared yet asymmetric, computationally intensive processes and the simultaneous selection of the most beneficial candidates. Sequential approaches to these problems can be unified under a new framework, Sequential Support Network Learning (SSNL), in which the goal is to select the most beneficial candidate set of partners for all participants using trials; that is, to learn a directed graph that represents the highest-performing contributions. We demonstrate that a new pure-exploration model, the semi-overlapping multi-(multi-armed) bandit (SOMMAB), in which a single evaluation provides distinct feedback to multiple bandits due to structural overlap among their arms, can be used to learn a support network from sparse candidate lists efficiently. We develop a generalized GapE algorithm for SOMMABs and derive new exponential error bounds that improve the best known constant in the exponent for multi-bandit best-arm identification. The bounds scale linearly with the degree of overlap, revealing significant sample-complexity gains arising from shared evaluations. From an application point of view, this work provides a theoretical foundation and improved performance guarantees for sequential learning tools for identifying support networks from sparse candidates in multiple learning problems, such as in multi-task learning (MTL), auxiliary task learning (ATL), federated learning (FL), and in multi-agent systems (MAS).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。