arXiv:2410.21764cs.LGcs.AI2024-10被引 5

提出自适应在线镜方法,解决多目标学习中权衡难收敛问题。

Adaptive Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Learning

  • 用自适应在线转批量策略优化极小极大形式的切比雪夫标量化
  • 收敛速度达 $\mathcal O(\sqrt{\log m/T})$,对目标数 $m$ 依赖更紧
  • 适用于需个性化解、公平解的联邦学习等场景

多目标学习旨在处理多个可能冲突的目标并实现合理平衡。现有偏好引导方法常依赖额外优化目标或约束,而本文采用经典的切比雪夫标量化(TCH),可自然实现用户指定的权衡。由于其极小极大形式,直接优化TCH常导致训练震荡与停滞。为此,我们提出针对TCH的自适应在线镜下降算法(Ada)OMD-TCH。核心在于一种自适应在线转批量转换机制,在保持相同理论收敛性的同时显著提升实际解的最优性。理论证明(Ada)OMD-TCH在离线设置下达到 $\mathcal O(\sqrt{\log m/T})$ 的收敛率,对目标数 $m$ 的依赖优于现有工作。实验表明,该方法在合成任务和联邦学习中均有效平滑训练过程,并生成偏好引导、特定、多样且公平的解。

原文摘要 · Abstract (English)

Multi-objective learning (MOL) aims to learn under multiple potentially conflicting objectives and strike a proper balance. While recent preference-guided MOL methods often rely on additional optimization objectives or constraints, we consider the classic Tchebycheff scalarization (TCH) that naturally allows for locating solutions with user-specified trade-offs. Due to its minimax formulation, directly optimizing TCH often leads to training oscillation and stagnation. In light of this limitation, we propose an adaptive online mirror descent algorithm for TCH, called (Ada)OMD-TCH. One of our main ingredients is an adaptive online-to-batch conversion that significantly improves solution optimality over traditional conversion in practice while maintaining the same theoretical convergence guarantees. We show that (Ada)OMD-TCH achieves a convergence rate of $\mathcal O(\sqrt{\log m/T})$, where $m$ is the number of objectives and $T$ is the number of rounds, providing a tighter dependency on $m$ in the offline setting compared to existing work. Empirically, we demonstrate on both synthetic problems and federated learning tasks that (Ada)OMD-TCH effectively smooths the training process and yields preference-guided, specific, diverse, and fair solutions.

多目标学习切比雪夫标量化在线优化联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。