arXiv:2505.20648cs.LGcs.AI2025-05ICML被引 2

用沃罗诺伊网格优化多目标学习,提升联邦学习解集覆盖度。

Voronoi-grid-based Pareto Front Learning and Its Application to Collaborative Federated Learning

  • 基于沃罗诺伊网格划分高维空间,结合遗传算法优化采样分布。
  • 在多个任务上显著提升帕累托前沿覆盖率,HV指标提升23%以上。
  • 适合需要高效多目标优化的联邦学习研究者使用。

多目标优化(MOO)在机器学习中广泛应用,旨在寻找一组帕累托最优解,即帕累托前沿。帕累托前沿学习(PFL)利用超网络(PHN)近似该前沿,实现从偏好向量到前沿解的映射。然而现有方法面临两大挑战:高维空间采样射线效率低;难以覆盖凸形帕累托前沿。本文提出新框架PHN-HVVS,将设计空间划分为沃罗诺伊网格,并引入遗传算法(GA)进行高维空间网格划分。提出新型损失函数,有效扩大帕累托前沿覆盖范围并最大化超体积(HV)指标。在多个多目标机器学习任务上的实验表明,PHN-HVVS显著优于基线方法。此外,该方法推动了联邦学习中若干近期问题的解决。代码已开源:https://github.com/buptcmm/phnhvvs

原文摘要 · Abstract (English)

Multi-objective optimization (MOO) exists extensively in machine learning, and aims to find a set of Pareto-optimal solutions, called the Pareto front, e.g., it is fundamental for multiple avenues of research in federated learning (FL). Pareto-Front Learning (PFL) is a powerful method implemented using Hypernetworks (PHNs) to approximate the Pareto front. This method enables the acquisition of a mapping function from a given preference vector to the solutions on the Pareto front. However, most existing PFL approaches still face two challenges: (a) sampling rays in high-dimensional spaces; (b) failing to cover the entire Pareto Front which has a convex shape. Here, we introduce a novel PFL framework, called as PHN-HVVS, which decomposes the design space into Voronoi grids and deploys a genetic algorithm (GA) for Voronoi grid partitioning within high-dimensional space. We put forward a new loss function, which effectively contributes to more extensive coverage of the resultant Pareto front and maximizes the HV Indicator. Experimental results on multiple MOO machine learning tasks demonstrate that PHN-HVVS outperforms the baselines significantly in generating Pareto front. Also, we illustrate that PHN-HVVS advances the methodologies of several recent problems in the FL field. The code is available at https://github.com/buptcmm/phnhvvs}{https://github.com/buptcmm/phnhvvs.

多目标优化联邦学习帕累托前沿超网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。