动态边缘网络下优化垂直联邦学习服务器部署,兼顾性能与资源消耗。
Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks

- 联合优化服务器位置、传输功率等四个控制变量
- 实现比贪心方法更优的分类/回归性能与资源节省
- 适用于边缘计算中数据特征异构且动态变化的场景
本文研究在动态边缘/雾网络中,针对垂直联邦学习(VFL)的控制与优化问题。由于边缘/雾设备间数据特征和硬件异构,各设备对VFL的贡献差异显著,且动态网络可能导致部分数据特征永久退出或加入。为此,提出服务器控制的动态网络垂直联邦学习(SC-DN)方法:首先证明每轮全局训练存在全局一阶平稳点,进而基于四个关键控制变量——服务器位置、设备到服务器传输功率、本地设备处理器频率、每轮全局训练迭代次数——联合优化模型训练与资源消耗。优化模型包含耦合变量及多种对数约束,被证明为混合整数符号规划(MISDP),属于NP难问题,并设计通用求解器。在图像与多模态数据集上的实验表明,该方法在分类/回归性能与资源消耗方面均优于贪心策略。
原文摘要 · Abstract (English)
We investigate the control and optimization of vertical federated learning (VFL), a class of distributed machine learning (ML) methods in which edge/fog devices contain separate data features, in dynamic edge/fog networks. Owing to heterogeneous data features and hardware across edge/fog networks, devices' contributions to VFL vary substantially, and, moreover, dynamic edge/fog networks can lead to the permanent exit or entry of select data features. In this setting, our proposed methodology, server controlled VFL in dynamic networks (SC-DN), first establishes the existence of a global first-order stationary point for every global round, and then leverages this result to jointly optimize ML model training and resource consumption based on four key control variables: (i) server placement, (ii) device-to-server transmit power, (iii) local device processor frequency, and (iv) local training iterations per global round. The resulting optimization formulation contains coupled variables as well as numerous forms of logarithmic constraints which we show is a mixed-integer signomial program, an NP-hard problem, and for which we develop a general solver. Finally, via experiments on both image and multi-modal datasets, we show that our methodology demonstrates superior classification/regression performance and resource consumption savings than even greedy methodologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。