发现联邦图学习中聚合会稀释关键参数信号,提出轻量级改进方法提升性能。
Dissecting Federated-Graph Aggregation under Domain Shift: Importance-Aware Aggregation via Empirical Analysis
- 分析客户端图域偏移对服务器聚合的影响,揭示信号稀释机制
- 在Twitch Gamers和WikiNet上提升最多11.58个百分点,尤其在数据偏斜时更明显
- 无需修改客户端训练,仅调整服务器端参数选择与加权,适合实际部署
联邦图学习(FGL)在保持原始图数据去中心化的同时,于各客户端间协同训练共享图模型。由于客户端局部图在节点特征、标签和连接性上存在差异,图域偏移会严重损害全局模型性能。现有方法多聚焦于本地表示、传播或图衍生协作的适应,而服务器通常对所有参数坐标采用统一聚合规则。本文通过实证分析发现:在不同图域条件下优化时,客户端逐渐将最强更新集中于不同的参数坐标,导致重要更新坐标在客户端间共享度下降。标准平均操作因此削弱了这些具有领域特性的信号,即使更新方向不冲突。这一现象揭示了‘聚合引起的信号稀释’效应——仅部分领域强烈表达的参数坐标,会被其余领域的近零贡献所抑制。基于此,我们提出轻量级服务器端聚合方法FedIA,通过识别每层的重要参数坐标,并根据其在选定子空间上的贡献动态调整客户端权重,无需改变本地图训练或标准客户端更新负载。在Twitch Gamers和WikiNet上,使用两种图学习主干网络及九种联邦/联邦图基线,实验显示最高提升达11.58个百分点,尤其在域偏斜条件下表现突出。
原文摘要 · Abstract (English)
Federated graph learning (FGL) trains a shared graph model across clients whose local graphs differ in node features, labels, and connectivity while keeping raw graph data decentralized. Although graph-domain shifts across clients can severely degrade the global model, existing FGL approaches for graph-domain shift mainly adapt local representations, propagation, or graph-derived collaboration, while the server typically applies the same aggregation rule to every parameter coordinate. In this work, we analyze how graph-domain shifts affect server-side aggregation. We find that, as clients optimize under distinct graph-domain conditions, they gradually concentrate their strongest updates on different parameter coordinates, making important update coordinates less shared across clients. Consequently, standard averaging can weaken these domain-specific signals even when client updates are not directly opposed. These findings reveal an aggregationinduced signal dilution effect: parameter coordinates strongly expressed by only a subset of domains are attenuated by nearzero contributions from the remaining domains. Motivated by these findings, we propose FedIA, a lightweight serverside aggregation method that calibrates parameter selection and client weighting. FedIA identifies important coordinates =within each layer and adjusts client aggregation weights according to their contributions on the selected subspace, without modifying local graph training or the standard clientupdate payload. Experiments on Twitch Gamers and WikiNet using two graph-learning backbones and nine FL/FGL baselines show improvements of up to 11.58 percentage points, with particularly strong gains under domain skew.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。