解决跨客户端与节点级模态缺失问题,提升联邦图学习效果
Towards Modality-imbalanced Federated Graph Learning: A Data Synthesis-based Approach

- 在表示空间中直接合成缺失模态语义,保持原数据分布一致性
- 在四个任务上性能超越基线,最高提升17.41%,效率与效果平衡
- 适合存在数据不完整或模态缺失的分布式多模态图学习场景
多模态联邦图学习(MM-FGL)提供了一种自然的协作训练范式,但其实际部署面临两种粒度的模态不平衡挑战:客户端级不平衡指某些客户端缺少完整模态,节点级不平衡指个别节点缺失视觉或文本属性。尽管已有相关研究,但多数针对非图或集中式场景,难以直接适配。为此,我们把模态不平衡的MM-FGL形式化为隐式图感知的潜在语义表示合成问题,直接在表示空间恢复缺失模态语义,最大化与原始数据语义分布对齐,并缓解因模态缺失带来的高方差。为此提出FedMGS(联邦模态感知图合成),包含三个核心组件:可用性感知图编码器防止缺失模态污染局部结构传播;原型引导的潜在语义合成器为缺失模态建立跨客户端语义锚点;可靠性校准的语义融合机制在预测前调节恢复的潜在表示影响。在四个任务上的大量实验表明,FedMGS持续优于对比基线,性能提升最高达17.41%,且具备最佳效率-性能权衡。
原文摘要 · Abstract (English)
MultiModal Federated Graph Learning (MM-FGL) offers a natural collaborative training paradigm, but its practical deployment is challenged by two granularities of modality imbalance. Client-level imbalance occurs when certain clients lack entire modalities, while node-level imbalance occurs when individual nodes exhibit missing visual or textual attributes. While several relevant studies exist, our investigation reveals that they predominantly target graph-agnostic or centralized scenarios, rendering them difficult to adapt directly. To address these challenges, we formalize modality-imbalanced MM-FGL as an implicit graph-aware latent semantic representation synthesis problem. This paradigm recovers missing modal semantics directly within the representation space, thereby maximizing alignment with the original data's semantic distribution and mitigating the high variance induced by missing modalities. To this end, we propose FedMGS (Federated Modality-aware Graph Synthesis), which integrates three core components. The availability-aware graph encoder prevents missing modalities from contaminating local structural propagation. The prototype-guided latent semantic synthesizer establishes cross-client semantic anchors for unavailable modalities. The reliability-calibrated semantic fusion mechanism regulates the impact of recovered latent representations prior to predictive readout. Extensive experiments on four tasks show that FedMGS consistently outperforms competitive baselines with gains up to 17.41% with best efficiency-performance tradeoff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。