解决联邦多视图学习中特征维度差异导致的模型偏差问题
FedMSGL: A Self-Expressive Hypergraph Based Federated Multi-View Learning
- 用自表达机制在本地学习统一维度子空间,捕捉样本间潜在关系
- 中心端自适应融合各视图信息,构建超图建模跨视图复杂关联
- 在不同维度的多视图数据上验证了性能提升,适合异构数据场景
联邦学习能在保护数据隐私和安全的前提下,实现分散数据源间的协同模型训练,降低集中式数据收集的风险及数据权属与合规性担忧。尽管联邦学习算法在缓解通信瓶颈和增强隐私保护方面取得进展,但现有方法忽视了数据特征维度差异的影响,导致全局模型过度依赖高维参与方。同时,传统单视图联邦学习无法充分捕捉多视图数据的独特特性,影响处理效果。为此,本文提出基于自表达超图的联邦多视图学习方法(FedMSGL)。该方法在本地训练中利用自表达特性,学习具有潜在样本关系的统一维度子空间;在中心端采用自适应融合策略生成全局模型,并基于学习到的全局与视图特异性子空间构建超图,以捕捉跨视图的复杂连接。在具有不同特征维度的多视图数据集上的实验验证了所提方法的有效性。
原文摘要 · Abstract (English)
Federated learning is essential for enabling collaborative model training across decentralized data sources while preserving data privacy and security. This approach mitigates the risks associated with centralized data collection and addresses concerns related to data ownership and compliance. Despite significant advancements in federated learning algorithms that address communication bottlenecks and enhance privacy protection, existing works overlook the impact of differences in data feature dimensions, resulting in global models that disproportionately depend on participants with large feature dimensions. Additionally, current single-view federated learning methods fail to account for the unique characteristics of multi-view data, leading to suboptimal performance in processing such data. To address these issues, we propose a Self-expressive Hypergraph Based Federated Multi-view Learning method (FedMSGL). The proposed method leverages self-expressive character in the local training to learn uniform dimension subspace with latent sample relation. At the central side, an adaptive fusion technique is employed to generate the global model, while constructing a hypergraph from the learned global and view-specific subspace to capture intricate interconnections across views. Experiments on multi-view datasets with different feature dimensions validated the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。