联邦回归中提升多模态数据特征提取效果,解决数据异构与信息丢失问题。
FDRMFL: Multimodal Federated Feature Extraction Model Based on Information Maximization and Contrastive Learning
- 融合互信息与对比学习,设计四部分目标函数优化特征提取。
- 在合成与真实近红外光谱数据上,均方误差降低超30%以上。
- 适合处理非独立同分布的多模态联邦学习场景,如医疗或工业检测。
我们提出FDRMFL,一种面向非独立同分布数据下联邦回归任务的多模态特征提取框架。从高维多模态输入中提取预测性特征在该场景下尤为困难:数据无法离开客户端,本地样本稀少且分布异质,无监督降维会丢弃任务相关信号,而联邦训练又引入跨通信轮次的表示漂移。FDRMFL通过统一的四部分局部目标函数解决这些问题:均方误差预测损失、基于相关性的互信息代理项以保留融合表征与连续目标间的依赖关系、对称KL散度惩罚项以在融合前对齐跨模态隐空间分布,以及类InfoNCE的对比损失以将本地表征锚定于全局共识。在三个合成数据集和两个真实世界近红外光谱数据集上的实验表明,各组件均有贡献。相比最佳传统基线(PCA),FDRMFL在模拟中平均误差降低33.8%,相比VAE降低43.0%,并在包括FedAvg、FedProx、MOON、SCAFFOLD和FedBN在内的六种联邦算法中达到最低整体平均均方误差。
原文摘要 · Abstract (English)
We propose FDRMFL, a task-driven multimodal feature extraction framework for federated regression under non-IID data distributions. Extracting predictive features from high-dimensional multimodal inputs is particularly challenging in this setting: data cannot leave each client, local samples are scarce and heterogeneously distributed, and unsupervised dimensionality reduction discards task-relevant information while federated training introduces representation drift across communication rounds. FDRMFL addresses these challenges through a unified four-term local objective: MSE prediction loss, a correlation-based mutual information surrogate that preserves dependence between the fused representation and the continuous target, a symmetric KL penalty that aligns cross-modal latent distributions before fusion, and an InfoNCE-style contrastive loss that anchors local representations to the global consensus. Experiments on three synthetic and two real-world near-infrared spectroscopy datasets under non-IID federated partitions, with comprehensive ablation and sensitivity analyses, demonstrate that each component contributes to the framework's effectiveness. FDRMFL reduces mean MSE by 33.8% relative to the best traditional baseline (PCA) and by 43.0% relative to VAE in simulation, and attains the lowest overall mean MSE among six federated algorithms including FedAvg, FedProx, MOON, SCAFFOLD, and FedBN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。