arXiv:2602.12708cs.LG2026-02

解决垂直联邦学习中数据对齐难题,提升隐私保护下的模型性能。

Mixture of Predefined Experts: Maximizing Data Usage on Vertical Federated Learning

  • 用预定义专家架构处理数据不对齐问题,无需样本完全重合。
  • 单轮通信即达顶尖效果,通信量大幅降低。
  • 抗恶意节点、可解释每样本贡献,适合高隐私要求场景。

垂直联邦学习(VFL)在金融、医疗等隐私敏感领域成为关键协作训练范式。然而,现有框架多依赖参与者间完全样本对齐的理想假设,这在真实场景中极少成立。为此,本文提出Split-MoPE,将分层学习与专用预定义专家混合架构(MoPE)结合。不同于动态路由的MoE,MoPE使用预设专家处理特定数据对齐情况,有效在训练和推理中最大化数据利用率,无需完整样本重叠。通过利用目标数据域的预训练编码器,Split-MoPE在单轮通信下达到业界最优性能,显著减少多轮端到端训练的通信开销。此外,该架构天然具备对抗恶意或噪声参与者的鲁棒性,并能量化每个合作者对每条预测的贡献,实现逐样本可解释性。在视觉(CIFAR-10/100)和表格数据(乳腺癌威斯康星)上的大量实验表明,Split-MoPE在高数据缺失等挑战场景下持续优于激光(LASER)和垂直分层神经网络(Vertical SplitNN)等先进系统。

原文摘要 · Abstract (English)

Vertical Federated Learning (VFL) has emerged as a critical paradigm for collaborative model training in privacy-sensitive domains such as finance and healthcare. However, most existing VFL frameworks rely on the idealized assumption of full sample alignment across participants, a premise that rarely holds in real-world scenarios. To bridge this gap, this work introduces Split-MoPE, a novel framework that integrates Split Learning with a specialized Mixture of Predefined Experts (MoPE) architecture. Unlike standard Mixture of Experts (MoE), where routing is learned dynamically, MoPE uses predefined experts to process specific data alignments, effectively maximizing data usage during both training and inference without requiring full sample overlap. By leveraging pretrained encoders for target data domains, Split-MoPE achieves state-of-the-art performance in a single communication round, significantly reducing the communication footprint compared to multi-round end-to-end training. Furthermore, unlike existing proposals that address sample misalignment, this novel architecture provides inherent robustness against malicious or noisy participants and offers per-sample interpretability by quantifying each collaborator's contribution to each prediction. Extensive evaluations on vision (CIFAR-10/100) and tabular (Breast Cancer Wisconsin) datasets demonstrate that Split-MoPE consistently outperforms state-of-the-art systems such as LASER and Vertical SplitNN, particularly in challenging scenarios with high data missingness.

联邦学习数据对齐专家混合隐私计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。