arXiv:2605.05718cs.LG2026-05

无需共享数据或参数,让多个模型在推理时协作提升性能。

Enabling Federated Inference via Unsupervised Consensus Embedding

论文配图:Enabling Federated Inference via Unsupervised Consensus Embedding
图 1 · 摘自论文原文
  • 通过无监督对齐异构中间表示,构建统一嵌入空间。
  • 在CIFAR-10/100上优于单独推理,接近需共享参数的方法。
  • 适合隐私敏感场景,支持跨组织模型协作。

在分布式环境中,多个独立部署的模型协同推理的需求日益增长,但现有框架通常依赖共享输入数据、模型参数或通用编码器,限制了其在隐私敏感或跨组织场景中的应用。为此,我们提出共识嵌入联邦推理(CE-FI)框架,使预训练模型在推理阶段无需共享模型参数或原始输入,也无需假设存在共同编码器即可协同工作。该框架包含两个组件:共识嵌入(CE)层将异构中间表示映射到统一嵌入空间;协作输出(CO)层基于这些嵌入生成预测。两个模块仅使用共享的无标签数据进行训练,因此协同阶段无需额外标注数据。在图像分类基准(CIFAR-10 和 CIFAR-100)下,多种非独立同分布条件中,CE-FI始终优于单模型推理,且表现可媲美需更强共享假设的传统方法。在文本和时间序列任务上的扩展评估表明其适用性更广,但性能依赖于集成策略。进一步分析指出表示对齐是主要瓶颈。

原文摘要 · Abstract (English)

Cooperative inference across independently deployed machine learning models is increasingly desirable in distributed environments, as there is a growing need to leverage multiple models while keeping their data and model parameters private. However, existing cooperative frameworks typically rely on sharing input data, model parameters, or a common encoder, which limits their applicability in privacy-sensitive or cross-organizational settings. To address this challenge, we propose Consensus Embedding-based Federated Inference (CE-FI), a framework that enables pretrained models to cooperate at inference time without sharing model parameters or raw inputs and without assuming a common encoder. CE-FI introduces two components: a Consensus Embedding (CE) layer that maps heterogeneous intermediate representations into a common embedding space, and a Cooperative Output (CO) layer that produces predictions from these embeddings. Both layers are trained using shared unlabeled data only, so the cooperative stage does not require additional labeled data. Experiments on image classification benchmarks -- CIFAR-10 and CIFAR-100 -- under diverse non-IID conditions show that CE-FI consistently outperforms solo inference and performs comparably to conventional methods that require stronger sharing assumptions. Additional evaluations on text and time-series tasks indicate applicability beyond image classification, although performance depends on the ensemble strategy. Further analysis identifies representation alignment as the primary bottleneck.

联邦学习模型协同无监督学习隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。