让私有模型在不共享数据的情况下协同推理,保护隐私同时提升性能。
Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving
- 提出联邦推理新范式,支持私有模型在推理时协作。
- 验证隐私约束下协作可带来显著性能提升。
- 适合关注隐私保护与模型协同的系统设计者。
联邦推理(Federated Inference, FI)研究独立训练且私有持有的模型如何在推理阶段协同工作,而无需共享数据或模型参数。尽管已有研究从不同角度探索安全分布式推理,但缺乏对FI的统一抽象与系统理解。本文将FI定位为一种区别于联邦学习的协同范式,识别出其可行性两大核心要求:推理时隐私保护与通过协作实现有意义的性能提升。我们将FI形式化为一种受保护的协同计算,分析其核心设计维度,并考察在推理阶段同时存在隐私约束、非独立同分布数据及观测受限时产生的结构性权衡。通过具体实例与实证分析,我们揭示了隐私保护推理、基于集成的协作以及激励对齐中的关键摩擦点。研究发现,FI展现出无法直接继承自训练阶段联邦或经典集成方法的系统级行为。本文提供了对FI的统一视角,并指出了实现实用、可扩展、隐私保护的协同推理系统所必须解决的开放挑战。
原文摘要 · Abstract (English)
Federated Inference (FI) studies how independently trained and privately owned models can collaborate at inference time without sharing data or model parameters. While recent work has explored secure and distributed inference from disparate perspectives, a unified abstraction and system-level understanding of FI remain lacking. This paper positions FI as a distinct collaborative paradigm, complementary to federated learning, and identifies two fundamental requirements that govern its feasibility: inference-time privacy preservation and meaningful performance gains through collaboration. We formalize FI as a protected collaborative computation, analyze its core design dimensions, and examine the structural trade-offs that arise when privacy constraints, non-IID data, and limited observability are jointly imposed at inference time. Through a concrete instantiation and empirical analysis, we highlight recurring friction points in privacy-preserving inference, ensemble-based collaboration, and incentive alignment. Our findings suggest that FI exhibits system-level behaviors that cannot be directly inherited from training-time federation or classical ensemble methods. Overall, this work provides a unifying perspective on FI and outlines open challenges that must be addressed to enable practical, scalable, and privacy-preserving collaborative inference systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。