arXiv:2605.08343cs.LGcs.CR2026-05

提出混合架构,让时间序列联合推理既快又私密。

Private Vertical Federated Inference for Time-Series

论文配图:Private Vertical Federated Inference for Time-Series
图 1 · 摘自论文原文
  • 模型头分公私两部分,公头明文计算,私头用轻量MPC加密。
  • 比全链路MPC快六倍,通信量从1.7GB降至19MB每批次。
  • 适合需高隐私、大模型的跨机构时序数据分析场景。

机构在保护隐私的前提下可协作进行时间序列推理。多方计算(MPC)虽能提供强隐私保障,但对现代Transformer架构而言代价过高且扩展性差。垂直联邦学习(VFL)效率高,但在嵌入层存在隐私泄露风险,而用MPC保护整个模型头仍过于缓慢且通信开销大。为此,我们提出“公/私混合头-VFL”(PPHH-VFL):将模型头拆分为高效明文的公共头与安全轻量的MPC私有头。通过对抗训练优化公共嵌入,缓解隐私泄露;同时小规模私有头确保敏感信息安全传递,维持下游任务性能。在高达8600万参数的模型上评估显示,相较端到端MPC,PPHH-VFL推理速度提升达六数量级;相比标准VFL+MPC基线,广域网(WAN)下加速44.4倍,通信成本降低91.2%(每批次从1.7 GB降至19 MB),同时分类准确率提升2.50%,回归RMSE改善40.7%。

原文摘要 · Abstract (English)

Institutions may benefit from collaborative inference on time-series data. In settings where privacy is necessary, multi-party computation (MPC) is a straightforward approach to providing strong guarantees, yet it remains prohibitively expensive and scales poorly with modern transformer architectures. Vertical Federated Learning (VFL) offers efficiency but suffers from privacy leakage at the embedding level, and securing the entire VFL model head via MPC remains prohibitively slow and communication-heavy for larger models. To enable practical, secure inference at scale, we propose "Public/Private Hybrid Head-VFL" (PPHH-VFL). This hybrid architecture splits the model head into an efficient plaintext public head and a secure, lightweight MPC private head. By applying adversarial training to the public embeddings, we mitigate privacy leakage; concurrently, the small private head securely preserves the flow of sensitive information needed for high downstream utility. Empirical evaluations on models ranging up to 86 million parameters demonstrate that PPHH-VFL accelerates inference by up to six orders of magnitude compared to end-to-end MPC. Compared to a standard VFL+MPC baseline, our approach scales significantly better, achieving a speedup of up to 44.4x in WAN and a 91.2x reduction in communication costs (dropping from 1.7 GB to 19 MB per batch), while simultaneously improving downstream classification accuracy by 2.50% and regression RMSE by 40.7%.

联邦学习隐私计算时序分析MPC

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。