提出事件驱动在线垂直联邦学习框架,解决数据异步更新难题
Event-Driven Online Vertical Federated Learning
- 按事件触发部分客户端激活,其余静默协作
- 引入动态局部遗憾机制,非凸模型下稳定性能提升30%以上
- 适合实时数据流场景,显著降低通信与计算开销
在线学习在垂直联邦学习(VFL)中比离线学习更适应真实场景。然而,由于客户端共享同一实体但特征集不重叠,将在线学习引入VFL面临挑战。现实中,数据通常由仅关联部分客户端的事件生成,而非同步到达。本文首次识别这一问题,提出事件驱动的在线VFL框架:每个事件仅激活部分客户端,其余被动参与。同时引入动态局部遗憾(DLR),应对非凸模型在非平稳环境中的挑战。我们对框架进行了全面的遗憾分析,证明其在非凸条件下具备稳定性。大量实验表明,在非平稳数据下,该框架比现有方法更稳定,且通信与计算成本显著降低。
原文摘要 · Abstract (English)
Online learning is more adaptable to real-world scenarios in Vertical Federated Learning (VFL) compared to offline learning. However, integrating online learning into VFL presents challenges due to the unique nature of VFL, where clients possess non-intersecting feature sets for the same sample. In real-world scenarios, the clients may not receive data streaming for the disjoint features for the same entity synchronously. Instead, the data are typically generated by an \emph{event} relevant to only a subset of clients. We are the first to identify these challenges in online VFL, which have been overlooked by previous research. To address these challenges, we proposed an event-driven online VFL framework. In this framework, only a subset of clients were activated during each event, while the remaining clients passively collaborated in the learning process. Furthermore, we incorporated \emph{dynamic local regret (DLR)} into VFL to address the challenges posed by online learning problems with non-convex models within a non-stationary environment. We conducted a comprehensive regret analysis of our proposed framework, specifically examining the DLR under non-convex conditions with event-driven online VFL. Extensive experiments demonstrated that our proposed framework was more stable than the existing online VFL framework under non-stationary data conditions while also significantly reducing communication and computation costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。