为跨组织联邦学习设计易用架构,解决实际落地难题
FL-APU: A Software Architecture to Ease Practical Implementation of Cross-Silo Federated Learning
- 基于场景的软件架构,支持多方安全协作训练
- 集成治理与认证,确保只有可信方能参与
- 提供决策可追溯与训练过程追踪,适合生产环境
联邦学习(FL)正被越来越多地应用于真实场景。早期应用多聚焦于跨设备场景,如 Google GBoard 的分布式模型训练;而跨域场景参与者较少但资源丰富,例如医疗领域。尽管已有初步探索,但联邦学习在实际中的应用仍十分有限,缺乏最佳实践。针对跨组织的跨域应用,克服缺乏范例的挑战尤为关键。为此,本文提出一种面向多企业协作提升机器学习模型质量的联邦学习实用化架构。该架构强调参与者与联邦服务器间的协作,通过加入领域特定功能扩展基础交互:首先,将治理与认证结合,构建仅允许可信参与者加入的环境;其次,支持治理决策的可追溯性及训练过程的追踪,这对生产环境至关重要。除了呈现架构设计,还分析了联邦学习在真实世界应用的需求,并通过场景化分析方法评估了该架构的有效性。
原文摘要 · Abstract (English)
Federated Learning (FL) is an upcoming technology that is increasingly applied in real-world applications. Early applications focused on cross-device scenarios, where many participants with limited resources train machine learning (ML) models together, e.g., in the case of Google's GBoard. Contrarily, cross-silo scenarios have only few participants but with many resources, e.g., in the healthcare domain. Despite such early efforts, FL is still rarely used in practice and best practices are, hence, missing. For new applications, in our case inter-organizational cross-silo applications, overcoming this lack of role models is a significant challenge. In order to ease the use of FL in real-world cross-silo applications, we here propose a scenario-based architecture for the practical use of FL in the context of multiple companies collaborating to improve the quality of their ML models. The architecture emphasizes the collaboration between the participants and the FL server and extends basic interactions with domain-specific features. First, it combines governance with authentication, creating an environment where only trusted participants can join. Second, it offers traceability of governance decisions and tracking of training processes, which are also crucial in a production environment. Beyond presenting the architectural design, we analyze requirements for the real-world use of FL and evaluate the architecture with a scenario-based analysis method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。