提出基于网络结构的个性化联邦学习方法,实现隐私保护下的高效协同建模。
Federated Learning: From Theory to Practice
- 将设备视为网络节点,通过数据相似性构建通信边,实现模型参数共享
- 采用广义总变差最小化优化框架,使相似任务设备学习相近模型参数
- 适合想构建可扩展隐私保护系统的工程师和研究人员
本书提供了一个关于构建和理解联邦学习(FL)系统的实践指南。FL允许多个设备(如智能手机、传感器或本地计算机)在不集中数据的前提下协同训练机器学习模型,是应对隐私、监管或技术限制时的理想方案。本书聚焦个性化:在保持各设备独立建模的同时,通过相关设备间的协作提升性能。核心思想是将真实世界中的FL系统建模为设备网络,其中节点代表设备,边表示通信链接及数据相似性。在此框架下,个性化模型训练被自然表述为分布式优化问题,即广义总变差最小化(GTVMin),确保具有相似学习任务的设备学习相似的模型参数。该方法兼具数学严谨性和实际可行性,虽引入优化理论与图学习的先进概念,但注重可读性,以逐步引导的方式讲解核心思想,辅以直观解释。
原文摘要 · Abstract (English)
This book offers a hands-on introduction to building and understanding federated learning (FL) systems. FL enables multiple devices -- such as smartphones, sensors, or local computers -- to collaboratively train machine learning (ML) models, while keeping their data private and local. It is a powerful solution when data cannot or should not be centralized due to privacy, regulatory, or technical reasons. The book is designed for students, engineers, and researchers who want to learn how to design scalable, privacy preserving FL systems. Our main focus is on personalization: enabling each device to train its own model while still benefiting from collaboration with relevant devices. This is achieved by leveraging similarities between (the learning tasks associated with) devices that are encoded by the weighted edges (or links) of a federated learning network (FL network). The key idea is to represent real-world FL systems as networks of devices, where nodes correspond to device and edges represent communication links and data similarities between them. The training of personalized models for these devices can be naturally framed as a distributed optimization problem. This optimization problem is referred to as generalized total variation minimization (GTVMin) and ensures that devices with similar learning tasks learn similar model parameters. Our approach is both mathematically principled and practically motivated. While we introduce some advanced ideas from optimization theory and graph-based learning, we aim to keep the book accessible. Readers are guided through the core ideas step by step, with intuitive explanations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。