arXiv:2410.13141cs.LGphysics.comp-ph2024-10被引 13

联邦学习+科学机器学习,解决异构数据下方程求解难题

Federated scientific machine learning for approximating functions and solving differential equations with data heterogeneity

  • 提出FedPINN和FedDeepONet,实现跨设备协同求解微分方程
  • 实验表明方法在异构数据下性能优于本地训练,接近集中式模型
  • 首次量化数据异质性并建立权重偏差理论边界,适合隐私敏感场景

借助神经网络,科学机器学习(SciML)为求解由偏微分方程(PDEs)支配的复杂问题提供了新途径。实际应用中,数据分散、隐私顾虑或大规模数据传输不现实等问题带来挑战。联邦学习(FL)作为一种去中心化框架,可在保护数据隐私的前提下协同训练全局模型,有效应对孤立数据源与敏感数据问题。本文探索将联邦学习与科学机器学习融合,用于逼近复杂函数与求解微分方程。提出两种新模型:联邦物理信息神经网络(FedPINN)和联邦深度算子网络(FedDeepONet)。设计多种数据生成方法以控制非独立同分布(non-iid)程度,并采用1-Wasserstein距离量化函数逼近与PDE学习中的数据异质性。系统研究了数据异质性与联邦模型性能的关系。此外,提出权重偏差度量并构建理论框架,建立联邦学习中权重偏差增长的上界,对比传统集中式学习。通过10组实验验证方法有效性,包括2项函数逼近、5项基于FedPINN的PDE问题和3项基于FedDeepONet的PDE问题。结果表明,所提联邦方法优于仅使用本地数据训练的模型,在准确率上可媲美使用全部数据的集中式模型。

原文摘要 · Abstract (English)

By leveraging neural networks, the emerging field of scientific machine learning (SciML) offers novel approaches to address complex problems governed by partial differential equations (PDEs). In practical applications, challenges arise due to the distributed essence of data, concerns about data privacy, or the impracticality of transferring large volumes of data. Federated learning (FL), a decentralized framework that enables the collaborative training of a global model while preserving data privacy, offers a solution to the challenges posed by isolated data pools and sensitive data issues. Here, this paper explores the integration of FL and SciML to approximate complex functions and solve differential equations. We propose two novel models: federated physics-informed neural networks (FedPINN) and federated deep operator networks (FedDeepONet). We further introduce various data generation methods to control the degree of non-independent and identically distributed (non-iid) data and utilize the 1-Wasserstein distance to quantify data heterogeneity in function approximation and PDE learning. We systematically investigate the relationship between data heterogeneity and federated model performance. Additionally, we propose a measure of weight divergence and develop a theoretical framework to establish growth bounds for weight divergence in federated learning compared to traditional centralized learning. To demonstrate the effectiveness of our methods, we conducted 10 experiments, including 2 on function approximation, 5 PDE problems on FedPINN, and 3 PDE problems on FedDeepONet. These experiments demonstrate that proposed federated methods surpass the models trained only using local data and achieve competitive accuracy of centralized models trained using all data.

联邦学习微分方程科学机器学习异构数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。