arXiv:2609.05012cs.LGcs.DC2026-09

提出新方法解决科学联邦学习中数据异质性难题

Solution-space heterogeneity shapes federated learning dynamics across partial differential equations

论文配图:Solution-space heterogeneity shapes federated learning dynamics across partial differential equations
图 1 · 摘自论文原文
  • 基于解空间构建可复用的客户端数据分组机制
  • 解空间异质性越强,优化过程越不一致,最终误差升高最多达4.157个百分点
  • 适用于多类偏微分方程任务,为非独立同分布评估提供统一框架

联邦科学机器学习使机构能在不集中本地物理数据的情况下训练神经代理模型,但针对偏微分方程(PDE)的研究缺乏可迁移的非独立同分布(non-IID)数据定义。现有协议根据方程特性对坐标、系数、边界条件或几何形状进行划分。本文提出解空间PDE-Dirichlet协议,将连续监督响应转化为可复用的解桶,并通过最优传输量化客户端间实际分离程度。我们推导出总体分配异质性与狄利克雷浓度之间的精确反向关系,并确立响应异质性引发梯度分歧、局部更新发散和参数漂移的条件。在七个受控及公开的PDE任务、三种神经算子族和五个随机种子下,浓度越低,解距离和优化异质性越高。最终误差下降程度因任务而异:低粘性伯格斯方程影响最大,最异质设置下误差上升4.157个百分点;尽管参数分离持续存在,额外通信或更平滑动力学可缩小最终差距。结果揭示了可重现的几何机制与任务依赖泛化结果的区分,为非IID联邦PDE学习提供了共同评价基础。

原文摘要 · Abstract (English)

Federated scientific machine learning enables institutions to train neural surrogates without centralizing local physical data, yet studies of partial differential equations (PDEs) lack a transferable definition of non-independent and identically distributed data. Existing protocols partition coordinates, coefficients, boundary conditions, or geometries according to equation-specific rules. Here, we introduce solution-space PDE-Dirichlet, a protocol that converts continuous supervised responses into reusable solution bins and quantifies the realized separation between clients through optimal transport over the geometry of these bins. We derive an exact inverse relation between population allocation heterogeneity and the Dirichlet concentration, and we establish conditions under which response heterogeneity induces gradient disagreement, local-update dispersion, and parameter divergence. Across seven controlled and public PDE tasks, three neural-operator families, and five random seeds, a lower concentration consistently increases the realized solution distance and optimization heterogeneity. The degradation in final error is task dependent: the largest effect occurs for low-viscosity Burgers, reaching 4.157 percentage points under the most heterogeneous setting, whereas additional communication or smoother dynamics can reduce the final gap despite persistent parameter separation. These results distinguish a reproducible geometric mechanism from task-dependent generalization outcomes and provide a common basis for evaluating non-IID federated PDE learning.

联邦学习偏微分方程异质性神经算子

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。