arXiv:2512.16074cs.LG2025-12被引 1

用简单架构实现多个微分方程求解器的上下文学习,训练快、效果准。

In-Context Multi-Operator Learning with DeepOSets

  • 基于DeepOSets架构,通过上下文示例实现多算子同时学习。
  • 在多个初值/边值问题上准确预测未见方程的解,训练仅需数分钟。
  • 适合需要快速部署、理论可保证的科学计算场景。

神经网络在科学计算中的一个重要应用是学习非线性算子。在此框架中,神经网络被训练以拟合两个无限维空间之间的非线性映射,例如常微分方程和偏微分方程的解算子。最近,受大语言模型上下文学习的启发,一种更雄心勃勃的范式被探索,称为多算子学习。该方法中,神经网络被训练以同时学习多个不同的算子;为评估某个已学算子,通过输入示例输入输出对来区分目标算子。本文给出了多算子学习问题的精确数学形式化,改进了简单的高效架构DeepOSets以支持多算子学习,并证明其在多算子学习中的通用性。此外,我们进行了全面实验,验证了DeepOSets能够学习对应于不同初值和边值微分方程的多个算子,并利用上下文示例准确预测查询对应的解,这些解在训练中未见过。DeepOSets的主要优势在于其架构简洁,可推导理论保证,训练时间在分钟级,相比依赖变换器的类似方法(经验性验证,需数小时训练)具有显著效率优势。

原文摘要 · Abstract (English)

An important application of neural networks to scientific computing has been the learning of non-linear operators. In this framework, a neural network is trained to fit a non-linear map between two infinite dimensional spaces, for example, the solution operator of ordinary and partial differential equations. Recently, inspired by the discovery of in-context learning for large language models, an even more ambitious paradigm has been explored, called multi-operator learning. In this approach, a neural network is trained to learn many different operators at the same time. In order to evaluate one of the learned operators, the network is passed example inputs and outputs to disambiguate the desired operator. In this work, we provide a precise mathematical formulation of the multi-operator learning problem. In addition, we modify a simple efficient architecture, called DeepOSets, for multi-operator learning and prove its universality for multi-operator learning. Finally, we provide a comprehensive set of experiments that demonstrate the ability of DeepOSets to learn multiple operators corresponding to different initial-value and boundary-value differential equations and use in-context examples to predict accurately the solutions corresponding to queries and differential equations not seen during training. The main advantage of DeepOSets is its architectural simplicity, which allows the derivation of theoretical guarantees and training times that are in the order of minutes, in contrast to similar transformer-based alternatives that are empirically justified and require hours of training.

算子学习上下文学习微分方程DeepOSets

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。