提出通用算子逼近定理,统一了多种编码器-解码器模型的理论基础。
New universal operator approximation theorem for encoder-decoder architectures
- 从拓扑角度构建新逼近性质,实现对紧凑集无关的统一逼近
- 证明在任意紧集上一致收敛,涵盖无限维空间与概率测度空间
- 适用于深度算子网络、帧基架构等,可拓展至最优传输等应用
受神经网络算子逼近领域快速发展的启发,本文提出了针对广泛类别的编码器-解码器架构及其丰富输入输出空间的新型通用算子逼近定理。研究聚焦于无穷维赋范空间或度量空间之间连续算子在紧集上一致收敛拓扑下的逼近问题。不同于现有算子学习文献的标准结果,我们进一步考察逼近序列可独立于紧集选取的情形。从拓扑视角指出,在多数相关算子学习框架中,这种独立性为更强性质。为此,我们引入适配编码器-解码器架构的新逼近性质,从而证明了保证输入空间每个紧子集上一致收敛的通用逼近定理。该结果统一并扩展了经典DeepONets、BasisONets、MIONets、基于框架的架构等各类模型的已有定理。本框架还适用于超越赋范空间的度量空间,包括概率测度的p-Wasserstein空间作为输入或输出空间,以及右连续有界变差函数的Skorohod空间作为输入空间,为最优传输等领域开辟潜在应用。
原文摘要 · Abstract (English)
Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for broad classes of encoder-decoder architectures and a wide range of input and output spaces. In this study, we focus on the approximation of continuous operators between infinite-dimensional normed or metric spaces in the topology of uniform convergence on compact sets. Unlike standard results in the operator learning literature, we additionally investigate the case where the approximating sequence of encoder-decoder architectures can be chosen independently of the compact sets. Taking a topological perspective, we point out that compact-set-independent approximation is a strictly stronger property in most relevant operator learning frameworks. To establish our results, we introduce new approximation properties of input and output spaces tailored to encoder-decoder architectures. These properties enable us to prove a universal operator approximation theorem ensuring uniform convergence on every compact subset of the input space. Our results unify and extend existing universal operator approximation theorems for various encoder-decoder architectures, including classical DeepONets, BasisONets, MIONets, architectures based on frames and other related approaches. A notable feature of our framework is that it also applies to metric spaces beyond the normed setting. In particular, it allows the consideration of $p$-Wasserstein spaces of probability measures as input or output spaces, and Skorohod spaces of càdlàg functions as input spaces. This generality also opens up potential applications in optimal transport.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。