用神经网络动态学习可适配数据的正交函数基,突破传统固定基局限。
Learning Orthonormal Bases for Function Spaces

- 将正交基视为李流形上的路径,通过神经网络参数化微分方程生成器
- 秩2生成器即可逼近任意目标正交基,理论证明其解在流形上稠密
- 可灵活转化为数据主成分、算子特征函数或物理系统的动态模式
无限维正交基展开在函数空间表示与计算中具有核心作用,因其优良的线性代数性质。然而,傅里叶、小波等常用基为固定形式,无法适应特定问题或数据结构。本文提出用神经网络表示并优化这些基。核心思想是:任意目标正交基可视为正交群李流形上的点,或从参考基(如傅里叶基)出发,经由满足斜自伴积分算子控制的常微分方程(ODE)路径演化至目标。利用神经网络定义此类ODE的有限秩生成器,实现函数空间正交基的参数化与优化。尽管有限秩生成器建模无限算子看似受限,我们证明了普遍性结果:即使使用秩2生成器,其积分解在适当算子拓扑下也稠密于正交群。即对任意目标正交基,总存在从参考基出发、由有限秩生成器驱动的路径,可任意接近该目标。我们验证了框架的灵活性:将傅里叶基转化为功能性数据集的主成分、线性算子的特征函数,或能量守恒物理模拟的动态模式。
原文摘要 · Abstract (English)
Infinite-dimensional orthonormal basis expansions play a central role in representing and computing with function spaces due to their favorable linear algebraic properties. However, common bases such as Fourier or wavelets are fixed and do not adapt to the structure of a given problem or dataset. In this paper, we aim to represent these bases with neural networks and optimize them. Our key idea is that any target infinite-dimensional orthonormal basis can be viewed either as a point on the Lie manifold of the orthogonal group, or equivalently, as the endpoint of a continuous path on that manifold that connects a reference basis, e.g. Fourier, to that target. Paths on the Lie manifold satisfy ordinary differential equations (ODEs) governed by skew-adjoint integral operators. Using neural networks to define finite-rank generators of such ODEs allows us to parameterize and optimize orthonormal bases in function space. While relying on finite-rank generators to model infinite operators might seem restrictive, we prove a universality result: even with a rank-2 generator, the integrated solutions of the ODE are dense in the orthogonal group under the appropriate operator topology. In other words, for any target orthonormal basis, there exists a path originating from a reference basis and driven by finite-rank generators that gets arbitrarily close to that target basis. We demonstrate the flexibility of our framework by transforming the Fourier basis into the principal components of a functional dataset, eigenfunctions of linear operators, or dynamic modes of energy-preserving physical simulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。