不依赖神经网络,直接从数据中学习可解释的自适应基函数
Data-Driven Variational Basis Learning Beyond Neural Networks: A Non-Neural Framework for Adaptive Basis Discovery
- 将基函数作为优化变量,通过变分法联合学习基与系数
- 证明了最优解存在性及算法收敛性,支持对齐流形与动态结构
- 适合需要可解释性与数学严谨性的高维数据建模场景
传统表示系统如傅里叶级数、小波和固定字典虽具解析可处理性,却无法内生适配现代高维数据的实证结构。神经网络虽能从数据中学习特征,但其分层非线性参数化常牺牲可解释性、基结构显式控制与数学透明性。本文提出非神经替代框架——数据驱动变分基学习(DVBL),将基原子作为核心优化变量,联合学习样本特定系数及潜在线性演化算子。该方法生成数据自适应的基展开,保持显式、可解释且便于严格分析。我们建立了模型的存在性、交替最小化算法的块下降性质,给出系数恢复与基可辨识条件,并在无需神经架构的前提下整合流形与动力学正则化。还讨论了该框架相对于经典字典学习、谱方法、Koopman算子方法与深度表示学习的概念创新。
原文摘要 · Abstract (English)
Classical representation systems such as Fourier series, wavelets, and fixed dictionaries provide analytically tractable basis expansions, but they are not intrinsically adapted to the empirical structure of modern high-dimensional data. Neural networks overcome this limitation by learning features from data, yet they do so through layered nonlinear parameterizations that often sacrifice interpretability, explicit control over basis structure, and mathematical transparency. In this manuscript we develop a non-neural alternative that learns basis functions directly from data through variational optimization. The proposed framework, termed Data Driven Variational Basis Learning (DVBL), treats basis atoms as primary optimization variables and learns them jointly with sample-specific coefficients and, when appropriate, a latent linear evolution operator. This yields a data-adaptive basis expansion that remains explicit, interpretable, and amenable to rigorous analysis. We formulate the model, establish existence of minimizers, prove blockwise descent properties for an alternating minimization algorithm, give conditions for coefficient recovery and basis identifiability, and show how manifold and dynamical regularization can be integrated without invoking neural architectures. We also discuss the conceptual novelty of the framework relative to classical dictionary learning, spectral methods, Koopman operator methods, and deep representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。