arXiv:2603.13311cs.LG2026-03

用未训练神经网络做基函数,提升多维函数逼近能力

Neural Approximation and Its Applications

  • 用未训练的神经网络充当基函数,替代传统手工设计基函数
  • 在多光谱图像、视频等数据上逼近误差显著低于经典方法
  • 适合需要灵活适应新数据的多维函数建模任务

多维函数逼近是机器学习中的基础问题。传统方法依赖手工设计的基函数(如多项式或傅里叶基),限制了其逼近能力和数据适应性,导致性能不佳。为此,本文提出利用未训练的神经网络作为基函数,构建神经逼近(NeuApprox)范式。具体地,将多维数据背后的隐含函数分解为若干块项之和,每个块项由表达性强的神经基函数与可学习系数的乘积构成,能准确捕捉数据的不同成分,并通过微调神经基函数灵活适应新数据。得益于精心设计的块结构,NeuApprox在逼近能力与数据适应性上均优于基于手工基函数的方法。理论上证明,NeuApprox可任意精度逼近任意连续多维函数。在多光谱图像、光场数据、视频、交通数据及点云数据等多样化多维数据集上的实验表明,该方法在逼近性能与适应性方面均表现优异。

原文摘要 · Abstract (English)

Multivariate function approximation is a fundamental problem in machine learning. Classic multivariate function approximations rely on hand-crafted basis functions (e.g., polynomial basis and Fourier basis), which limits their approximation ability and data adaptation ability, resulting in unsatisfactory performance. To address these challenges, we introduce the neural basis function by leveraging an untrained neural network as the basis function. Equipped with the proposed neural basis function, we suggest the neural approximation (NeuApprox) paradigm for multivariate function approximation. Specifically, the underlying multivariate function behind the multi-dimensional data is decomposed into a sum of block terms. The clear physically-interpreted block term is the product of expressive neural basis functions and their corresponding learnable coefficients, which allows us to faithfully capture distinct components of the underlying data and also flexibly adapt to new data by readily fine-tuning the neural basis functions. Attributed to the elaborately designed block terms, the suggested NeuApprox enjoys strong approximation ability and flexible data adaptation ability over the hand-crafted basis function-based methods. We also theoretically prove that NeuApprox can approximate any multivariate continuous function to arbitrary accuracy. Extensive experiments on diverse multi-dimensional datasets (including multispectral images, light field data, videos, traffic data, and point cloud data) demonstrate the promising performance of NeuApprox in terms of both approximation capability and adaptability.

函数逼近神经基函数多维数据可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。