arXiv:2606.01172cs.LGstat.ME2026-06

用傅里叶与伏尔泰拉展开提升神经过程的可解释性与效率

Revisiting Neural Processes via Fourier Transform and Volterra Series

论文配图:Revisiting Neural Processes via Fourier Transform and Volterra Series
图 1 · 摘自论文原文
  • 通过伏尔泰拉级数分解实现可解析的平移等变算子
  • 提出集傅里叶卷积,线性扩展至不规则采样点,全局感受野
  • 适合需要高效建模函数的科学计算与数据稀疏场景

从有限、非规则采样的观测中建模未知隐含函数是科学与工程中的常见挑战。神经过程(NPs)作为一类概率函数模型,尤其在具备如平移等变性等领域对称性时表现优异,能提升样本效率与泛化能力。然而现有平移等变神经过程存在两大局限:(i) 采用堆叠通用组件与非线性操作,导致函数类难以解析,可解释性差;(ii) 卷积设计受限于局部感受野且需将输入嵌入密集均匀网格,而基于注意力的方法虽突破限制,但计算复杂度达观测数的平方。本文提出两项改进:首先,利用伏尔泰拉展开,将连续平移等变算子近似为高阶卷积之和,实现分析透明性,并可通过一阶卷积高效计算;其次,引入集傅里叶卷积(SFConvs),一种在频域参数化的运算方式,直接作用于非规则采样点,实现近似全局感受野,且计算复杂度随观测数线性增长。基于此,提出两种条件神经过程(CNPs):SFConvCNPs(堆叠SFConv模块与非线性)、SFVConvCNPs(融合伏尔泰拉形式)。在合成与真实数据集上的实验表明,方法优于当前最优基线。

原文摘要 · Abstract (English)

Modeling unknown latent functions from finite, irregularly sampled measurements is a recurring challenge across science and engineering. Neural processes (NPs), a family of probabilistic functional models, are promising solutions -- especially when endowed with domain-specific symmetries like translation equivariance, which improve sample efficiency and generalization. Yet existing translation-equivariant NPs face two limitations: (i) they stack generic components with non-linearities, obscuring the induced function class and limiting interpretability; and (ii) convolutional designs are limited by local receptive fields and the need to embed inputs onto a dense uniform grid, while attention-based alternatives lift these restrictions at quadratic cost in the number of observations. We address both with two contributions. First, using the Volterra expansion, we approximate continuous translation-equivariant operators by sums of higher-order convolutions, yielding analytical transparency while admitting efficient evaluation via first-order convolutions. Second, we introduce set Fourier convolutions (SFConvs), a frequency-domain parameterization that operates directly on irregularly sampled points, achieves approximately global receptive fields, and scales linearly in the number of observations. Building on these ideas, we propose two conditional NPs (CNPs): SFConvCNPs, which stack SFConv blocks with non-linearities, and SFVConvCNPs, which integrate the Volterra formulation. Experiments on synthetic and real-world datasets demonstrate our methods' efficacy against state-of-the-art baselines.

神经过程傅里叶变换函数建模可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。