arXiv:2605.24584cs.LGcs.AI2026-05

提出可学习的拉普拉斯核算子,实现海量数据下的高效稠密计算。

LAPLEX: The FFT of Learnable Laplace Kernels

论文配图:LAPLEX: The FFT of Learnable Laplace Kernels
图 1 · 摘自论文原文
  • 用可训练的坐标锚点定义稠密矩阵,避免存储大矩阵
  • 支持向量维度达10^9的矩阵-向量运算,速度如FFT
  • 适用于高维图像建模,保留空间结构且无卷积偏见

深度学习中的快速线性代数通常面临权衡:固定几何与精确计算(如傅里叶变换),或自适应几何但需密集参数、随机特征或低秩近似。为突破这一限制,本文提出LAPLEX,一类可学习(带相位)的拉普拉斯核算子。一个LAPLEX层是一个通常满秩的稠密矩阵,由可学习的坐标锚点隐式定义,具有类似傅里叶变换的计算复杂度。因此,它可在现代GPU上实现高达10^9维度的向量-矩阵乘法。作为神经网络层,其投影和分类头紧凑且可解释为软可学习路由模型。同一基元也可作为高效格拉姆算子,在3×10^6维度的展平图像上构建高维协方差模型,保留明显空间结构而不引入卷积偏见。这些应用均源于同一原则:稠密几何可学习而无需存储稠密矩阵,从而在传统稠密层不可行的场景中实现数据自适应的全局交互。LAPLEX将表达能力与存储开销分离——行为如同可训练稠密矩阵,但通过少量结构化参数表示与应用。

原文摘要 · Abstract (English)

Fast linear algebra in deep learning usually comes with a choice: fixed geometry and exact computation, as in the Fourier transform, or adaptive geometry paid for by dense parameters, random features, or low-rank surrogates. To move beyond this trade-off, we introduce LAPLEX, a class of exact, trainable (phased) Laplace-kernel operators. A LAPLEX layer is a typically full-rank dense matrix, implicitly defined by learnable coordinate anchors, with FFT-like scaling. Consequently, it supports trainable matrix--vector operations at vector dimensions up to $10^9$ on modern GPUs. As a neural layer, it yields compact projections and classification heads interpretable as soft, trainable routing models. The same primitive also serves as an efficient Gram operator, enabling high-dimensional covariance models on flattened images of dimension $3 \cdot 10^6$ that preserve visible spatial structure without imposing convolutional bias. These applications reflect a single principle: dense geometry can be learned without storing a dense matrix, which enables data-adaptive global interactions in regimes where ordinary dense layers are out of reach. In this sense, LAPLEX separates expressivity from storage cost: it behaves like a dense trainable matrix, but is represented and applied through a small structured set of parameters.

可学习核稠密计算矩阵加速高维建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。