用再生核希尔伯特空间构建通用卷积模型,提升神经网络的可扩展性与表达力。
Convolutional Filtering with RKHS Algebras
- 基于代数信号处理理论,在RKHS中定义多种卷积算子
- 在真实无人机无线覆盖预测任务中,性能优于全连接和传统卷积
- 适用于图、群及欧氏空间等多类信号结构,支持显式训练推导
本文发展了一种针对再生核希尔伯特空间(RKHS)的广义卷积信号处理与神经网络理论。借助代数信号处理(ASP)框架,我们证明任意RKHS均可形式化定义多重代数卷积模型,其元素决定作用于RKHS函数的卷积算子。该方法在保持RKHS优势的同时,实现可扩展的滤波与学习。通过构造代数RKHS模型,我们可在群、图翁(graphons)及传统欧氏空间上建立卷积信号模型。进一步地,基于此构建卷积网络,正式定义点乘非线性,并推导出显式的训练公式,其表达依赖于RKHS的代数表示。我们在真实无人机无线覆盖预测数据上进行实验,结果表明该模型相比全连接和标准卷积算子具有显著优势。
原文摘要 · Abstract (English)
In this paper, we develop a generalized theory of convolutional signal processing and neural networks for Reproducing Kernel Hilbert Spaces (RKHS). Leveraging the theory of algebraic signal processing (ASP), we show that any RKHS allows the formal definition of multiple algebraic convolutional models. We show that any RKHS induces algebras whose elements determine convolutional operators acting on RKHS elements. This approach allows us to achieve scalable filtering and learning as a byproduct of the convolutional model, and simultaneously take advantage of the well-known benefits of processing information in an RKHS. To emphasize the generality and usefulness of our approach, we show how algebraic RKHS can be used to define convolutional signal models on groups, graphons, and traditional Euclidean signal spaces. Furthermore, using algebraic RKHS models, we build convolutional networks, formally defining the notion of pointwise nonlinearities and deriving explicit expressions for the training. Such derivations are obtained in terms of the algebraic representation of the RKHS. We present a set of numerical experiments on real data in which wireless coverage is predicted from measurements captured by unmaned aerial vehicles. This particular real-life scenario emphasizes the benefits of the convolutional RKHS models in neural networks compared to fully connected and standard convolutional operators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。