arXiv:2504.04669physics.comp-phcs.LG2025-04被引 7

改进KAN网络,让其更高效处理物理系统中的斜率函数。

asKAN: Active Subspace embedded Kolmogorov-Arnold Network

  • 将主动子空间方法嵌入KAN,自适应投影变量到关键方向。
  • 在相同架构下,误差显著降低,解方程和拟合效果更好。
  • 适合需要高精度建模的科学计算与物理系统问题。

Kolmogorov-Arnold网络(KAN)在小规模AI+Science应用中表现出色,但难以灵活建模脊函数(ridge functions),而这类函数广泛用于描述物理系统关系。本文从Kolmogorov-Arnold定理出发,指出应优先构建一元函数而非组合独立变量。分析表明,引入独立变量的线性组合可大幅简化网络结构。受此启发,提出主动子空间嵌入KAN(asKAN),一种分层框架,将KAN函数表示与主动子空间方法结合。该架构在KAN之间嵌入主动子空间检测,通过识别主要脊方向,将变量自适应投影至关键维度。asKAN以迭代方式实现,不增加原KAN的神经元数量。在函数拟合、泊松方程求解和声场重建任务中验证,相比KAN,在相同网络架构下误差显著下降,表明asKAN显著提升了KAN对脊函数形式方程的拟合与求解能力。

原文摘要 · Abstract (English)

The Kolmogorov-Arnold Network (KAN) has emerged as a promising neural network architecture for small-scale AI+Science applications. However, it suffers from inflexibility in modeling ridge functions, which is widely used in representing the relationships in physical systems. This study investigates this inflexibility through the lens of the Kolmogorov-Arnold theorem, which starts the representation of multivariate functions from constructing the univariate components rather than combining the independent variables. Our analysis reveals that incorporating linear combinations of independent variables can substantially simplify the network architecture in representing the ridge functions. Inspired by this finding, we propose active subspace embedded KAN (asKAN), a hierarchical framework that synergizes KAN's function representation with active subspace methodology. The architecture strategically embeds active subspace detection between KANs, where the active subspace method is used to identify the primary ridge directions and the independent variables are adaptively projected onto these critical dimensions. The proposed asKAN is implemented in an iterative way without increasing the number of neurons in the original KAN. The proposed method is validated through function fitting, solving the Poisson equation, and reconstructing sound field. Compared with KAN, asKAN significantly reduces the error using the same network architecture. The results suggest that asKAN enhances the capability of KAN in fitting and solving equations in the form of ridge functions.

KAN科学计算脊函数主动子空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。