用微分代数方法高效计算神经正切核的对偶激活,提升模型分析精度。
An Application of the Holonomic Gradient Method to the Neural Tangent Kernel
- 基于微分算子环的计算机代数算法求解
- 实现对偶激活的数值计算,支持高维分布建模
- 适用于深度学习理论分析,适合研究者使用
一个线性偏微分方程组若其解空间有限维,则称为一个解析系统。满足此类系统的分布称为解析分布。本文提出一种数值方法,用于计算神经正切核中解析激活分布的对偶激活。该方法基于微分算子环的计算机代数算法,可高效处理高维复杂分布的对偶激活计算,为神经网络动力学分析提供新工具。
原文摘要 · Abstract (English)
A holonomic system of linear partial differential equations is, roughly speaking, a system whose solution space is finite dimensional. A distribution that is a solution of a holonomic system is called a holonomic distribution. We give methods to numerically evaluate dual activations of holonomic activator distributions for neural tangent kernels. These methods are based on computer algebra algorithms for rings of differential operators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。