arXiv:2412.18005math.ATcs.CG2024-12

将ReLU神经网络的拓扑结构转化为可计算的离散莫尔斯配对方法

Combinatorial Regularity for Relatively Perfect Discrete Morse Gradient Vector Fields of ReLU Neural Networks

  • 构建从分段线性莫尔斯函数到相对完美离散莫尔斯函数的转换框架
  • 提出算法判断顶点是否为莫尔斯临界点,支持子水平集拓扑分析
  • 适用于研究浅层ReLU网络的拓扑性质,适合拓扑学习方向学者

ReLU神经网络在机器学习中广泛使用,其输入空间被分解为称为规范多面体复形的分段线性结构。已有研究证明判断一个ReLU神经网络是否为分段线性莫尔斯函数是可判定的。为了拓展分析ReLU神经网络拓扑性质的计算工具并利用离散莫尔斯理论的优势,本文提出一种将给定规范多面体复形上的分段线性莫尔斯函数(如ReLU神经网络参数)转换为兼容的(“相对完美”)离散莫尔斯函数的方案。该方法具有构造性,提供算法以判断规范多面体复形中的某顶点是否对应分段线性莫尔斯临界点,并给出算法构造包含该顶点的单元格上一致的离散莫尔斯配对。此外,本文还获得关于浅层ReLU神经网络子水平集拓扑的一些新可实现性结果。

原文摘要 · Abstract (English)

One common function class in machine learning is the class of ReLU neural networks. ReLU neural networks induce a piecewise linear decomposition of their input space called the canonical polyhedral complex. It has previously been established that it is decidable whether a ReLU neural network is piecewise linear Morse. In order to expand computational tools for analyzing the topological properties of ReLU neural networks, and to harness the strengths of discrete Morse theory, we introduce a schematic for translating between a given piecewise linear Morse function (e.g. parameters of a ReLU neural network) on a canonical polyhedral complex and a compatible (``relatively perfect") discrete Morse function on the same complex. Our approach is constructive, producing an algorithm that can be used to determine if a given vertex in a canonical polyhedral complex corresponds to a piecewise linear Morse critical point. Furthermore we provide an algorithm for constructing a consistent discrete Morse pairing on cells in the canonical polyhedral complex which contain this vertex. We additionally provide some new realizability results with respect to sublevel set topology in the case of shallow ReLU neural networks.

神经网络拓扑离散莫尔斯ReLU

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。