用薛定谔型动力学构建可学习的隐空间图结构,实现稳定且可微的神经网络设计。
Learning Latent Graph Geometry via Fixed-Point Schrödinger-Type Activation: A Theoretical Study
- 以耗散薛定谔动力学定义隐空间图上的静态层,实现可微隐式结构。
- 多层系统等价于超图上的全局静态问题,惩罚项收敛时逼近精确解。
- 适用于图神经网络、流形架构等,适合研究结构化表示与复杂度控制。
我们研究一类神经网络架构,其中每个隐藏层由在可学习的隐空间图上定义的耗散薛定谔型动力学的稳态决定。在稳定分支上,局部稳态问题定义了一个可微的隐式图层。为学习图结构,我们在加权图的分层模空间上进行优化,并为每个层配备非退化的凯勒-黑塞度量,确保自然梯度下降和面交叉问题的良好定义。我们证明,多层稳态网络等价于在超图上的精确全局稳态问题,且其惩罚形式的全局松弛在惩罚参数趋于无穷时,其稳态收敛到精确解。反向传播被恢复为精确全局系统的伴随算子,而惩罚后的伴随算子在同一极限下收敛到该伴随。在有限维强单调性和可提升性假设下,对应的假设类在求解器前馈网络、图稳态网络、超图稳态系统以及具有酉连接的层析架构中一致。由此产生的结构性识别使得复杂度界由稀疏图或超图几何控制,而非密集的环境连通性。
原文摘要 · Abstract (English)
We study neural architectures in which each hidden layer is defined by the stationary state of a dissipative Schrödinger-type dynamics on a learned latent graph. On stable branches, the local stationary problem defines a differentiable implicit graph layer. To learn the graph itself, we optimize over the stratified moduli space of weighted graphs and equip each stratum with a non-degenerate Kähler-Hessian metric that keeps natural-gradient descent and face crossing well posed. We then show that a multilayer stationary network is equivalent to an exact global stationary problem on a supra-graph, and that it admits a penalized global relaxation whose stationary states converge to the exact one as the penalty parameter tends to infinity. Reverse-mode differentiation is recovered as the adjoint of the exact global system, and the penalized adjoint converges to it in the same limit. Finally, under finite-dimensional strong-monotonicity and admissible-lift assumptions, the corresponding represented hypothesis classes coincide among resolvent feed-forward networks, graph-stationary networks, supra-graph stationary systems, and sheaf-based architectures with unitary connection. The resulting structural identifications yield complexity bounds controlled by sparse graph or supra-graph geometry rather than dense ambient connectivity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。