用流形上的随机场生成神经网络,让结构和权重同时随机演化。
Supervised Learning of Random Neural Architectures Structured by Latent Random Fields on Compact Boundaryless Multiply-Connected Manifolds
- 基于紧致无边多连通流形的隐式随机场生成神经架构
- 通过测地距离与场强关联实现几何感知的稀疏连接
- 无需预设结构,适合研究复杂系统中的随机建模
本文提出一种新的概率框架,用于神经系统的监督学习。该框架旨在建模在确定性输入下输出高度非高斯的复杂不确定性系统。神经架构本身是随机对象,由定义在紧致、无边、多连通流形上的隐式各向异性高斯随机场随机生成。神经拓扑与突触权重共同源自该隐式场。通过流形上非齐次泊松过程的降维参数化控制神经元位置采样,输入输出神经元通过场的极值评估识别,连接性由测地邻近性与局部场相关性决定。突触权重从场实现中条件采样,即使输入确定也能产生随机输出。为保证可扩展性,采用分位数扩散掩码进行稀疏化,实现无先验假设的几何感知稀疏连接。监督学习被表述为对隐式场生成超参数的推断,使用单输入单观测数据集估计负对数似然损失。论文初步分析了模型的适定性、可测性及诱导随机映射的表达变异性,支持其内在一致性,并为几何驱动的随机学习建立理论基础。
原文摘要 · Abstract (English)
This paper introduces a new probabilistic framework for supervised learning in neural systems. It is designed to model complex, uncertain systems whose random outputs are strongly non-Gaussian given deterministic inputs. The architecture itself is a random object stochastically generated by a latent anisotropic Gaussian random field defined on a compact, boundaryless, multiply-connected manifold. The goal is to establish a novel conceptual and mathematical framework in which neural architectures are realizations of a geometry-aware, field-driven generative process. Both the neural topology and synaptic weights emerge jointly from a latent random field. A reduced-order parameterization governs the spatial intensity of an inhomogeneous Poisson process on the manifold, from which neuron locations are sampled. Input and output neurons are identified via extremal evaluations of the latent field, while connectivity is established through geodesic proximity and local field affinity. Synaptic weights are conditionally sampled from the field realization, inducing stochastic output responses even for deterministic inputs. To ensure scalability, the architecture is sparsified via percentile-based diffusion masking, yielding geometry-aware sparse connectivity without ad hoc structural assumptions. Supervised learning is formulated as inference on the generative hyperparameters of the latent field, using a negative log-likelihood loss estimated through Monte Carlo sampling from single-observation-per-input datasets. The paper initiates a mathematical analysis of the model, establishing foundational properties such as well-posedness, measurability, and a preliminary analysis of the expressive variability of the induced stochastic mappings, which support its internal coherence and lay the groundwork for a broader theory of geometry-driven stochastic learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。