arXiv:2602.14885cond-mat.dis-nncond-mat.stat-mech2026-02

让神经网络模拟复杂动态,突破对称限制,实现记忆与时间行为建模。

Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks

  • 通过非对称连接训练连续时间网络,嵌入任意非线性随机微分方程
  • 可精准再现混沌吸引子等非平衡动力学,支持瞬态吸引子切换
  • 适合研究神经记忆、时间序列计算及生物神经回路的动力学机制

递归神经网络(RNN)为理解生物神经回路中的计算提供了理论框架,但经典模型如霍普菲尔德的关联记忆模型依赖对称连接,限制了网络动力学只能表现为梯度流。而生物网络因非对称性支持丰富的时变行为。本文提出一种通用框架——漂移-扩散匹配,用于训练连续时间RNN,在低维潜在空间中表示任意非线性随机微分方程(SDE),给定其漂移与扩散系数。允许非对称连接后,我们证明RNN能忠实嵌入所给SDE的漂移与扩散项,包括非线性与非平衡动力学,如混沌吸引子。作为应用,我们构建了可由输入驱动或自发动态切换的随机系统,实现吸引子的瞬时探索,解释为关联记忆与序列(情景)记忆模型。为揭示动力学编码机制,我们基于非对称连接与时间不可逆性对RNN进行分解。结果将吸引子神经网络理论拓展至非平衡领域,表明非对称神经种群可在低维流形内实现广泛的动力学计算,统一了关联记忆、非平衡统计力学与神经计算思想。

原文摘要 · Abstract (English)

Recurrent neural networks (RNNs) provide a theoretical framework for understanding computation in biological neural circuits, yet classical results, such as Hopfield's model of associative memory, rely on symmetric connectivity that restricts network dynamics to gradient-like flows. In contrast, biological networks support rich time-dependent behaviour facilitated by their asymmetry. Here we introduce a general framework, which we term drift-diffusion matching, for training continuous-time RNNs to represent arbitrary, nonlinear stochastic differential equations (SDEs), with given drift and diffusion coefficients, within a low-dimensional latent subspace. Allowing asymmetric connectivity, we show that RNNs can faithfully embed the drift and diffusion of a given SDE, including nonlinear and nonequilibrium dynamics such as chaotic attractors. As an application, we construct RNN realisations of stochastic systems that transiently explore various attractors through both input-driven switching and autonomous transitions driven by nonequilibrium currents, which we interpret as models of associative and sequential (episodic) memory. To elucidate how these dynamics are encoded in the network, we introduce decompositions of the RNN based on its asymmetric connectivity and its time-irreversibility. Our results extend attractor neural network theory beyond equilibrium, showing that asymmetric neural populations can implement a broad class of dynamical computations within low-dimensional manifolds, unifying ideas from associative memory, nonequilibrium statistical mechanics, and neural computation.

神经网络随机微分方程非平衡动力学记忆建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。