提出一种保持对偶参数关系的新型神经网络架构,可稳定学习物理系统结构。
Symplectic Representation of Legendre Dynamics
- 通过勒让德对偶性约束表示空间中的动态,确保变量间始终保持对偶关系
- 证明满足该约束的系统必须由线性动量哈密顿量驱动,且有唯一标准形式
- 设计出能自动保持对偶结构的哈密顿递归网络,适合建模物理系统与统计模型
现代学习系统依赖数据的内部表示,但这些表示如何编码底层物理或统计结构常被忽略。在物理学中,辛结构使哈密顿系统忠实于相空间几何。近期方法在动力学或训练损失中施加此类几何结构。本文提出新问题:表示本身是否应遵循辛守恒律?我们通过勒让德对偶性来实现这一表示级约束——即原坐标与对偶坐标间的关系 $p = dψ(q)$,在指数族模型中对应自然参数与期望参数的信息几何配对。我们将勒让德动力学形式化为轨迹始终位于勒让德图上的随机过程,其中演化中的原-对偶参数保持勒让德对偶。我们证明该类包括线性时不变高斯过程回归和奥恩斯坦-乌伦贝克动力学。几何上,我们刻画了保持所有勒让德图的余切丛辛同构,发现它们恰好是基微分同胚的余切提升后接精确纤维平移。这给出了勒让德保持表示更新的显式标准形。动态上,我们证明该标准形可由至多关于动量线性的哈密顿量实现。基于此原理,我们构造了线性和非线性哈密顿辛储层(SR),其递归更新构造即保证勒让德图不变。这是唯一保持勒让德对偶性的标准形,因此架构源于不变性。数值实验验证了标准形恒等式,并将勒让德保持的哈密顿SR与通用辛及标准储层基线区分开。
原文摘要 · Abstract (English)
Modern learning systems act on internal representations of data, yet how these representations encode underlying physical or statistical structure is often left implicit. In physics, symplecticity keeps Hamiltonian systems faithful to their phase-space geometry. Recent learning methods impose such geometric structure either in the dynamics or through training losses. Here we ask a different question: what would it mean for the representation itself to obey a symplectic conservation law? We pose this representation-level constraint through Legendre duality: the relation $p = dψ(q)$ between primal and dual coordinates, which in exponential family models is the information-geometric pairing of natural and expectation parameters. We formalize Legendre dynamics as stochastic processes whose trajectories remain on Legendre graphs, where the evolving primal-dual parameters stay Legendre dual. We show that this class includes linear time-invariant Gaussian process regression and Ornstein-Uhlenbeck dynamics. Geometrically, we characterize the symplectomorphisms of cotangent bundles that preserve all Legendre graphs. We show that these maps are exactly cotangent lifts of base diffeomorphisms followed by exact fibre translations. This gives an explicit normal form for Legendre-preserving representation updates. Dynamically, we prove that the normal form is realized by Hamiltonians that are at most linear in the momentum. This realization principle is used to construct linear and nonlinear Hamiltonian Symplectic Reservoirs (SR) whose recurrent updates preserve Legendre graphs by construction. This is the only normal form that preserves Legendre duality, so the architecture follows from the invariant. Numerical experiments confirm the normal-form identities and distinguish Legendre preserving Hamiltonian SRs from generic symplectic and standard reservoir baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。