用相对论类比卷积神经网络中信息传播的机制。
A Unified Framework for the Mechanics of Information in Convolutional Neural Network Image Space

- 用对称/反对称滤波器类比静止能量与动量,解释图像特征演化。
- 小滤波器的位移由反对称能量占比决定,类似相对论速度参数。
- 在3D图像中发现尺度不变的拓扑特征,覆盖分子到星系尺度。
本文提出一个统一的数学框架,用于建模卷积神经网络(CNN)中信息在图像空间的传播,旨在连接物理空间与信息空间的描述。通过非线性修正卷积操作,建立了离散滤波器对称性与相对论能量-动量关系的对应。对称滤波分量(如Σ=[1,1])类似于静止能量mc²,保持图像质心(如各向同性扩散);反对称分量(如∇=[-1,1])则类似动量项pc,通常引发位移(如振动或平移)。对于典型的小离散滤波器,该位移由反对称能量与总能量之比决定,类似于相对论粒子中洛伦兹变换的β = v/c = pc/E。重复过滤导致高斯尺度空间及涌现的尺度不变特征。这些结构具有拉普拉斯驱动特性,与经典热方程、薛定谔方程及弗里德曼方程存在标准数学对应,并涌现出莫尔斯拓扑结构。在三维图像中的演示显示,在涵盖有机糖分子、无机硅晶体、人与灵长类大脑磁共振图像(MRI)、星系及宇宙微波背景(CMB)的广泛物理尺度上,均存在类泡状、尺度不变的莫尔斯临界点。
原文摘要 · Abstract (English)
This paper introduces a unified mathematical framework for modeling information propagation through convolutional neural networks (CNNs), with the aim of connecting descriptions of physical space and information space. A correspondence is presented linking discrete filter symmetry and the relativistic energy--momentum relation under the widely used nonlinear rectified convolution operation. Specifically, symmetric filter components (e.g. the sum $Σ= [1,1]$) operate analogously to rest energy $mc^2$ in preserving the image centre of mass (e.g. isotropic diffusion), whereas antisymmetric components (e.g. the gradient $\nabla = [-1,1]$) operate analogously to the momentum term $pc$ in generally inducing a displacement (e.g. vibration or translation). For typical small discrete filters, this displacement is determined by the ratio of antisymmetric to total filter energy, analogously to how the displacement of a relativistic particle relates to a Lorentz transform with beta parameter $β= \frac{v}{c}=\frac{pc}{E}$ equal to the ratio of momentum $pc$ to total energy $E$. Repeated filtering leads to the Gaussian scale-space and emergent scale-invariant features. These constructions share a Laplacian-driven structure with the classical heat (diffusion) equation and, via standard mathematical correspondences, with the Schrödinger equation and aspects of the Friedmann equations, together with emergent Morse topological structure. Demonstrations in 3D images reveal blob-like, scale-invariant Morse critical points in images spanning a wide range of physical scales, including organic sugar molecules and inorganic silicon crystals, human and primate brains in magnetic resonance images (MRI), galaxies and the cosmic microwave background (CMB).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。