把神经网络看作潜空间中的动态系统,用向量场分析模型行为。
Navigating the Latent Space Dynamics of Neural Models
- 将自编码器视为潜空间上的动力系统,通过编码解码迭代生成向量场。
- 训练过程自然产生吸引子,可反映模型的泛化与记忆特性。
- 无需输入数据即可提取先验知识,还能识别分布外样本。
神经网络将高维数据映射为紧凑的结构化表示,通常被视为低维潜空间中的元素。本文提出将神经模型重新理解为作用于潜流形的动力系统。具体而言,我们发现自编码器模型隐式定义了潜空间中的向量场,该场由反复应用编码-解码映射生成,无需额外训练。标准训练过程引入归纳偏置,导致该向量场中出现吸引子点。基于此洞察,我们提出利用该向量场作为模型表示,提供一种新工具以分析模型与数据属性:(i) 分析神经模型在训练全过程中的泛化与记忆状态;(ii) 无需任何输入数据,仅从参数中提取网络所编码的先验知识;(iii) 通过样本在向量场中的轨迹识别分布外样本。我们在视觉基础模型上验证该方法,展示其在真实场景中的适用性与有效性。
原文摘要 · Abstract (English)
Neural networks transform high-dimensional data into compact, structured representations, often modeled as elements of a lower dimensional latent space. In this paper, we present an alternative interpretation of neural models as dynamical systems acting on the latent manifold. Specifically, we show that autoencoder models implicitly define a latent vector field on the manifold, derived by iteratively applying the encoding-decoding map, without any additional training. We observe that standard training procedures introduce inductive biases that lead to the emergence of attractor points within this vector field. Drawing on this insight, we propose to leverage the vector field as a representation for the network, providing a novel tool to analyze the properties of the model and the data. This representation enables to: (i) analyze the generalization and memorization regimes of neural models, even throughout training; (ii) extract prior knowledge encoded in the network's parameters from the attractors, without requiring any input data; (iii) identify out-of-distribution samples from their trajectories in the vector field. We further validate our approach on vision foundation models, showcasing the applicability and effectiveness of our method in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。