arXiv:2512.11263cs.LG2025-12

首次将稀疏自编码器应用于3D模型,发现特征以离散状态存在。

Features Emerge as Discrete States: The First Application of SAEs to 3D Representations

  • 用稀疏自编码器分析3D重建VAE的隐藏特征
  • 发现特征呈现离散状态而非连续变化,存在相变现象
  • 解释了位置编码偏好、损失函数非线性等反直觉行为

稀疏自编码器(SAEs)是一种强大的词典学习技术,能无监督地分解神经网络激活值,将隐状态转化为高语义价值的人类可理解概念。然而该方法极少应用于文本之外的领域,限制了特征分解的理论探索。本文首次将SAEs应用于3D领域,分析基于53,000个3D模型的Objaverse数据集上训练的先进3D重建变分自编码器(VAE)所使用的特征。我们发现网络编码的是离散而非连续特征,关键发现为:此类模型近似于离散状态空间,由特征激活的类相变过程驱动。通过这一状态转变框架,我们解释了三个以往难以理解的现象——重建模型对位置编码表示的倾向性、特征消融导致的重建损失呈S型变化,以及相变点分布的双峰特性。最后一点表明,模型会重新分配叠加干扰,优先突出不同特征的显著性。本工作不仅归纳并解释了特征分解中的异常现象,还提供了一个解析模型特征学习动态的框架。代码与编码后的3D对象数据集将在发布时公开。

原文摘要 · Abstract (English)

Sparse Autoencoders (SAEs) are a powerful dictionary learning technique for decomposing neural network activations, translating the hidden state into human ideas with high semantic value despite no external intervention or guidance. However, this technique has rarely been applied outside of the textual domain, limiting theoretical explorations of feature decomposition. We present the first application of SAEs to the 3D domain, analyzing the features used by a state-of-the-art 3D reconstruction VAE applied to 53k 3D models from the Objaverse dataset. We observe that the network encodes discrete rather than continuous features, leading to our key finding: such models approximate a discrete state space, driven by phase-like transitions from feature activations. Through this state transition framework, we address three otherwise unintuitive behaviors - the inclination of the reconstruction model towards positional encoding representations, the sigmoidal behavior of reconstruction loss from feature ablation, and the bimodality in the distribution of phase transition points. This final observation suggests the model redistributes the interference caused by superposition to prioritize the saliency of different features. Our work not only compiles and explains unexpected phenomena regarding feature decomposition, but also provides a framework to explain the model's feature learning dynamics. The code and dataset of encoded 3D objects will be available on release.

3D生成稀疏编码特征分解自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。