arXiv:2606.02600cond-mat.dis-nncs.LG2026-06

用自旋玻璃理论分析生成模型隐空间相变,发现边缘稳定态能提升生成与异常检测性能。

High-Dimensional Latents Should Be Diagnosed Through Phase Structure

论文配图:High-Dimensional Latents Should Be Diagnosed Through Phase Structure
图 1 · 摘自论文原文
  • 将隐空间建模为自旋玻璃系统,用重叠分布等工具识别有序、无序与边缘相
  • 在CIFAR-10和CelebA64上实现更低的自相似FID,同时保持或提升重建质量
  • 适用于希望理解隐空间结构并优化生成/异常检测的开发者与研究者

本文从自旋玻璃理论视角研究自编码器与变分自编码器的隐空间。首先,针对固定解码器,重构项与超球坐标先验共同诱导出隐球面上的哈密顿量,其中隐变量扮演连续自旋角色,先验相当于外磁场,从而可引入自旋玻璃诊断工具——重叠分布、磁化率与块自旋粗粒化——以检测训练后隐表示中的有序、无序及边缘稳定性相。其次,刻意将隐空间推向拓扑平凡化临界边缘时,产生明确下游效果:在生成任务中,超球压缩显著改善重建-生成权衡,在CIFAR-10与CelebA64上获得更低自相似FID;在异常检测中,同一类半有序隐几何结构提升了完全无监督及条件下的分布外检测性能,涵盖真实世界火星车与星系动物园数据集,以及基于CIFAR-10/100和Imagenette的分布外基准。因此,我们倡导采用相感知评估范式,以自旋玻璃可观测量补充标准机器学习指标,揭示众多下游成功或失败背后的隐空间机制。

原文摘要 · Abstract (English)

We study autoencoder and variational-autoencoder latent spaces through the lens of spin-glass theory. The paper has two components. First, we formalize a latent-space spin-glass dictionary: for a fixed decoder, the reconstruction term together with a hyperspherical coordinates prior induces a Hamiltonian on the latent sphere, where latent coordinates play the role of continuous spins and the prior acts as an external magnetic field. This allows us to import operational spin-glass diagnostics -- overlap distributions, susceptibility, and block-spin coarse-graining -- to detect ordered, disordered, and edge-of-stability phases in trained latent representations. Second, we show that deliberately driving the latent system toward the edge-of-stability of the topological trivialization regime has concrete downstream consequences. In generation, hyperspherical compression improves the reconstruction-generation trade-off on CIFAR-10 and CelebA64, yielding lower self-FID while preserving or improving reconstruction. In anomaly detection, the same semi-ordered latent geometry improves both fully unsupervised and conditional OOD detection, including real-world Mars Rover and Galaxy Zoo datasets, as well as CIFAR-10/100 and Imagenette-based OOD benchmarks. We therefore advocate a phase-aware evaluation paradigm for AEs/VAEs, in which spin-glass observables complement standard ML metrics and expose the latent regimes that underlie downstream success or failure in many cases.

自编码器隐空间分析自旋玻璃异常检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。