arXiv:2607.23182stat.MLcs.LG2026-07

用对称性破缺证明深度生成模型可识别,突破传统ICA局限。

Beyond ICA: Identifiability by Symmetry Breaking

论文配图:Beyond ICA: Identifiability by Symmetry Breaking
图 1 · 摘自论文原文
  • 基于分段仿射解码器与高斯混合先验,通过三种代数对比机制实现无监督可识别。
  • 在非连续、非单射解码情况下仍能识别潜变量分布与解码器结构,关键结果为可识别层级体系。
  • 适合研究生成模型可识别性、非线性信号分离的学者,尤其关注对称性与结构辨识者。

我们在纯无监督设置下,证明了具有分段仿射(PWA)解码器和高斯混合模型(GMM)先验的深层生成模型(DGMs)的可识别性。提出三种代数对比原则:域对比,消除混合对称性;机制对比,确保每个解码分支被唯一边界覆盖;交互对比,排除潜变量成分与解码分支间的参数共谋。三者结合利用PWA映射的离散组合结构与潜变量GMM的连续对称性之间的相互作用。连续性由代数对称性条件取代;注入性不再需用于结构识别,仅要求逐点反演。结果构成层级:从律可识别性(LID,潜变量分布至全局仿射变换)到映射可识别性(MID,解码器同前)再到后验与逐点可识别性。当对角成分协方差满足特定条件时,出现ICA形式的歧义。假设仅针对数据生成过程,学习方法除外交互对比。据我们所知,这是首个将代数对称性破缺作为非线性可识别性核心机制的工作,首个允许不连续解码器,也是首个处理完全非单射解码器(每个观测对应多个潜变量编码)的研究。

原文摘要 · Abstract (English)

We prove the identifiability of deep generative models (DGMs) with piecewise-affine (PWA) decoders and Gaussian mixture model (GMM) priors, in a purely unsupervised setting. We introduce three algebraic contrast principles for symmetry breaking: domain contrast, which trivializes the mixture symmetry group; mechanism contrast, which ensures every decoder branch is witnessed by a unique boundary; and interaction contrast, which forbids parameter conspiracies between latent components and decoder branches. Together they exploit the interplay between the discrete combinatorics of the PWA map and the continuous symmetry structure of the latent GMM. Continuity is replaced by algebraic symmetry conditions; injectivity is decoupled from structural identification and required only for pointwise inversion. Our results form a hierarchy: from law identifiability (LID; latent distribution up to a global affine map) through map identifiability (MID; decoder up to the same map) to posterior and pointwise identifiability. The ICA-form ambiguity emerges under conditions on diagonal component covariances. Assumptions are only on the data-generating process, not on learning methods, except for the interaction contrast. To our knowledge this is the first to make algebraic symmetry-breaking the engine of nonlinear identifiability, the first to admit discontinuous decoders, and the first to handle fully non-injective decoders, where every observation admits multiple latent codes.

生成模型可识别性对称性破缺非线性分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。