提出统一框架,解决条件生成模型的可识别性与外推问题。
Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation
- 构建属性驱动的生成模型结构,通过潜在调制机制连接属性与概念。
- 发现外推成立的代数条件,依赖于属性势函数在未见属性上的延拓。
- 统一多个现有方法的理论基础,适用于需要可靠泛化的场景。
条件隐变量模型的可靠泛化需同时理解可识别性与外推性:观测属性变化如何决定潜在结构,以及该结构如何决定未见属性下的分布。然而现有可识别性与外推性保证多为模型特定,分散于非线性ICA、因果表征学习、扰动建模等不同领域。本文提出概念调制模型(CMMs),一种属性索引的条件生成模型,结构为 $A\to Λ\to C\to X$:属性选择调制器,调制器诱导潜概念规律,概念生成观测特征。CMMs通过特征在已知属性上的一致性,导出受CMM类约束的潜概念转移,以属性势函数(即属性条件概念律的对数密度比)表达该约束,实现从通用提升步骤到模型特异性刚性论证的分离。同一势函数也控制外推:在未见属性上一致成立当且仅当传输后的属性势函数身份能延拓至这些属性。由此获得代数外推准则,揭示多个现有可识别性与外推结果共有的势函数证明对象,并结合各工作中的具体刚性论证,复现其结论。
原文摘要 · Abstract (English)
Reliable generalization in conditional latent variable models requires understanding both identifiability and extrapolation: how observed variation across attributes determines latent structure, and how that structure determines distributions at unseen attributes. However, existing identifiability and extrapolation guarantees are largely model-specific, with separate analyses in nonlinear ICA, causal representation learning, perturbation modeling, and related conditional latent variable models. We introduce concept modulation models (CMMs), an attribute-indexed class of conditional generative models with structure $A\to Λ\to C\to X$, where attributes select modulators, modulators induce latent concept laws, and concepts generate observed features. CMMs lift transition-based identifiability to conditional settings by showing that feature agreement on observed attributes induces a latent concept transition constrained by the CMM class. We express these constraints through attribute potentials, log-density ratios between attribute-conditioned concept laws, separating the generic lifting step from model-specific rigidity arguments. The same potentials control extrapolation: agreement at unseen attributes holds exactly when the transported attribute-potential identities extend to those attributes. This yields algebraic extrapolation criteria, identifies the common potential-based proof objects behind several existing identifiability and extrapolation results, and, when combined with the model-specific rigidity arguments in those works, recovers their stated conclusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。