arXiv:2605.15995cs.LGcs.AI2026-05

提出统一框架,用约束平衡隐状态表示的多个目标。

Constrained latent state modeling: A unifying perspective on representation learning under competing constraints

论文配图:Constrained latent state modeling: A unifying perspective on representation learning under competing constraints
图 1 · 摘自论文原文
  • 以互补约束定义隐状态,如预测充分性、时间一致性等
  • 不同约束组合产生不同隐空间结构,存在帕累托最优权衡
  • 适合研究表征学习设计原则或评估模型内在属性的研究者

从复杂数据中学习隐状态表示是现代机器学习的核心,涵盖时序、多模态和部分可观测系统。现有方法常因缺乏明确假设而碎片化,导致同一目标下存在多种表示,难以解释。本文提出约束隐状态建模(CLSM)作为统一框架,通过预测充分性、最小性、时间一致性、观测兼容性、对无关因素的不变性及结构约束等互补条件,将表示学习视为在这些性质间权衡的过程。重新审视主流模型家族,发现它们侧重不同约束子集,位于共同设计空间的不同区域。一个受控合成基准验证了不同约束组合会诱导出各异的隐组织结构,并形成帕累托最优权衡。该框架将设计重点从架构转向约束,为分析、指导和评估表示学习提供原则性依据。

原文摘要 · Abstract (English)

Learning latent representations from complex data is central to modern machine learning, spanning temporal, multimodal, and partially observed systems. In such settings, representations are more naturally understood as latent states capturing underlying system dynamics rather than compressed summaries of observations. Yet current approaches remain fragmented, relying on distinct, often implicit, assumptions about what these states should represent. We argue that this fragmentation reflects a more fundamental limitation: latent representations are typically learned from underconstrained objectives that fail to specify the properties that meaningful latent states should satisfy. As a result, multiple representations may satisfy the same objective, leading to ambiguity in their structure and interpretation. While many underlying principles have been studied in isolation, their interactions have not been explicitly formalized. We propose Constrained Latent State Modeling (CLSM) as a unifying conceptual framework. CLSM characterizes latent states through complementary constraints, including predictive sufficiency, minimality, temporal coherence, observation compatibility, invariance to nuisance factors, and structural constraints, and interprets representation learning as balancing these properties through trade-offs. Revisiting major modeling families through this lens, we show that existing approaches emphasize different subsets of constraints, occupying distinct regions of a common design space. A controlled synthetic benchmark illustrates how different constraint combinations induce distinct latent organizations and Pareto-optimal trade-offs. By shifting the emphasis from architecture-centric to constraint-driven design, CLSM provides a principled framework for analyzing existing methods, guiding new ones, and evaluating latent representations according to their intended properties.

表征学习隐状态约束建模设计空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。