arXiv:2603.14483cs.LG2026-03被引 3

通过因果表示学习,从数据中自动解耦系统参数,无需预设函数形式。

Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention

  • 结合因果表示学习与局部稀疏注意力,实现无结构假设下的参数解耦
  • 在四个合成数据集上成功恢复基线无法识别的高解耦表示
  • 理论证明局部因果结构对完全可辨识性至关重要,适合物理建模研究者

参数化系统辨识方法从数据中估计显式定义的物理系统的参数,但受限于需提供明确函数空间,通常依赖领域知识预选候选函数库。相比之下,深度学习虽能高保真建模复杂系统,但黑箱函数逼近难以揭示系统的显式或解耦结构。本文提出一种新型可辨识性定理,利用因果表示学习,无需结构假设即可揭示系统参数的解耦表示。推导出一个图判据,明确在何种条件下系统参数可从原始轨迹数据中唯一解耦(至置换和微分同胚)。关键发现是:全局因果结构为考虑局部状态相关因果结构时的可辨识性提供了下界。将系统参数识别转化为变分推断问题,采用稀疏正则化变压器挖掘状态依赖的因果结构。在四个合成域上实证验证,结果表明该方法能恢复基线无法捕捉的高解耦表示。与理论分析一致,证实强制局部因果结构常为实现完全可辨识性的必要条件。

原文摘要 · Abstract (English)

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of candidate functions chosen via available domain knowledge. In contrast, deep learning can demonstrably model systems of broad complexity with high fidelity, but black-box function approximation typically fails to yield explicit descriptive or disentangled representations revealing the structure of a system. We develop a novel identifiability theorem, leveraging causal representation learning, to uncover disentangled representations of system parameters without structural assumptions. We derive a graphical criterion specifying when system parameters can be uniquely disentangled from raw trajectory data, up to permutation and diffeomorphism. Crucially, our analysis demonstrates that global causal structures provide a lower bound on the disentanglement guarantees achievable when considering local state-dependent causal structures. We instantiate system parameter identification as a variational inference problem, leveraging a sparsity-regularised transformer to uncover state-dependent causal structures. We empirically validate our approach across four synthetic domains, demonstrating its ability to recover highly disentangled representations that baselines fail to recover. Corroborating our theoretical analysis, our results confirm that enforcing local causal structure is often necessary for full identifiability.

因果学习系统辨识表示学习稀疏注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。