提出同步学习静态与动态因果表示的方法,提升模型在动态环境中的泛化能力。
Learning Time-Aware Causal Representation for Model Generalization in Evolving Domains
- 构建时间感知的因果模型,分离任务无关干扰因素
- 在合成与真实数据集上实现优于现有方法的时序泛化性能
- 适合需要应对数据分布随时间变化的工业场景
赋予深度模型在动态场景中泛化的能力对于实际部署至关重要,因为数据分布持续且复杂地变化。近年来,演化领域泛化(EDG)应运而生,旨在捕捉随时间演变的模式以提升模型泛化能力。然而,现有方法仅建模跨域数据与目标之间的依赖关系,可能引入虚假相关性,导致无关因素与目标间形成捷径,阻碍泛化。为此,我们设计了一种时间感知的结构因果模型(SCM),融合动态因果因子与因果机制漂移,提出静态-动态因果表示学习(SYNC)方法,有效学习时间感知的因果表示。具体而言,该方法将信息论目标融入序列变分自编码器框架,捕捉演化模式,并通过保持跨域与域内因果因子的类内紧凑性生成期望表示。此外,我们理论上证明了该方法可为每个时间域生成最优因果预测器。在合成与真实数据集上的实验表明,SYNC可实现更优的时序泛化性能。
原文摘要 · Abstract (English)
Endowing deep models with the ability to generalize in dynamic scenarios is of vital significance for real-world deployment, given the continuous and complex changes in data distribution. Recently, evolving domain generalization (EDG) has emerged to address distribution shifts over time, aiming to capture evolving patterns for improved model generalization. However, existing EDG methods may suffer from spurious correlations by modeling only the dependence between data and targets across domains, creating a shortcut between task-irrelevant factors and the target, which hinders generalization. To this end, we design a time-aware structural causal model (SCM) that incorporates dynamic causal factors and the causal mechanism drifts, and propose \textbf{S}tatic-D\textbf{YN}amic \textbf{C}ausal Representation Learning (\textbf{SYNC}), an approach that effectively learns time-aware causal representations. Specifically, it integrates specially designed information-theoretic objectives into a sequential VAE framework which captures evolving patterns, and produces the desired representations by preserving intra-class compactness of causal factors both across and within domains. Moreover, we theoretically show that our method can yield the optimal causal predictor for each time domain. Results on both synthetic and real-world datasets exhibit that SYNC can achieve superior temporal generalization performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。