提出首个非线性因果鲁棒方法,实现可证明的分布鲁棒性。
Causality-Inspired Robustness for Nonlinear Models via Representation Learning
- 基于可识别表征学习构建非线性因果框架
- 首次在非线性场景下获得有限半径鲁棒保证
- 适用于存在分布偏移的真实数据,如单细胞数据
分布鲁棒性是预测算法的核心目标,因现实数据中普遍存在分布偏移。模型需最小化不确定性集内最坏情况下的风险。因果建模提供了严谨的鲁棒性保障,其不确定性集由数据驱动,而非传统方法预设。然而,现有因果启发的鲁棒方法仅在线性设定下具备有限半径鲁棒性,即变量间关系为线性。本文提出一种基于因果框架的非线性方法,结合可识别表征学习的最新进展,建立了分布鲁棒性保证。据我们所知,这是首个在非线性设定下具备此类有限半径鲁棒保证的因果启发式方法。在合成数据和真实世界单细胞数据上的实证验证支持了理论发现,并表明有限半径鲁棒性至关重要。
原文摘要 · Abstract (English)
Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, a.k.a., an uncertainty set. Causality provides a modeling framework with a rigorous robustness guarantee in the above sense, where the uncertainty set is data-driven rather than pre-specified as in traditional distributional robustness optimization. However, current causality-inspired robustness methods possess finite-radius robustness guarantees only in the linear settings, where the causal relationships among the covariates and the response are linear. In this work, we propose a nonlinear method under a causal framework by incorporating recent developments in identifiable representation learning and establish a distributional robustness guarantee. To our best knowledge, this is the first causality-inspired robustness method with such a finite-radius robustness guarantee in nonlinear settings. Empirical validation of the theoretical findings is conducted on both synthetic data and real-world single-cell data, also illustrating that finite-radius robustness is crucial.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。