arXiv:2412.08869stat.APcs.LG2024-12被引 7

发现可观测变量的分布偏移能预测不可观测变量的偏移强度,提升泛化推断可靠性。

Beyond Reweighting: On the Predictive Role of Covariate Shift in Effect Generalization

  • 用标准化度量方法量化可观测与不可观测变量的偏移
  • 680项研究显示可观测偏移可预测不可观测偏移的强弱范围
  • 适用于多中心数据、部分可观测场景下的稳健推断

现有分布偏移下统计推断的泛化方法多基于协变量偏移假设,即可观测变量给定条件下未观测变量的条件分布跨群体保持不变。然而,近期实证研究表明,仅调整可观测变量的偏移往往不足以实现泛化,因为条件分布偏移通常不可忽略。本文通过两项大规模多中心复制研究,分析65个站点共680项研究,提出新观点:尽管条件偏移显著,其强度常可被可观测协变量偏移所界定。这一规律仅在使用我们提出的标准化“枢轴”度量时显现。理论分析表明,该现象与随机分布偏移模型中的推导模式一致。进一步证明,利用协变量偏移的预测作用,可实现部分可观测数据下目标估计的可靠高效不确定性量化。本研究为分布偏移、泛化性与外部有效性问题提供了新视角。

原文摘要 · Abstract (English)

Many existing approaches to generalizing statistical inference amidst distribution shift operate under the covariate shift assumption, which posits that the conditional distribution of unobserved variables given observable ones is invariant across populations. However, recent empirical investigations have demonstrated that adjusting for shift in observed variables (covariate shift) is often insufficient for generalization. In other words, covariate shift does not typically ``explain away'' the distribution shift between settings. As such, addressing the unknown yet non-negligible shift in the unobserved variables given observed ones (conditional shift) is crucial for generalizable inference. In this paper, we present a series of empirical evidence from two large-scale multi-site replication studies to support a new role of covariate shift in ``predicting'' the strength of the unknown conditional shift. Analyzing 680 studies across 65 sites, we find that even though the conditional shift is non-negligible, its strength can often be bounded by that of the observable covariate shift. However, this pattern only emerges when the two sources of shifts are quantified by our proposed standardized, ``pivotal'' measures. We then interpret this phenomenon by connecting it to similar patterns that can be theoretically derived from a random distribution shift model. Finally, we demonstrate that exploiting the predictive role of covariate shift leads to reliable and efficient uncertainty quantification for target estimates in generalization tasks with partially observed data. Overall, our empirical and theoretical analyses suggest a new way to approach the problem of distributional shift, generalizability, and external validity.

分布偏移泛化推断不确定性量化多中心研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。