arXiv:2410.16636stat.MLcs.LG2024-10被引 4

提出两种新框架,解决带混杂因素的两样本检验难题

General Frameworks for Conditional Two-Sample Testing

  • 将条件独立性检验转为条件两样本检验,黑盒兼容
  • 通过估计密度比比较边缘分布,可复用现有方法
  • 适用于域适应、算法公平等需控制混杂变量场景

我们研究条件两样本检验问题,旨在判断在控制混杂因素后两个总体是否具有相同分布。该问题广泛存在于域适应和算法公平等应用中。首先,我们建立了一个难解性结果,表明在无合理假设下,任何有效检验都无法对单个替代假设具备显著功效。随后,我们提出两种通用框架:第一种可将任意条件独立性检验转化为条件两样本检验,同时保持原检验的渐近性质;第二种将问题转化为比较边缘分布与估计的密度比,从而可利用现有的边缘两样本检验方法。我们在分类和核方法上具体实现了这一思想。最后,通过模拟实验验证了所提框架在有限样本下的表现。

原文摘要 · Abstract (English)

We study the problem of conditional two-sample testing, which aims to determine whether two populations have the same distribution after accounting for confounding factors. This problem commonly arises in various applications, such as domain adaptation and algorithmic fairness, where comparing two groups is essential while controlling for confounding variables. We begin by establishing a hardness result for conditional two-sample testing, demonstrating that no valid test can have significant power against any single alternative without proper assumptions. We then introduce two general frameworks that implicitly or explicitly target specific classes of distributions for their validity and power. Our first framework allows us to convert any conditional independence test into a conditional two-sample test in a black-box manner, while preserving the asymptotic properties of the original conditional independence test. The second framework transforms the problem into comparing marginal distributions with estimated density ratios, which allows us to leverage existing methods for marginal two-sample testing. We demonstrate this idea in a concrete manner with classification and kernel-based methods. Finally, simulation studies are conducted to illustrate the proposed frameworks in finite-sample scenarios.

统计检验条件检验混杂因素分布比较

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。