用有限区分器测试分布,高效识别差异并连接多个领域。
Testing Distributions Against Bounded Distinguishers
- 以有界区分器定义新测试框架,适配高维与连续分布。
- 实现半空间与决策树的可测试学习,及低度多项式密度分布的检验。
- 连接学习验证、结构分布测试,推动多领域新结果产生。
针对高维或连续域上的分布测试难题,本文研究基于有界区分器类的分布测试。核心任务是:从未知分布 $P$ 中采样,判断 $P = P_{\mathsf{ref}}$ 还是存在一个在有界类 $φ$ 内的区分器 $f$,使得 $|\mathbf{E}_P[f] - \mathbf{E}_{P_{\mathsf{ref}}}[f]| > \varepsilon$。该问题即为关于伪随机性距离的身份测试。我们证明该模型不仅在高维下具有样本效率,还揭示了可测试学习、学习算法验证与结构化分布测试三者间的深层联系,并由此获得新成果:1. 基于成员查询的半空间与决策树的可测试正确学习;2. 基于 Rademacher 复杂度的 PAC 验证下界,以及不相交 $k$ 个多维矩形的无分布验证协议;3. 决策树分布与低度多项式密度分布(在布尔与连续超立方体上)的总变差距离身份测试器。
原文摘要 · Abstract (English)
Motivated by the challenge of testing distributions over high-dimensional or continuous domains, we study distribution testing with respect to bounded classes of distinguishers. A representative task is to use samples from an unknown distribution $P$ over a very large domain to decide between two cases: $P = P_{\mathsf{ref}}$ for a fixed reference distribution $P_{\mathsf{ref}}$, or there exists a distinguisher $f$ in a bounded class $\mathcal{F}$ which witnesses the separation $|\mathbf{E}_P[f] - \mathbf{E}_{P_{\mathsf{ref}}}[f]| > ε$. This is the task of identity testing with respect to fooling distance, a name inspired by the conceptual connection with pseudorandomness. (Formally, our model instantiates integral probability metrics from Boolean classes of bounded expressivity.) We show that testing with respect to fooling distance is not only a natural computational problem that admits sample-efficient algorithms even in high-dimensional settings, but also one that reveals and underlies connections between three seemingly unrelated areas of study: testable learning, verification of learning algorithms, and testing of structured distributions (whose "$\mathcal{A}_k$-testing" model our framework extends). These connections yield new results for all of these models, including: 1. Testable proper learners using membership queries for halfspaces and decision trees. 2. A lower bound for testable PAC verification in terms of Rademacher complexity, and a distribution-free verification protocol for disjoint unions of $k$ multidimensional rectangles. 3. Identity testers (with respect to total variation distance) for decision tree distributions and distributions with low-degree polynomial densities, over Boolean and continuous hypercube domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。