arXiv:2509.20848cs.DScs.LG2025-09

不依赖合成点,高效学习半空间分类器,适用于轴对齐等特殊场景。

Actively Learning Halfspaces without Synthetic Data

  • 利用预设的D个有序结构并行二分查找,避免逐个顺序处理。
  • 在正常向量来自大小为D的集合时,仅需Θ(D + log n)次查询即可完成学习。
  • 适用于轴对齐半空间和抗噪声的近似学习,结果接近最优。

在经典点定位问题中,给定一个n个点的任意数据集X ⊂ ℝ^d,以及对未知半空间f: ℝ^d → {0,1}的查询访问权限,目标是学习X中每个点的标签。该问题已被广泛研究,由于Hopkins-Kane-Lovett-Mahajan(FOCS 2020)提出的一种近乎最优的˜O(d log n)查询算法而取得进展。然而,该算法允许查询不在X中的任意点(即点合成),而若无此能力,则存在Ω(n)查询下界(Dasgupta,NeurIPS 2004)。本文旨在设计无需点合成的高效半空间学习算法。为突破Ω(n)下界,我们考虑法向量来自大小为D的集合的半空间,并证明了紧致的Θ(D + log n)复杂度。作为推论,我们获得了一个最优的O(d + log n)确定性学习算法,用于轴对齐半空间,解决了此前O(d log n)与Ω(d + log n)之间的差距。此外,我们的算法还可推广至学习在至少一个给定排序下单调的布尔函数。关键技术洞察在于利用排序结构实现并行二分查找,而非依次处理每种排序。我们还基于精确学习算法,得到近似最优的PAC学习算法:在误差ε内学习仅需O(min(D + log(1/ε), 1/ε) · log D)次查询,即使在最多cε比例的点被恶意污染时也成立(其中c为小常数)。该界在可实现设置下已达到最优,仅差一个log D因子。

原文摘要 · Abstract (English)

In the classic point location problem, one is given an arbitrary dataset $X \subset \mathbb{R}^d$ of $n$ points with query access to an unknown halfspace $f : \mathbb{R}^d \to \{0,1\}$, and the goal is to learn the label of every point in $X$. This problem is extremely well-studied and a nearly-optimal $\widetilde{O}(d \log n)$ query algorithm is known due to Hopkins-Kane-Lovett-Mahajan (FOCS 2020). However, their algorithm is granted the power to query arbitrary points outside of $X$ (point synthesis), and in fact without this power there is an $Ω(n)$ query lower bound due to Dasgupta (NeurIPS 2004). In this work our goal is to design efficient algorithms for learning halfspaces without point synthesis. To circumvent the $Ω(n)$ lower bound, we consider learning halfspaces whose normal vectors come from a set of size $D$, and show tight bounds of $Θ(D + \log n)$. As a corollary, we obtain an optimal $O(d + \log n)$ query deterministic learner for axis-aligned halfspaces, closing a previous gap of $O(d \log n)$ vs. $Ω(d + \log n)$. In fact, our algorithm solves the more general problem of learning a Boolean function $f$ over $n$ elements which is monotone under at least one of $D$ provided orderings. Our technical insight is to exploit the structure in these orderings to perform a binary search in parallel rather than considering each ordering sequentially, and we believe our approach may be of broader interest. Furthermore, we use our exact learning algorithm to obtain nearly optimal algorithms for PAC-learning. We show that $O(\min(D + \log(1/\varepsilon), 1/\varepsilon) \cdot \log D)$ queries suffice to learn $f$ within error $\varepsilon$, even in a setting when $f$ can be adversarially corrupted on a $c\varepsilon$-fraction of points, for a sufficiently small constant $c$. This bound is optimal up to a $\log D$ factor, including in the realizable setting.

半空间学习主动学习并行搜索抗噪声

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。