提出平面几何概念的快速鲁棒学习算法,显著提升计算效率。
Fast Agnostic Learners in the Plane
- 基于计算几何设计高效学习算法,实现最优样本复杂度
- 三角形学习时间降至ε⁻⁶,4-5边形分别优化至ε⁻⁸与ε⁻¹⁰
- 适用于需容忍噪声的测试场景,适合几何机器学习研究者
我们研究了平面中若干基本几何概念类的鲁棒学习计算效率。尽管鲁棒学习的样本复杂度已明确,其时间复杂度仍较少被关注。本文针对三角形、小顶点数凸多边形(如4-5边形)以及正方形中的凸集,设计了合适的鲁棒学习算法。对三角形类,提出运行时间$ ilde O({ε^{-6}})$的算法,优于Dobkin和Gunopulos(COLT `95)的$ ilde O({ε^{-10}})$;对4-5边形,将运行时间从$O({ε^{-12}})$改进为$ ilde O({ε^{-8}})$和$ ilde O({ε^{-10}})$。对均匀分布于正方形的凸集,提出$ ilde O({ε^{-5}})$的算法,虽略增样本复杂度,但优于此前$ ilde O(ε^{-8})$。值得注意的是,在一般分布下,[0,1]²中凸集的鲁棒学习因无限VC维而不可行。所提算法利用计算几何数据结构,分析依赖几何与概率组合工具。由于是合适学习器,可导出匹配运行时间的容错性质测试器。结果引发关键问题:这些自然概念类的鲁棒学习是否存在样本与时间复杂度的固有差距。
原文摘要 · Abstract (English)
We investigate the computational efficiency of agnostic learning for several fundamental geometric concept classes in the plane. While the sample complexity of agnostic learning is well understood, its time complexity has received much less attention. We study the class of triangles and, more generally, the class of convex polygons with $k$ vertices for small $k$, as well as the class of convex sets in a square. We present a proper agnostic learner for the class of triangles that has optimal sample complexity and runs in time $\tilde O({ε^{-6}})$, improving on the algorithm of Dobkin and Gunopulos (COLT `95) that runs in time $\tilde O({ε^{-10}})$. For 4-gons and 5-gons, we improve the running time from $O({ε^{-12}})$, achieved by Fischer and Kwek (eCOLT `96), to $\tilde O({ε^{-8}})$ and $\tilde O({ε^{-10}})$, respectively. We also design a proper agnostic learner for convex sets under the uniform distribution over a square with running time $\tilde O({ε^{-5}})$, improving on the previous $\tilde O(ε^{-8})$ bound at the cost of slightly higher sample complexity. Notably, agnostic learning of convex sets in $[0,1]^2$ under general distributions is impossible because this concept class has infinite VC-dimension. Our agnostic learners use data structures and algorithms from computational geometry and their analysis relies on tools from geometry and probabilistic combinatorics. Because our learners are proper, they yield tolerant property testers with matching running times. Our results raise a fundamental question of whether a gap between the sample and time complexity is inherent for agnostic learning of these and other natural concept classes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。