新方法用低度多项式逼近低维几何函数,精度显著提升。
Sandwiching Polynomials for Geometric Concepts with Low Intrinsic Dimension
- 基于边界光滑性直接构造夹逼的Lipschitz函数
- 高斯分布下k个半空间函数只需poly(k)度多项式
- 无需复杂正则化,适合低维几何建模任务
近期研究发现,低次夹逼多项式在分布偏移、可测试学习和污染学习等复杂学习场景中表现出惊人能力:一对夹逼多项式能在期望上逼近目标函数,同时提供点态上下界。本文提出一种新构造方法,显著改进了多个基础函数类和边缘分布的次数界。特别地,在高斯分布下,k个半空间函数的夹逼多项式次数降至poly(k),相比之前2^O(k)的指数级提升。该方法适用于边界光滑的低维函数类。与以往工作不同,本证明相对简洁,直接利用目标函数边界的光滑性构造夹逼Lipschitz函数,并借助高维逼近理论结果。对于高斯分布下的低维多项式阈值函数(PTFs),我们实现了无需使用Kane提出的FT-光滑化方法的双重指数级改进。
原文摘要 · Abstract (English)
Recent work has shown the surprising power of low-degree sandwiching polynomial approximators in the context of challenging learning settings such as learning with distribution shift, testable learning, and learning with contamination. A pair of sandwiching polynomials approximate a target function in expectation while also providing pointwise upper and lower bounds on the function's values. In this paper, we give a new method for constructing low-degree sandwiching polynomials that yield greatly improved degree bounds for several fundamental function classes and marginal distributions. In particular, we obtain degree $\mathrm{poly}(k)$ sandwiching polynomials for functions of $k$ halfspaces under the Gaussian distribution, improving exponentially over the prior $2^{O(k)}$ bound. More broadly, our approach applies to function classes that are low-dimensional and have smooth boundary. In contrast to prior work, our proof is relatively simple and directly uses the smoothness of the target function's boundary to construct sandwiching Lipschitz functions, which are amenable to results from high-dimensional approximation theory. For low-dimensional polynomial threshold functions (PTFs) with respect to Gaussians, we obtain doubly exponential improvements without applying the FT-mollification method of Kane used in the best previous result.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。