arXiv:2507.13222cs.CCcs.DS2025-07被引 2

用NP难性证明学习复杂度的极限,揭示算法效率与样本需求的权衡。

Computational-Statistical Tradeoffs from NP-hardness

  • 基于NP-hardness建立学习的计算-统计权衡框架
  • 对任意多项式p(n),存在VC维为1的类,需Θ(p(n))样本才能高效学习
  • 首次实现对非正规学习器的NP难性下界,突破经典障碍

计算机科学与统计学的核心问题之一是:能否设计出高效的算法达到统计问题的信息论极限?尽管已有许多在平均情况假设下的计算-统计权衡结果,但因统计问题本质为平均情况,如何基于标准最坏情况假设建立这些权衡仍是挑战。在最初研究此类权衡的PAC学习中,关键问题是:计算效率是否会导致所需样本数超过信息论下限?本文基于NP-hardness构建此类权衡,得到:(1) 在NP需要指数时间的假设下,对每个多项式p(n),存在一个n变量、VC维为1的类别C,其高效学习的样本复杂度为Θ(p(n));(2) 对学习的刻画:RP = NP 当且仅当每个NP可枚举的类别都能在多项式时间内以O(VCdim(C))个样本完成学习。前半部分已知(Pitt & Valiant, 1988),我们给出了反向证明。值得注意的是,所有下界均针对不正规学习器成立,这是首个关于多项式大小电路子类的不正规学习的NP-hardness结果,绕过了Applebaum、Barak和Xiao(2008)提出的理论障碍。

原文摘要 · Abstract (English)

A central question in computer science and statistics is whether efficient algorithms can achieve the information-theoretic limits of statistical problems. Many computational-statistical tradeoffs have been shown under average-case assumptions, but since statistical problems are average-case in nature, it has been a challenge to base them on standard worst-case assumptions. In PAC learning where such tradeoffs were first studied, the question is whether computational efficiency can come at the cost of using more samples than information-theoretically necessary. We base such tradeoffs on $\mathsf{NP}$-hardness and obtain: $\circ$ Sharp computational-statistical tradeoffs assuming $\mathsf{NP}$ requires exponential time: For every polynomial $p(n)$, there is an $n$-variate class $C$ with VC dimension $1$ such that the sample complexity of time-efficiently learning $C$ is $Θ(p(n))$. $\circ$ A characterization of $\mathsf{RP}$ vs. $\mathsf{NP}$ in terms of learning: $\mathsf{RP} = \mathsf{NP}$ iff every $\mathsf{NP}$-enumerable class is learnable with $O(\mathrm{VCdim}(C))$ samples in polynomial time. The forward implication has been known since (Pitt and Valiant, 1988); we prove the reverse implication. Notably, all our lower bounds hold against improper learners. These are the first $\mathsf{NP}$-hardness results for improperly learning a subclass of polynomial-size circuits, circumventing formal barriers of Applebaum, Barak, and Xiao (2008).

计算统计复杂度理论学习理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。