证明VC维为1的可测概念类仍可能存在非PAC一致的学习规则。
A Borel Concept Class of VC Dimension One with a Non-PAC Consistent Learner in ZFC
- 在ZFC公理下构造了一个VC维为1的Borel概念类
- 该类存在一个一致学习规则,其真实风险恒为1
- 无需连续统假设,揭示理论前提不可省略
统计学习基础定理指出,在适当可测性条件下,有限VC维保证所有恰当的一致学习规则都是大概率近似正确(PAC)。Blumer等人曾假设连续统假设,构造出一个VC维为1的Borel概念类,其存在一致学习规则但不满足PAC。本文证明该连续统假设可去掉:仅在标准的ZFC公理体系下,我们构造了[0,1]上一个VC维为1的Borel概念类和一个恰当的一致学习规则,使得对于某个合适的Borel概率测度和目标概念,该规则在每个样本规模下,于外测度为1的样本集合上真实风险恒为1。因此,仅靠有限VC维与个体概念的Borel可测性不足以保证所有恰当的一致学习规则是PAC的。结果表明,基础定理中的额外正则性假设在一般情况下不可省略。
原文摘要 · Abstract (English)
The fundamental theorem of statistical learning states that, under suitable measurability assumptions, finite Vapnik--Chervonenkis (VC) dimension guarantees that every proper consistent learning rule is probably approximately correct (PAC). Blumer, Ehrenfeucht, Haussler, and Warmuth showed, assuming the Continuum Hypothesis, that the "well-behavedness" condition of the concept class cannot be omitted: they constructed a concept class of Borel sets of VC dimension one admitting a consistent learning rule that is not PAC. We show that the Continuum Hypothesis is unnecessary. Working in Zermelo--Fraenkel set theory with the Axiom of Choice (ZFC) alone, we construct a concept class of Borel sets on $[0,1]$ of VC dimension one and a proper consistent learning rule that is not PAC. More precisely, for a suitable Borel probability measure and target concept, the rule has true risk one at every sample size on a set of samples of outer probability one. Consequently, finite VC dimension and Borel measurability of the individual concepts do not suffice to guarantee that every proper consistent learning rule is PAC. The result shows, with no need of extra set-theoretical assumptions, that the additional regularity assumption in the fundamental theorem cannot in general be omitted.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。