提出几何可定义性假设,解决策略学习中复杂度失控问题
Strategic PAC Learnability via Geometric Definability
- 用一阶公式描述假设类与代价结构,限制可操控范围
- 证明在该假设下,即使简单类也保持可学习,样本复杂度可控
- 适用于常见距离度量,适合关注公平与可解释性的研究者
策略分类研究个体可支付代价修改特征以影响分类器决策的学习场景。核心问题是:诱导的策略假设类的样本复杂度如何依赖于基础假设类和代价结构的复杂度。已有工作表明,在线性分类器与范数代价等自然设定下,复杂度可控制。本文首先证明:此类保证在一般情况下不成立——即使在实线上维度为1的假设类,仅用最简单的区间邻域,其诱导类仍可能具有无限VC维。因此,策略行为可使易学问题变为不可学。为克服此问题,引入几何可定义性假设:假设类与代价诱导的邻域关系均可由ℝₐₓₚ上的一个一阶公式定义。这包含算术运算、指数、对数及比较,涵盖ℓₚ距离、Wasserstein距离与信息论散度等多种自然情形。在此假设下,我们证明学习性得以保持,且样本复杂度受定义公式的复杂度控制。
原文摘要 · Abstract (English)
Strategic classification studies learning settings in which individuals can modify their features, at a cost, in order to influence the classifier's decision. A central question is how the sample complexity of the induced (strategic) hypothesis class depends on the complexities of the underlying hypothesis class and the cost structure governing feasible manipulations. Prior work has shown that in several natural settings, such as linear classifiers with norm costs, the induced complexity can be controlled. We begin by showing that such guarantees fail in general - even in simple cases: there exist hypothesis classes of VC dimension $1$ on the real line such that, even under the simplest interval neighborhoods, the induced class has infinite VC dimension. Thus, strategic behavior can turn an easy learning problem into a non-learnable one. To overcome this, we introduce structure via a geometric definability assumption: both the hypothesis class and the cost-induced neighborhood relation can be defined by first-order formulas over $\mathbb{R}_{\mathtt{exp}}$. Intuitively, this means that hypotheses and costs can be described using arithmetic operations, exponentiation, logarithms, and comparisons. This captures a broad range of natural classes and cost functions, including $\ell_p$ distances, Wasserstein distance, and information-theoretic divergences. Under this assumption, we prove that learnability is preserved, with sample complexity controlled by the complexity of the defining formulas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。