arXiv:2501.08887cs.LGmath.OC2025-01被引 2

提出新维度证明决策算法的可学习性,揭示经典条件非必要

PAC Learnability of Scenario Decision-Making Algorithms: Necessary Conditions and Sufficient Conditions

  • 引入dVC维作为场景决策算法的可学习性判据
  • 证明经典VC维等条件并非必要,但有限dVC维是必要条件
  • 适用于算法设计者与安全关键系统开发者

本文研究场景决策算法的可能近似正确(PAC)性质,即在足够多约束样本下,算法能否以任意低风险规避未知安全约束。尽管已有文献给出若干PAC充分条件(如关联分类器的VC维有限或存在压缩方案),但这些条件是否必要仍不明确。本文通过反例证明:这些条件在一般情况下并非必要。这一结论与二分类学习不同,后者类似条件兼具充分与必要性。进一步地,针对稳定场景决策算法(包含实际中的场景优化方法),我们仍证明前述条件非必要。为此,本文提出新的dVC维概念,作为场景决策算法的VC维类比。我们证明:有限dVC维是此类算法PAC学习的必要条件。该结果可指导算法使用者与设计者识别非PAC算法,并推动对PAC场景决策算法的完整刻画。

原文摘要 · Abstract (English)

We investigate the Probably Approximately Correct (PAC) property of scenario decision algorithms, which refers to their ability to produce decisions with an arbitrarily low risk of violating unknown safety constraints, provided a sufficient number of realizations of these constraints are sampled. While several PAC sufficient conditions for such algorithms exist in the literature -- such as the finiteness of the VC dimension of their associated classifiers, or the existence of a compression scheme -- it remains unclear whether these conditions are also necessary. In this work, we demonstrate through counterexamples that these conditions are not necessary in general. These findings stand in contrast to binary classification learning, where analogous conditions are both sufficient and necessary for a family of classifiers to be PAC. Furthermore, we extend our analysis to stable scenario decision algorithms, a broad class that includes practical methods like scenario optimization. Even under this additional assumption, we show that the aforementioned conditions remain unnecessary. Furthermore, we introduce a novel quantity, called the dVC dimension, which serves as an analogue to the VC dimension for scenario decision algorithms. We prove that the finiteness of this dimension is a PAC necessary condition for scenario decision algorithms. This allows to (i) guide algorithm users and designers to recognize algorithms that are not PAC, and (ii) contribute to a comprehensive characterization of PAC scenario decision algorithms.

算法学习安全决策理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。