arXiv:2511.11656cs.LGcs.AI2025-11AAAI被引 4

提出新方法在高维空间高效估算神经网络输入区域,保证结果可靠性。

On the Probabilistic Learnability of Compact Neural Network Preimage Bounds

  • 用随机决策树集成生成满足输出属性的输入区域
  • 理论证明区域纯度与覆盖范围有统计保障
  • 适合需要可靠、可扩展预像近似的人工智能研究者

尽管近期已发展出可证明的神经网络预像边界计算方法,但其可扩展性受问题#P难性的根本限制。本文采用新的概率视角,旨在提供高置信度保证且误差有界的解法。我们研究了基于自助采样和随机化的方法,以捕捉高维空间中的复杂模式,包括满足给定输出属性的输入区域。具体地,提出$ exttt{RF-ProVe}$方法,利用一组随机决策树生成满足目标输出属性的候选输入区域,并通过主动重采样进行优化。理论推导提供了区域纯度与全局覆盖的正式统计保证,为精确求解器无法扩展的情形下,提供了一种实用且可扩展的紧凑预像逼近方案。

原文摘要 · Abstract (English)

Although recent provable methods have been developed to compute preimage bounds for neural networks, their scalability is fundamentally limited by the #P-hardness of the problem. In this work, we adopt a novel probabilistic perspective, aiming to deliver solutions with high-confidence guarantees and bounded error. To this end, we investigate the potential of bootstrap-based and randomized approaches that are capable of capturing complex patterns in high-dimensional spaces, including input regions where a given output property holds. In detail, we introduce $\textbf{R}$andom $\textbf{F}$orest $\textbf{Pro}$perty $\textbf{Ve}$rifier ($\texttt{RF-ProVe}$), a method that exploits an ensemble of randomized decision trees to generate candidate input regions satisfying a desired output property and refines them through active resampling. Our theoretical derivations offer formal statistical guarantees on region purity and global coverage, providing a practical, scalable solution for computing compact preimage approximations in cases where exact solvers fail to scale.

神经网络预像边界概率方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。