arXiv:2505.00466cs.LGcs.LO2025-05被引 3

将逻辑约束融入训练,让神经网络自动满足安全属性。

A General Framework for Property-Driven Machine Learning

  • 用可微逻辑将任意逻辑规则转为损失项,引导模型学习。
  • 在无人机控制器中验证,提升系统对复杂输入区域的鲁棒性。
  • 适合需要形式化保证的场景,如自动驾驶、控制系统。

神经网络仅依赖数据常无法学习关键的安全与正确性属性,亟需直接融合逻辑规范的训练方法。尽管对抗训练可在ε-立方体内提升对小扰动的鲁棒性,但控制与自然语言处理等领域的输入空间更复杂,需通过广义超矩形灵活定义。可微逻辑可将任意逻辑约束转化为额外损失项,引导学习过程满足这些约束。本文提出一个统一框架,融合这两种互补方法,推动神经网络的形式化验证。我们证明文献中的多个经典属性均为该框架的特例,并在无人机控制器案例中展示了其实际有效性。代码已开源:https://github.com/tflinkow/property-driven-ml。

原文摘要 · Abstract (English)

Neural networks have been shown to frequently fail to learn critical safety and correctness properties purely from data, highlighting the need for training methods that directly integrate logical specifications. While adversarial training can be used to improve robustness to small perturbations within $ε$-cubes, domains other than computer vision -- such as control systems and natural language processing -- may require more flexible input region specifications via generalised hyper-rectangles. Differentiable logics offer a way to encode arbitrary logical constraints as additional loss terms that guide the learning process towards satisfying these constraints. In this paper, we investigate how these two complementary approaches can be unified within a single framework for property-driven machine learning, as a step toward effective formal verification of neural networks. We show that well-known properties from the literature are subcases of this general approach, and we demonstrate its practical effectiveness on a case study involving a neural network controller for a drone system. Our framework is made publicly available at https://github.com/tflinkow/property-driven-ml.

机器学习逻辑约束形式验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。