arXiv:2509.02491cs.LGcs.FL2025-09被引 1

RNN能泛化到复杂时序逻辑语言,验证规模超训练数据8倍

RNN Generalization to Omega-Regular Languages

  • 用RNN学习时序逻辑生成的无限序列模式
  • 在长达训练长度8倍的测试序列上达到92.6%任务完美泛化
  • 为神经符号验证提供新思路,适合形式化验证研究者

Büchi自动机(BAs)可识别由线性时序逻辑(LTL)等形式规范定义的ω-正则语言,常用于反应系统验证。但面对复杂系统行为时,BAs存在可扩展性问题。随着神经网络在模型检测等领域应用增多,研究其对训练数据外样本的泛化能力变得必要。本文首次系统探究循环神经网络(RNN)是否能泛化至由LTL公式导出的ω-正则语言。我们在最终周期性的ω-词序列上训练RNN以模仿目标BA行为,并评估其在分布外序列上的泛化性能。基于对应确定性自动机状态数从3到超过100的LTL公式实验结果表明,当测试序列长度达训练样本的8倍时,RNN在92.6%的任务中实现完美或近乎完美的泛化。该结果证实了神经方法学习复杂ω-正则语言的可行性,暗示其在神经符号验证中的潜力。

原文摘要 · Abstract (English)

Büchi automata (BAs) recognize $ω$-regular languages defined by formal specifications like linear temporal logic (LTL) and are commonly used in the verification of reactive systems. However, BAs face scalability challenges when handling and manipulating complex system behaviors. As neural networks are increasingly used to address these scalability challenges in areas like model checking, investigating their ability to generalize beyond training data becomes necessary. This work presents the first study investigating whether recurrent neural networks (RNNs) can generalize to $ω$-regular languages derived from LTL formulas. We train RNNs on ultimately periodic $ω$-word sequences to replicate target BA behavior and evaluate how well they generalize to out-of-distribution sequences. Through experiments on LTL formulas corresponding to deterministic automata of varying structural complexity, from 3 to over 100 states, we show that RNNs achieve high accuracy on their target $ω$-regular languages when evaluated on sequences up to $8 \times$ longer than training examples, with $92.6\%$ of tasks achieving perfect or near-perfect generalization. These results establish the feasibility of neural approaches for learning complex $ω$-regular languages, suggesting their potential as components in neurosymbolic verification methods.

时序逻辑RNN泛化形式验证神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。