用大模型生成实时系统可调度性证明脚本,提升自动化水平
PROVE-RT: Generating Mechanized Theorem Prover Scripts for Real-Time Systems using LLMs

- 通过依赖感知草图和文档检索引导大模型生成证明脚本
- 在精选数据集上成功率达44.7%,显著优于直接提示
- 适合需要形式化验证的实时系统研究者使用
可调度性分析对实时系统认证至关重要,但现有方法多依赖人工推导,难以扩展、验证与维护。PROSA/ROCQ的机械化验证提供严谨替代方案,但手动构建证明需大量领域知识与工程工作。大语言模型在多任务中表现优异,可能用于生成PROSA/ROCQ脚本。然而,当前主流LLMs缺乏PROSA特定知识,难以正确使用其建模抽象与证明模式。本文提出PROVE-RT,一个基于LLM的框架,用于生成实时系统文献中的PROSA/ROCQ机械化证明脚本。该框架通过依赖感知的非形式化草图、已处理的PROSA文档检索、分阶段脚本生成与证明补全来引导生成。我们从1,191篇实时系统论文构建了面向机械化的语料库,包含13,134个带依赖信息的非形式化草图。在筛选后的评估集上,直接提示先进LLMs无法可靠生成有效机械化证明,而PROVE-RT成功率达44.7%。结果表明,检索引导与分阶段的LLM辅助能有效提升PROSA/ROCQ中可调度性分析的自动化机械化水平。
原文摘要 · Abstract (English)
Schedulability analysis is essential for certifying real-time systems, but existing tests are often developed through pen-and-paper proofs that are difficult to scale, validate, and maintain. Mechanized verification in PROSA/ROCQ offers a rigorous alternative, yet manually constructing such proofs requires substantial domain expertise and proof-engineering effort. Recent successes of large language models (LLMs) across a wide range of tasks make them promising candidates for generating PROSA/ROCQ scripts for mechanized theorem provers. However, state-of-the-art LLMs often lack the PROSA-specific knowledge required to correctly use its modeling abstractions and proof patterns. This paper introduces PROVE-RT, an LLM-assisted framework for generating PROSA/ROCQ scripts to mechanize schedulability analyses in real-time systems literature. PROVE-RT guides generation through dependency-aware informal sketches, retrieval from processed PROSA documentation, staged skeleton generation, and proof completion. We construct a mechanization-oriented corpus from 1, 191 real-time systems papers, containing 13, 134 informal sketches with dependency information. On a curated evaluation set, direct prompting of state-of-the-art LLMs fails to reliably generate valid PROSA mechanizations, whereas PROVE-RT achieves a success rate of 44.7%. These results show that retrieval-guided and staged LLM assistance can improve automated mechanization of schedulability analysis in PROSA/ROCQ.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。