arXiv:2605.13817cs.SEcs.AI2026-05

用大模型+逻辑求解器自动检测医疗设备软件需求中的模糊与漏洞。

Neurosymbolic Auditing of Natural-Language Software Requirements

论文配图:Neurosymbolic Auditing of Natural-Language Software Requirements
图 1 · 摘自论文原文
  • 将自然语言需求转为形式化逻辑,通过随机生成不同形式化结果判断模糊性。
  • 在透析问答任务中,精准反馈使验证准确率从55.4%提升至98.5%。
  • 适合安全关键领域需求审计,尤其适用于医疗设备等高风险场景。

自然语言编写的软件需求常存在歧义、不一致和表述不足的问题;在安全关键领域,这些缺陷会传递到形式化模型和实现中,导致验证错误规范并发布不安全行为。本文提出VERIMED,一种神经符号管道,利用大语言模型结合SMT求解器对医疗设备软件需求进行审计:将需求转化为形式逻辑,通过生成形式化过程的随机变异检测歧义,借助求解器查询暴露不一致、空洞及安全违规。实验表明,独立形式化间的差异可作为歧义信号——产生非等价形式化的需求数量显著增多;在透析问答基准上,细粒度的SMT反例反馈使验证准确率从55.4%跃升至98.5%。在开源透析安全需求上的广泛评估显示,该方法有效降低敏感歧义需求比例,并支持通过SMT查询实现严谨的需求审计。

原文摘要 · Abstract (English)

Natural-language software requirements are often ambiguous, inconsistent, and underspecified; in safety-critical domains, these defects propagate into formal models that verify the wrong specification and into implementations that ship unsafe behavior. We show that large language models, equipped with an SMT solver, can audit such requirements: translating them into formal logic, detecting ambiguity through stochastic variation in the generated formalization, and exposing inconsistency, vacuousness, and safety violations through solver queries on the resulting specification. We present VERIMED, a neurosymbolic pipeline that operationalizes this idea for medical-device software requirements, and report two findings. First, stochastic variation across independent formalizations is a signal of ambiguity: requirements that admit multiple plausible interpretations produce SMT-inequivalent formalizations, and bidirectional SMT equivalence checking turns this disagreement into a solver-checkable test. Second, the usefulness of symbolic feedback depends on its granularity: in counterexample-guided repair on a hemodialysis question-answering benchmark, concrete SMT counterexamples raise verified accuracy from 55.4% to 98.5%. Over an extensive experimental evaluation on open-source hemodialysis safety requirements, we show that the LLM-based approach in VERIMED successfully reduces ambiguity-sensitive requirements and enables rigorous auditing of software requirements through SMT-based queries.

需求审计大模型SMT求解医疗设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。