用大模型自动提炼法律安全规则,确保自动驾驶系统合规可靠。
Towards Neuro-symbolic Causal Rule Synthesis, Verification, and Evaluation Grounded in Legal and Safety Principles
- 用大模型将人类目标分解为候选因果,生成逻辑规则
- 通过语法、逻辑与安全校验,构建可验证的最小规则集
- 适合需要合规性保障的自动驾驶等高风险场景
基于规则的系统在安全关键领域仍占核心地位,但常面临可扩展性差、脆弱和目标错设问题,易导致奖励劫持与形式验证失败。此前研究提出神经符号因果框架,融合一阶逻辑反演树、结构因果模型与深度强化学习,在MAPE-K循环中实现分布偏移下的可解释自适应。本文在此基础上引入元层,包含目标/规则合成器与规则验证引擎,从人类专家提供的自然语言目标与原则出发,迭代优化形式化规则理论。合成流程利用大语言模型(LLMs):(1) 将目标分解为候选原因,(2) 整合语义去除冗余,(3) 转换为候选一阶规则,(4) 组成必要且充分的因果集合。验证流程执行:(1) 语法与模式校验,(2) 逻辑一致性分析,(3) 安全性与不变量检查后,将验证规则整合至知识库。在两个自动驾驶场景的原型验证表明,给定人类设定的目标与原则,该流程可成功推导出最小必要且充分的规则集,并形式化为逻辑约束。结果表明,该流程支持增量式、模块化与可追溯的规则合成,扎根于既有的法律与安全原则。
原文摘要 · Abstract (English)
Rule-based systems remain central in safety-critical domains but often struggle with scalability, brittleness, and goal misspecification. These limitations can lead to reward hacking and failures in formal verification, as AI systems tend to optimize for narrow objectives. In previous research, we developed a neuro-symbolic causal framework that integrates first-order logic abduction trees, structural causal models, and deep reinforcement learning within a MAPE-K loop to provide explainable adaptations under distribution shifts. In this paper, we extend that framework by introducing a meta-level layer designed to mitigate goal misspecification and support scalable rule maintenance. This layer consists of a Goal/Rule Synthesizer and a Rule Verification Engine, which iteratively refine a formal rule theory from high-level natural-language goals and principles provided by human experts. The synthesis pipeline employs large language models (LLMs) to: (1) decompose goals into candidate causes, (2) consolidate semantics to remove redundancies, (3) translate them into candidate first-order rules, and (4) compose necessary and sufficient causal sets. The verification pipeline then performs (1) syntax and schema validation, (2) logical consistency analysis, and (3) safety and invariant checks before integrating verified rules into the knowledge base. We evaluated our approach with a proof-of-concept implementation in two autonomous driving scenarios. Results indicate that, given human-specified goals and principles, the pipeline can successfully derive minimal necessary and sufficient rule sets and formalize them as logical constraints. These findings suggest that the pipeline supports incremental, modular, and traceable rule synthesis grounded in established legal and safety principles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。