用符号推理提升大模型可信度,实现可验证的智能代理。
ATA: A Neuro-Symbolic Approach to Implement Autonomous and Trustworthy Agents
- 将任务分为离线知识构建与在线推理两阶段,用符号化知识库替代纯语言模型决策。
- 在复杂推理任务中性能媲美顶尖端到端模型,且结果完全确定、抗干扰强。
- 适合高安全场景,如医疗、金融,需透明可控决策的系统开发。
大型语言模型(LLMs)虽表现出强大能力,但在高风险领域部署受限于幻觉、不稳定性及缺乏透明性等固有缺陷。为此,我们提出一种通用神经符号方法——自主可信代理(ATA)。其核心是将任务解耦为两个阶段:离线知识摄入与在线任务处理。在知识摄入阶段,LLM将非正式问题描述转化为形式化符号知识库,该表示可由人类专家验证和修正,确保正确性与领域一致性。在任务处理阶段,每个输入被编码为同一形式语言,由符号决策引擎结合知识库生成可靠结果。在复杂推理任务上的广泛评估表明,ATA 实现方案在全自动设置下性能媲美当前最优端到端推理模型,同时保持高度可信。关键在于,经人工验证修正的知识库使该方法显著超越更大模型,且具备完全确定性、对输入扰动更强的稳定性,以及对提示注入攻击的天然免疫性。通过基于符号推理生成决策,ATA 提供了一种可解释、可审计、可靠的下一代自主代理架构。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated impressive capabilities, yet their deployment in high-stakes domains is hindered by inherent limitations in trustworthiness, including hallucinations, instability, and a lack of transparency. To address these challenges, we introduce a generic neuro-symbolic approach, which we call Autonomous Trustworthy Agents (ATA). The core of our approach lies in decoupling tasks into two distinct phases: Offline knowledge ingestion and online task processing. During knowledge ingestion, an LLM translates an informal problem specification into a formal, symbolic knowledge base. This formal representation is crucial as it can be verified and refined by human experts, ensuring its correctness and alignment with domain requirements. In the subsequent task processing phase, each incoming input is encoded into the same formal language. A symbolic decision engine then utilizes this encoded input in conjunction with the formal knowledge base to derive a reliable result. Through an extensive evaluation on a complex reasoning task, we demonstrate that a concrete implementation of ATA is competitive with state-of-the-art end-to-end reasoning models in a fully automated setup while maintaining trustworthiness. Crucially, with a human-verified and corrected knowledge base, our approach significantly outperforms even larger models, while exhibiting perfect determinism, enhanced stability against input perturbations, and inherent immunity to prompt injection attacks. By generating decisions grounded in symbolic reasoning, ATA offers a practical and controllable architecture for building the next generation of transparent, auditable, and reliable autonomous agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。