arXiv:2605.26942cs.AIcs.LO2026-05中稿 · technical communic…

用符号与神经方法结合,提升医疗等敏感领域大模型输出的可靠性。

Neuro-Symbolic Verification of LLM Outputs for Data-Sensitive Domains (extended preprint)

论文配图:Neuro-Symbolic Verification of LLM Outputs for Data-Sensitive Domains (extended preprint)
图 1 · 摘自论文原文
  • 分步验证:输入用逻辑推理保证结构正确,输出用语义相似度查幻觉。
  • 在真实医疗设备报告系统中,结构实体幻觉检测率超83%,语义幻觉达72%。
  • 适合医疗、金融等高风险场景,可减少报告撰写时间30%。

部署于高风险领域的大型语言模型面临根本性可靠性挑战:幻觉、不一致和隐私漏洞会带来法律、财务或安全后果。本文提出一种混合验证架构,结合形式化符号方法与神经语义分析,为模型生成内容提供互补保障。该架构采用逻辑推理进行输入验证,利用完备性特性对结构化需求提供可判定保证;输出验证则通过嵌入式语义相似度检测上下文幻觉,弥补形式方法表达力不足的问题。该分离机制通过并行、基于演员的流水线实现,克服了提示自验证方法继承分布偏见导致幻觉的局限。所提架构与类型感知验证方法在实际医疗设备损伤评估报告系统HAIMEDA上验证,结果显示结构化实体幻觉检测率达83%以上,语义虚构检测率达72%,报告生成时间减少30%,证明神经符号架构能为数据敏感领域的大模型部署提供可靠保障。

原文摘要 · Abstract (English)

LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce unacceptable risks where errors carry legal, financial, or safety consequences. This paper presents a hybrid verification architecture combining formal symbolic methods with neural semantic analysis to provide complementary guarantees for LLM-generated content. This architecture employs logical reasoning for input verification, leveraging completeness properties to provide decidable guarantees on structured requirements. For output validation, embedding-based semantic similarity detects contextual hallucinations where formal methods lack expressiveness. This separation is realized in a parallel, actor-based pipeline, addressing limitations of prompt-based self-verification approaches, which inherit the distributional biases that produce hallucinations. The proposed architecture and type-aware verification method are validated with HAIMEDA, a real-world medical device damage assessment reporting system developed through Action Design Research. Evaluation shows hallucination detection rates of over 83% for structured entities and 72% for semantic fabrications, with a 30% reduction in report creation time, demonstrating that neuro-symbolic architectures can provide principled safeguards for LLM deployment in data-sensitive domains.

大模型验证医疗AI神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。