arXiv:2606.18068cs.AI2026-06被引 1

用多智能体框架解决医疗AI过早下诊断和隐性幻觉问题

Agentic AI-based Framework for Mitigating Premature Diagnostic Handoff and Silent Hallucination in Healthcare Applications

论文配图:Agentic AI-based Framework for Mitigating Premature Diagnostic Handoff and Silent Hallucination in Healthcare Applications
图 1 · 摘自论文原文
  • 用确定性调度替代LLM评判,强制收集完整临床信息
  • 诊断准确率提升11.3个百分点,达49.3%
  • 通过语义熵检测异常输出,适合高风险医疗场景

大型语言模型与多智能体系统的进展推动了代理型AI在医疗推理中的应用。然而,开放对话代理仍存在两个关键缺陷:过早做出诊断和未被察觉的临床幻觉。本文提出一种多智能体框架,通过用确定性编排约束替代“以LLM为裁判”的路由机制来解决上述问题。系统包含两项安全机制:其一,神经符号状态追踪门强制执行OLDCARTS临床协议(发作、部位、持续时间、性质、加重/缓解因素、放射、时间、严重程度),在所有维度信息收集完成前阻止诊断转移;其二,基于认知不确定性的量化门(UQ)通过计算K=5个独立诊断样本间的语义熵(H)识别并拦截分歧输出。在150个测试案例上,使用llama-3.1-70b-instruct驱动的模拟患者代理进行评估,完整架构实现49.3%的诊断精度,相比无约束基线绝对提升11.3个百分点。此外,观察到OLDCARTS完整性(σ)与语义熵(H)之间存在统计显著的负相关关系(r = -0.181,p < 0.05),表明结构化信息收集与降低诊断不确定性相关。

原文摘要 · Abstract (English)

Recent advances in Large Language Models (LLMs) and multi-agent systems have driven the rise of Agentic AI, showing promise for medical reasoning. However, open-ended conversational agents remain prone to two critical failure modes: premature diagnostic handoff and silent clinical hallucinations that may go undetected before reaching the patient. In this work, we propose a multi-agent framework that addresses both issues by replacing ``LLM-as-a-judge'' routing with deterministic orchestration constraints. The framework incorporates two safety mechanisms. First, a neuro-symbolic state-tracking gate enforces completeness of the OLDCARTS clinical protocol (Onset, Location, Duration, Character, Aggravating/Alleviating factors, Radiation, Timing, and Severity) by blocking diagnostic transitions until all required dimensions are collected. Second, an epistemic uncertainty quantification (UQ) gate computes semantic entropy (H) across K=5 independent diagnostic samples to identify and intercept divergent outputs before delivery. We evaluate the system using simulated patient agents powered by the llama-3.1-70b-instruct model on 150 test cases. The full architecture achieves 49.3% diagnostic precision, representing an absolute improvement of 11.3 percentage points over an unconstrained baseline. Additionally, we observe a statistically significant negative correlation (r = -0.181, p < 0.05) between OLDCARTS completeness (σ) and semantic entropy (H), suggesting that structured information gathering is associated with reduced diagnostic uncertainty.

医疗AI多智能体幻觉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。