用多智能体协作检测修正医疗文本错误,提升LLM在临床应用中的安全性。
MedGuards: Multi-Agent System for Reliable Medical Error Detection and Correction

- 分角色智能体分别负责找错、定位、纠错,通过置信度仲裁达成共识。
- 在4个跨国语临床数据集上,错误检测准确率提升18.7%,关键术语保留率提高23%。
- 适合医疗AI研发者、临床系统部署方,尤其关注安全性的大模型应用者。
随着大型语言模型(LLMs)在医疗场景中日益普及,生成或现有文本中的错误检测与修正变得至关重要,因为微小失误可能危及患者安全。现有方法如自动化检查和基于启发式规则的方案,在未见数据集上泛化能力差。本文提出MedGuards,一种医疗安全防护框架,将医学错误检测与修正视为多智能体上下文学习任务。专用智能体分别执行错误检测、定位与修正,由置信度引导的仲裁机制结合推理轨迹与置信分数解决分歧。该设计提升可解释性、鲁棒性与适应性,无需对基础模型进行额外训练。此外,我们引入关键词优先修正评分(KPCS),评估参考文本中关键术语是否被正确生成,提供比传统指标更全面的评估。在包含临床记录的四个多语言医疗数据集上的实验表明,所提框架在多个指标与模型上均有显著提升。为保证可复现性,代码已公开于https://github.com/congboma/MedGuards。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) are increasingly deployed in healthcare settings, accurate error detection and correction in generated or existing text becomes critical, as even minor mistakes can pose risks to patient safety. Existing methods for error detection and correction, including automated checks and heuristic-based approaches, do not generalize well across unseen datasets. In this paper, we propose MedGuards as a medical safety guardrail, which is a new framework that treats medical error detection and correction as a multi-agent in-context learning task. Specialized agents separately detect, localize, and correct errors, while a confidence-guided arbitration mechanism resolves disagreements using reasoning traces and confidence scores. This design enhances interpretability, robustness, and adaptability, without requiring additional training of the base LLMs. Additionally, we introduce the Keyword-Prioritized Correction Score (KPCS), a new evaluation metric that considers whether critical keywords within the reference text are generated correctly, providing a more comprehensive assessment than conventional metrics. Experiments across four multilingual medical datasets consisting of clinical notes demonstrate significant improvements by the proposed framework across several metrics and models. Our aim is to enable safer deployment of LLMs in real-world healthcare applications. For reproducibility, we make our code publicly available at https://github.com/congboma/MedGuards.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。