arXiv:2510.13500cs.CLcs.AI2025-10被引 6

医学大模型精准编辑新框架,支持批量修正错误知识

MedREK: Retrieval-Based Editing for Medical LLMs with Key-Aware Prompts

  • 用关键感知提示增强检索匹配精度
  • 在多个医学基准上实现更高编辑准确率
  • 首个支持批量编辑的医疗大模型修正方案

大语言模型在医疗应用中前景广阔,但医学知识快速更新及训练数据错误常导致其生成过时或不准确信息,限制其在临床实践中的应用。模型编辑被视为无需全量重训的解决方案。参数编辑易破坏局部性,不适用于医疗场景;而基于检索的编辑更具可行性,但仍面临两大挑战:(1) 医学知识空间内表示重叠导致检索不准,降低编辑精度;(2) 现有方法仅支持单样本编辑,批量编辑尚未探索,但对真实医疗应用至关重要。为此,我们构建了覆盖更广医学主题的 MedVersa 增强基准,用于在严格局部性约束下评估单样本与批量编辑。提出 MedREK 框架,融合共享查询-键模块实现精准匹配,以及基于注意力的提示编码器提供有效引导。在多个医学基准上的实验表明,MedREK 在各项核心指标上表现更优,并提供了首个经验证的医疗大模型批量编辑解决方案。代码与数据集已开源。

原文摘要 · Abstract (English)

LLMs hold great promise for healthcare applications, but the rapid evolution of medical knowledge and errors in training data often cause them to generate outdated or inaccurate information, limiting their applicability in high-stakes clinical practice. Model editing has emerged as a potential remedy without full retraining. While parameter-based editing often compromises locality and is thus ill-suited for the medical domain, retrieval-based editing offers a more viable alternative. However, it still faces two critical challenges: (1) representation overlap within the medical knowledge space often causes inaccurate retrieval and reduces editing accuracy; (2) existing methods are restricted to single-sample edits, while batch-editing remains largely unexplored despite its importance for real-world medical applications. To address these challenges, we first construct MedVersa, an enhanced benchmark with broader coverage of medical subjects, designed to evaluate both single and batch edits under strict locality constraints. We then propose MedREK, a retrieval-based editing framework that integrates a shared query-key module for precise matching with an attention-based prompt encoder for informative guidance. Experimental results on various medical benchmarks demonstrate that our MedREK achieves superior performance across different core metrics and provides the first validated solution for batch-editing in medical LLMs. Our code and dataset are available at https://github.com/mylittleriver/MedREK.

医学大模型模型编辑检索增强批量修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。