arXiv:2509.04482cs.CLcs.AI2025-09被引 1

用能量模型提升医疗RAG系统拒答可靠性,关键时刻更敢说'不知道'

Energy Landscapes Enable Reliable Abstention in Retrieval-Augmented Large Language Models for Healthcare

  • 基于260万条医疗指南问题构建平滑能量景观,判断何时该拒绝回答
  • 在难例上达到0.961的AUROC,误报率降低至0.235
  • 适合对安全敏感的医疗AI场景,尤其在语义复杂时表现更优

可靠拒答对检索增强生成(RAG)系统至关重要,尤其在女性健康等高风险领域,错误回答可能造成伤害。本文提出一种基于能量的模型(EBM),在包含260万条指南衍生问题的密集语义语料上学习平滑能量景观,使系统能自主决定是否生成回答。我们在易例和难例两种拒答测试集上对比EBM与校准软最大值基线及kNN密度启发式方法。在语义困难的案例中,EBM表现更优,达到0.961的AUROC(软最大值为0.950),同时将FPR@95降低至0.235(软最大值为0.331)。在简单负例上各方法表现相近,但EBM在安全关键的难分布中优势显著。消融实验表明,鲁棒性主要来自能量评分头,而负样本类型(难、易、混合)虽影响决策边界,但非泛化到难例的关键。结果表明,能量基拒答评分比概率基软最大值更可靠,为安全RAG系统提供了可扩展且可解释的基础。

原文摘要 · Abstract (English)

Reliable abstention is critical for retrieval-augmented generation (RAG) systems, particularly in safety-critical domains such as women's health, where incorrect answers can lead to harm. We present an energy-based model (EBM) that learns a smooth energy landscape over a dense semantic corpus of 2.6M guideline-derived questions, enabling the system to decide when to generate or abstain. We benchmark the EBM against a calibrated softmax baseline and a k-nearest neighbour (kNN) density heuristic across both easy and hard abstention splits, where hard cases are semantically challenging near-distribution queries. The EBM achieves superior abstention performance abstention on semantically hard cases, reaching AUROC 0.961 versus 0.950 for softmax, while also reducing FPR@95 (0.235 vs 0.331). On easy negatives, performance is comparable across methods, but the EBM's advantage becomes most pronounced in safety-critical hard distributions. A comprehensive ablation with controlled negative sampling and fair data exposure shows that robustness stems primarily from the energy scoring head, while the inclusion or exclusion of specific negative types (hard, easy, mixed) sharpens decision boundaries but is not essential for generalisation to hard cases. These results demonstrate that energy-based abstention scoring offers a more reliable confidence signal than probability-based softmax confidence, providing a scalable and interpretable foundation for safe RAG systems.

医疗AIRAG能量模型拒答机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。