构建首个用于医疗问答安全验证的基准,提升临床决策可靠性。
SCARE: A Benchmark for SQL Correction and Question Answerability Classification for Reliable EHR Question Answering
- 提出联合评估问题可答性与SQL纠错的双任务框架
- 涵盖4200组真实医疗数据三元组,覆盖7个主流模型生成的SQL
- 揭示分类与纠错间的性能权衡,助力安全部署
大型语言模型的发展推动了自然语言转结构化查询(text-to-SQL)在电子健康记录(EHR)中的应用,但其在临床环境中的安全部署仍面临挑战:错误的SQL查询(源于模型或用户输入)可能影响临床判断,危及患者安全。现有研究多聚焦于提升生成准确率或查询前过滤,缺乏对后置验证机制(即执行前检查生成SQL的安全层)的统一评估基准。为此,本文提出SCARE,一个面向医疗问答系统后置安全层的评估基准。该基准评估两个核心任务:(1)判断问题是否可答、模糊或不可答;(2)验证或修正候选SQL。数据集包含4200个三元组,源自MIMIC-III、MIMIC-IV和eICU数据库,涵盖7个不同text-to-SQL模型生成的查询。实验对比多种方法(从两阶段到智能体框架),发现问题分类与SQL纠错间存在显著性能权衡,揭示关键挑战并指引未来方向。
原文摘要 · Abstract (English)
Recent advances in Large Language Models (LLMs) have enabled the development of text-to-SQL models that allow clinicians to query structured data stored in Electronic Health Records (EHRs) using natural language. However, deploying these models for EHR question answering (QA) systems in safety-critical clinical environments remains challenging: incorrect SQL queries-whether caused by model errors or problematic user inputs-can undermine clinical decision-making and jeopardize patient care. While prior work has mainly focused on improving SQL generation accuracy or filtering questions before execution, there is a lack of a unified benchmark for evaluating independent post-hoc verification mechanisms (i.e., a component that inspects and validates the generated SQL before execution), which is crucial for safe deployment. To fill this gap, we introduce SCARE, a benchmark for evaluating methods that function as a post-hoc safety layer in EHR QA systems. SCARE evaluates the joint task of (1) classifying question answerability (i.e., determining whether a question is answerable, ambiguous, or unanswerable) and (2) verifying or correcting candidate SQL queries. The benchmark comprises 4,200 triples of questions, candidate SQL queries, and expected model outputs, grounded in the MIMIC-III, MIMIC-IV, and eICU databases. It covers a diverse set of questions and corresponding candidate SQL queries generated by seven different text-to-SQL models, ensuring a realistic and challenging evaluation. Using SCARE, we benchmark a range of approaches-from two-stage methods to agentic frameworks. Our experiments reveal a critical trade-off between question classification and SQL error correction, highlighting key challenges and outlining directions for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。