arXiv:2505.21190cs.CLcs.AI2025-05被引 7

首个支持纵向分析的胸部X光报告评估基准,提升医疗文本理解精度

Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretation

  • 构建多时序结构化报告数据集,支持跨检查时间点分析
  • 提出可解释评估指标LUNGUAGESCORE,捕捉实体与时间一致性
  • 适合医学AI、影像诊断系统研发者使用

放射科报告包含详细的临床观察和随时间演化的诊断推理,但现有评估方法仅限于单份报告,依赖粗粒度指标,难以捕捉细粒度临床语义与时间依赖关系。我们提出LUNGUAGE,一个支持单报告与纵向患者级评估的结构化放射科报告生成基准数据集。该数据集包含1,473份经专家标注的胸片报告,其中186份含纵向标注,用于捕捉疾病进展与检查间隔,均由专家审核。基于此,我们设计两阶段结构化框架,将生成报告转化为符合模板的细粒度结构化报告,实现纵向解读。同时提出LUNGUAGESCORE,一种在实体、关系、属性层面比较结构化输出并建模患者时间线一致性的可解释评估指标。这些贡献首次建立了序列化放射科报告的基准数据集、结构化框架与评估指标,实验证明其有效支持结构化报告评估。代码已开源。

原文摘要 · Abstract (English)

Radiology reports convey detailed clinical observations and capture diagnostic reasoning that evolves over time. However, existing evaluation methods are limited to single-report settings and rely on coarse metrics that fail to capture fine-grained clinical semantics and temporal dependencies. We introduce LUNGUAGE, a benchmark dataset for structured radiology report generation that supports both single-report evaluation and longitudinal patient-level assessment across multiple studies. It contains 1,473 annotated chest X-ray reports, each reviewed by experts, and 186 of them contain longitudinal annotations to capture disease progression and inter-study intervals, also reviewed by experts. Using this benchmark, we develop a two-stage structuring framework that transforms generated reports into fine-grained, schema-aligned structured reports, enabling longitudinal interpretation. We also propose LUNGUAGESCORE, an interpretable metric that compares structured outputs at the entity, relation, and attribute level while modeling temporal consistency across patient timelines. These contributions establish the first benchmark dataset, structuring framework, and evaluation metric for sequential radiology reporting, with empirical results demonstrating that LUNGUAGESCORE effectively supports structured report evaluation. The code is available at: https://github.com/SuperSupermoon/Lunguage

医学影像结构化报告时间序列评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。