arXiv:2503.13330eess.IVcs.AI2025-03中稿 · ance被引 4

用大模型自动标注腹部CT报告中的异常,准确率超人工。

LEAVS: An LLM-based Labeler for Abdominal CT Supervision

  • 基于链式思考提示的本地化大模型,分步提取报告信息。
  • 平均F1达0.89,异常检测与紧急程度标注均接近人工水平。
  • 适合医学影像训练数据自动生成,尤其腹部CT研究者。

从放射科报告中提取结构化标签已被用于训练多病种检测视觉模型。然而,现有工作主要聚焦于胸部区域,腹部因解剖复杂、病种多样,相关研究较少。本文提出LEAVS(基于大语言模型的腹部视觉监督标注器),可对九个腹部器官的七类异常进行存在性确定度与紧急程度标注。为保证覆盖全面,选取了涵盖多数常见发现类型的异常。方法采用本地部署大模型,结合句子提取与树状决策系统的多选问答链式思考提示策略。实验表明,该模型在跨腹部器官的多种异常检测上平均F1达到0.89,显著优于现有标注工具和人类标注;紧急程度标注性能也与人工相当。此外,生成的异常标签可有效用于训练单一视觉模型,实现多器官正常/异常分类。我们已公开代码及包含超过1000个CT体数据的结构化标注集。

原文摘要 · Abstract (English)

Extracting structured labels from radiology reports has been employed to create vision models to simultaneously detect several types of abnormalities. However, existing works focus mainly on the chest region. Few works have been investigated on abdominal radiology reports due to more complex anatomy and a wider range of pathologies in the abdomen. We propose LEAVS (Large language model Extractor for Abdominal Vision Supervision). This labeler can annotate the certainty of presence and the urgency of seven types of abnormalities for nine abdominal organs on CT radiology reports. To ensure broad coverage, we chose abnormalities that encompass most of the finding types from CT reports. Our approach employs a specialized chain-of-thought prompting strategy for a locally-run LLM using sentence extraction and multiple-choice questions in a tree-based decision system. We demonstrate that the LLM can extract several abnormality types across abdominal organs with an average F1 score of 0.89, significantly outperforming competing labelers and humans. Additionally, we show that extraction of urgency labels achieved performance comparable to human annotations. Finally, we demonstrate that the abnormality labels contain valuable information for training a single vision model that classifies several organs as normal or abnormal. We release our code and structured annotations for a public CT dataset containing over 1,000 CT volumes.

医学影像大模型标注工具CT分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。