arXiv:2501.04678eess.IVcs.CV2025-01ICCV被引 46

用AI自动生成高质量医学影像报告,构建首个带标注的腹部肿瘤数据集。

RadGPT: Constructing 3D Image-Text Tumor Datasets

  • 基于放射科医生修正的分割掩码,用RadGPT生成结构化报告
  • 创建9262组配对数据,新增3011个肿瘤病例,报告生成速度提升4.2倍
  • 适合医学AI、影像诊断和多模态模型研究者使用

CT扫描中发现的癌症通常伴随详细放射科报告,但公开的CT数据集常缺少这些关键信息,限制了报告生成AI的发展。为解决这一问题,我们提出AbdomenAtlas 3.0,首个公开且高质量的腹部CT数据集,包含专家审校的详细放射科报告。所有报告均与体素级掩码配对,描述肝、肾和胰腺肿瘤。该数据集包含9,262个CT、掩码与报告三元组,其中3,955个含肿瘤,数据源自17个公开数据集。除生成报告外,我们还将肿瘤掩码数量扩大4.2倍,识别出3,011个新肿瘤病例。报告更标准化,生成更快。其内容涵盖肿瘤大小、位置、密度及可切除性等细节。报告由12位认证放射科医生使用我们提出的RadGPT框架生成,该框架将放射科医生修订的肿瘤分割掩码转化为结构化叙事报告。除了用于数据集构建,RadGPT还可作为全自动、分割辅助的报告生成方法。我们在5个前沿视觉-语言模型上进行了基准测试,结果表明分割显著提升了AI生成报告中的肿瘤检测能力。

原文摘要 · Abstract (English)

Cancers identified in CT scans are usually accompanied by detailed radiology reports, but publicly available CT datasets often lack these essential reports. This absence limits their usefulness for developing accurate report generation AI. To address this gap, we present AbdomenAtlas 3.0, the first public, high-quality abdominal CT dataset with detailed, expert-reviewed radiology reports. All reports are paired with per-voxel masks and they describe liver, kidney and pancreatic tumors. AbdomenAtlas 3.0 has 9,262 triplets of CT, mask and report--3,955 with tumors. These CT scans come from 17 public datasets. Besides creating the reports for these datasets, we expanded their number of tumor masks by 4.2x, identifying 3,011 new tumor cases. Notably, the reports in AbdomenAtlas 3.0 are more standardized, and generated faster than traditional human-made reports. They provide details like tumor size, location, attenuation and surgical resectability. These reports were created by 12 board-certified radiologists using our proposed RadGPT, a novel framework that converted radiologist-revised tumor segmentation masks into structured and narrative reports. Besides being a dataset creation tool, RadGPT can also become a fully-automatic, segmentation-assisted report generation method. We benchmarked this method and 5 state-of-the-art report generation vision-language models. Our results show that segmentation strongly improves tumor detection in AI-made reports.

医学影像报告生成数据集多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。