基于临床模板构建病理问答数据集,提升模型对病理切片的理解能力
CTIS-QA: Clinical Template-Informed Slide-level Question Answering for Pathology
- 用临床诊断模板标准化提取病理报告信息
- 构建含804个WSI、14,879个问答对的严谨评测基准
- 双流模型模拟病理医生思路,显著优于现有方法
本文提出一种基于临床诊断模板的病理信息收集与结构化流程。在美国家庭病理学会(CAP)癌症指南指导下,与病理科医生合作设计临床病理报告模板(CPRT),确保诊断要素的全面与标准化提取。在TCGA-BRCA数据集上验证该流程:利用CPRT从报告中提取病理特征,构建包含80,000张切片-描述对的CTIS-Align数据集用于视觉语言对齐训练,以及包含977个全切片图像(WSI)和14,879个问答对的严格评测基准CTIS-Bench。CTIS-Bench强调基于临床实际、封闭式问题(如肿瘤分级、受体状态),减少非视觉推理,要求真正理解切片内容。进一步提出CTIS-QA模型,采用双流架构,一通道通过聚类聚合获取全局切片上下文,另一通道通过注意力引导的局部感知模块聚焦关键区域。在WSI-VQA、CTIS-Bench及切片级诊断任务上的大量实验表明,CTIS-QA在多个指标上持续优于现有最先进模型。代码与数据见https://github.com/HLSvois/CTIS-QA。
原文摘要 · Abstract (English)
In this paper, we introduce a clinical diagnosis template-based pipeline to systematically collect and structure pathological information. In collaboration with pathologists and guided by the the College of American Pathologists (CAP) Cancer Protocols, we design a Clinical Pathology Report Template (CPRT) that ensures comprehensive and standardized extraction of diagnostic elements from pathology reports. We validate the effectiveness of our pipeline on TCGA-BRCA. First, we extract pathological features from reports using CPRT. These features are then used to build CTIS-Align, a dataset of 80k slide-description pairs from 804 WSIs for vision-language alignment training, and CTIS-Bench, a rigorously curated VQA benchmark comprising 977 WSIs and 14,879 question-answer pairs. CTIS-Bench emphasizes clinically grounded, closed-ended questions (e.g., tumor grade, receptor status) that reflect real diagnostic workflows, minimize non-visual reasoning, and require genuine slide understanding. We further propose CTIS-QA, a Slide-level Question Answering model, featuring a dual-stream architecture that mimics pathologists' diagnostic approach. One stream captures global slide-level context via clustering-based feature aggregation, while the other focuses on salient local regions through attention-guided patch perception module. Extensive experiments on WSI-VQA, CTIS-Bench, and slide-level diagnostic tasks show that CTIS-QA consistently outperforms existing state-of-the-art models across multiple metrics. Code and data are available at https://github.com/HLSvois/CTIS-QA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。