构建多模态脑瘤分类数据集,支持不完整医疗信息下的鲁棒诊断研究。
CoRe-BT: A Multimodal Radiology-Pathology-Text Benchmark for Robust Brain Tumor Typing
- 整合影像、病理切片与报告,构建跨模态脑瘤诊断基准
- 涵盖310例患者,6类胶质瘤亚型,支持缺失模态下的学习
- 适用于临床真实场景中多模态融合模型的研发与评估
准确的脑瘤分型需融合磁共振成像(MRI)、组织病理学及病理报告等异构临床证据,但诊断时常存在数据不全。本文提出CoRe-BT,一个面向脑瘤分型的跨模态影像-病理-文本基准数据集,用于研究缺失模态条件下的鲁棒多模态学习。数据集包含310名患者,涵盖多序列MRI(T1、T1c、T2、FLAIR),其中95例配有H&E染色全切片病理图像和病理报告。所有病例均标注肿瘤类型与分级,且MRI数据含专家标注的肿瘤掩码,支持区域感知建模与辅助学习任务。肿瘤分为六类,覆盖常见与罕见胶质瘤亚型。通过对比仅用MRI的模型与可融合病理信息的多模态方法,评估不同模态可用性下的分型性能。基线实验验证了多模态融合的可行性,并揭示各模态在关键分型任务中的互补作用。CoRe-BT为真实临床数据不全场景下的多模态胶质瘤分型与表征学习提供了可靠测试平台。
原文摘要 · Abstract (English)
Accurate brain tumor typing requires integrating heterogeneous clinical evidence, including magnetic resonance imaging (MRI), histopathology, and pathology reports, which are often incomplete at the time of diagnosis. We introduce CoRe-BT, a cross-modal radiology-pathology-text benchmark for brain tumor typing, designed to study robust multimodal learning under missing modality conditions. The dataset comprises 310 patients with multi-sequence brain MRI (T1, T1c, T2, FLAIR), including 95 cases with paired H&E-stained whole-slide pathology images and pathology reports. All cases are annotated with tumor type and grade, and MRI volumes include expert-annotated tumor masks, enabling both region-aware modeling and auxiliary learning tasks. Tumors are categorized into six clinically relevant classes capturing the heterogeneity of common and rare glioma subtypes. We evaluate tumor typing under variable modality availability by comparing MRI-only models with multimodal approaches that incorporate pathology information when present. Baseline experiments demonstrate the feasibility of multimodal fusion and highlight complementary modality contributions across clinically relevant typing tasks. CoRe-BT provides a grounded testbed for advancing multimodal glioma typing and representation learning in realistic scenarios with incomplete clinical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。