提出H-CNN-ViT模型,用多模态MRI预测膀胱癌复发,准确率超现有方法。
H-CNN-ViT: A Hierarchical Gated Attention Multi-Branch Model for Bladder Cancer Recurrence Prediction
- 分层门控注意力多分支结构,动态融合局部与全局特征。
- 在自建数据集上达到78.6%的AUC,优于当前最优模型。
- 适合医学影像分析、癌症复发预测方向的研究者使用。
膀胱癌是全球最常见的恶性肿瘤之一,术后复发率高达78%,亟需精准的监测手段以实现有效患者管理。多序列增强MRI常用于复发检测,但术后瘢痕、肿胀和组织重塑等变化使影像解读极具挑战,即便经验丰富的放射科医生也难以准确判断。尽管人工智能辅助诊断在提升复发预测方面展现潜力,但该领域进展受限于缺乏专门用于复发评估的多序列MRI数据集。本文首次构建了一个针对膀胱癌复发预测的多序列、多模态MRI数据集,为未来研究提供重要基准。在此基础上,提出H-CNN-ViT模型——一种分层门控注意力多分支架构,可根据上下文需求动态加权全局(ViT)与局部(CNN)路径的特征,实现平衡且有针对性的特征融合。模型采用独立处理各模态的多分支设计,充分保留每种成像通道的独特属性并实现最优整合。在自建数据集上的评估显示,该模型达到78.6%的AUC,显著超越现有先进模型。代码已公开于https://github.com/XLIAaron/H-CNN-ViT。
原文摘要 · Abstract (English)
Bladder cancer is one of the most prevalent malignancies worldwide, with a recurrence rate of up to 78%, necessitating accurate post-operative monitoring for effective patient management. Multi-sequence contrast-enhanced MRI is commonly used for recurrence detection; however, interpreting these scans remains challenging, even for experienced radiologists, due to post-surgical alterations such as scarring, swelling, and tissue remodeling. AI-assisted diagnostic tools have shown promise in improving bladder cancer recurrence prediction, yet progress in this field is hindered by the lack of dedicated multi-sequence MRI datasets for recurrence assessment study. In this work, we first introduce a curated multi-sequence, multi-modal MRI dataset specifically designed for bladder cancer recurrence prediction, establishing a valuable benchmark for future research. We then propose H-CNN-ViT, a new Hierarchical Gated Attention Multi-Branch model that enables selective weighting of features from the global (ViT) and local (CNN) paths based on contextual demands, achieving a balanced and targeted feature fusion. Our multi-branch architecture processes each modality independently, ensuring that the unique properties of each imaging channel are optimally captured and integrated. Evaluated on our dataset, H-CNN-ViT achieves an AUC of 78.6%, surpassing state-of-the-art models. Our model is publicly available at https://github.com/XLIAaron/H-CNN-ViT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。