新医生上岗:用专家咨询和自回归推理实现病理切片持续学习
Welcome New Doctor: Continual Learning with Expert Consultation and Autoregressive Inference for Whole Slide Image Analysis
- 基于Transformer架构,通过专家咨询与自回归推理实现多任务病理切片持续学习
- 在7个器官、6种任务上表现优于现有方法,无需重训历史数据
- 适合需要长期更新模型的临床病理分析系统
全幻灯片图像(WSI)分析能揭示高倍放大下的组织结构细节,在癌症诊断与预后中至关重要。由于其具有吉字节级规模,处理和训练预测模型需大量存储与计算资源。随着临床中使用WSI的数量快速增长,亟需一种可高效处理并适应新任务的持续学习系统,避免对旧任务重新训练或微调。本研究提出COSFormer,一种专为多任务WSI分析设计的Transformer基持续学习框架,可顺序学习新任务而无需回看完整历史数据。我们在包含7个器官、6种任务的7个WSI数据集上,于类别增量与任务增量设置下评估该方法。结果表明,相比现有持续学习框架,COSFormer展现出更优的泛化能力与有效性,证明其在临床应用中具备鲁棒性。
原文摘要 · Abstract (English)
Whole Slide Image (WSI) analysis, with its ability to reveal detailed tissue structures in magnified views, plays a crucial role in cancer diagnosis and prognosis. Due to their giga-sized nature, WSIs require substantial storage and computational resources for processing and training predictive models. With the rapid increase in WSIs used in clinics and hospitals, there is a growing need for a continual learning system that can efficiently process and adapt existing models to new tasks without retraining or fine-tuning on previous tasks. Such a system must balance resource efficiency with high performance. In this study, we introduce COSFormer, a Transformer-based continual learning framework tailored for multi-task WSI analysis. COSFormer is designed to learn sequentially from new tasks wile avoiding the need to revisit full historical datasets. We evaluate COSFormer on a sequence of seven WSI datasets covering seven organs and six WSI-related tasks under both class-incremental and task-incremental settings. The results demonstrate COSFormer's superior generalizability and effectiveness compared to existing continual learning frameworks, establishing it as a robust solution for continual WSI analysis in clinical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。