用轻量方法实现病理全切片图像的高效端到端训练。
Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis
- 结合参数高效微调与多实例学习,避免大模型预训练开销。
- 在7个任务上表现媲美甚至超过域内预训练模型。
- 适合资源有限但需精准病理分析的研究者使用。
全切片图像(WSI)的计算分析可支持病理医生早期诊断和肿瘤检测分类。然而,WSI极高的分辨率使得端到端训练远超常规图像分析任务的可行性。现有方法通常采用ImageNet等自然图像数据集预训练的特征提取器,生成固定表示,再结合多实例学习(MIL)完成下游任务。这些提取器难以捕捉组织病理学的领域特异性特征。尽管在病理数据上进行领域特定预训练能获得更相关表征,但仍面临计算成本高、缺乏任务特异性的问题。为此,我们提出eWSI,通过精细整合参数高效微调(PEFT)与多实例学习(MIL),实现WSI任务的端到端训练。我们在Camelyon16、TCGA和BRACS数据集上的7个WSI级任务中评估eWSI。结果表明,即使仅使用ImageNet特征提取器,eWSI也能达到强分类性能,匹配或超越使用域内提取器的MIL模型,从而减轻对大规模域内预训练的需求。当搭配域内提取器时,多数情况下进一步提升分类效果,证明其可有效捕捉任务特异性信息。研究显示,eWSI为计算病理学中的任务导向学习提供了一条高效可行路径。
原文摘要 · Abstract (English)
Computational methods on analyzing Whole Slide Images (WSIs) enable early diagnosis and treatments by supporting pathologists in detection and classification of tumors. However, the extremely high resolution of WSIs makes end-to-end training impractical compared to typical image analysis tasks. To address this, most approaches use pre-trained feature extractors to obtain fixed representations of whole slides, which are then combined with Multiple Instance Learning (MIL) for downstream tasks. These feature extractors are typically pre-trained on natural image datasets such as ImageNet, which fail to capture domain-specific characteristics. Although domain-specific pre-training on histopathology data yields more relevant feature representations, it remains computationally expensive and fail to capture task-specific characteristics within the domain. To address the computational cost and lack of task-specificity in domain-specific pre-training, we propose EfficientWSI (eWSI), a careful integration of Parameter-Efficient-Fine-Tuning (PEFT) and Multiple Instance Learning (MIL) that enables end-to-end training on WSI tasks. We evaluate eWSI on seven WSI-level tasks over Camelyon16, TCGA and BRACS datasets. Our results show that eWSI when applied with ImageNet feature extractors yields strong classification performance, matching or outperforming MILs with in-domain feature extractors, alleviating the need for extensive in-domain pre-training. Furthermore, when eWSI is applied with in-domain feature extractors, it further improves classification performance in most cases, demonstrating its ability to capture task-specific information where beneficial. Our findings suggest that eWSI provides a task-targeted, computationally efficient path for WSI tasks, offering a promising direction for task-specific learning in computational pathology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。