简单平均池化MIL在3D脑影像分类中效率高且性能不输复杂模型。
A Multi-Dataset Benchmark of Multiple Instance Learning for 3D Neuroimage Classification

- 用平均池化实现的简易MIL方法,仅训练池化层和分类器。
- 在6个数据集上4个中表现优于或媲美先进模型,大样本数据集仍保持竞争力。
- 适合算力有限的研究者,尤其关注高效3D神经影像分析场景。
尽管3D卷积神经网络(CNN)训练成本高,仍是CT和MRI扫描分类的标准方法。近期研究指出,深度多实例学习(MIL)可能是更高效的替代方案,特别是当2D切片图像编码器固定、仅训练池化与分类器时。本文在三个CT和四个MRI数据集上系统比较了简单MIL、基于注意力的MIL、3D CNN和3D ViT,包含两个规模达10,000+扫描的大数据集。目标是帮助资源受限的研究者理解哪些模型适用于3D神经影像并为何有效。进一步对比了注意力MIL的设计选择,包括不同编码器、池化方式和结构顺序。结果发现,无需可学习注意力的简单均值池化MIL,在6个中等规模任务中的4个上表现匹配或超越近期MIL或3D CNN方法。该基线在两个大数据集上依然具有竞争力,且训练速度提升25倍。通过分析每切片注意力质量及半合成数据集上的贝叶斯最优分类器,揭示了现有MIL方法的局限性,并指明未来改进方向。
原文摘要 · Abstract (English)
Despite being resource-intensive to train, 3D convolutional neural networks (CNNs) have been the standard approach to classify CT and MRI scans. Recent work suggests that deep multiple instance learning (MIL) may be a more efficient alternative for 3D brain scans, especially when the pre-trained image encoder used to embed each 2D slice is frozen and only the pooling operation and classifier are trained. In this paper, we provide a systematic comparison of simple MIL, attention-based MIL, 3D CNNs, and 3D ViTs across three CT and four MRI datasets, including two large datasets of at least 10,000 scans. Our goal is to help resource-constrained practitioners understand which neural networks work well for 3D neuroimages and why. We further compare design choices for attention-based MIL, including different encoders, pooling operations, and architectural orderings. We find that simple mean pooling MIL, without any learnable attention, matches or outperforms recent MIL or 3D CNN alternatives on 4 of 6 moderate-sized tasks. This baseline remains competitive on two large datasets while being 25x faster to train. To explain mean pooling's success, we examine per-slice attention quality and a semi-synthetic dataset where we can derive the best possible classifier via a Bayes estimator. This analysis reveals the limits of existing MIL approaches and suggests routes for future improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。