arXiv:2409.02885eess.IVcs.CV2024-09被引 1

通过调整图像分块策略,提升病理图像模型在小样本下的表现。

CanvOI, an Oncology Intelligence Foundation Model: Scaling FLOPS Differently

  • 采用大图块(380x380)与小分块(10x10)设计,优化视觉特征提取
  • 在癌症基准上平均AUC提升1.5%-7.4%,小样本训练时优势更明显
  • 适合资源受限或标注数据稀缺的病理诊断场景

数字病理学领域快速发展,但面临多样复杂临床问题、罕见病种及标注数据稀缺等挑战,制约了生物医学AI工具的鲁棒性发展。为此,我们提出CanvOI,一个基于ViT-g/10的病理基础模型,通过改变输入图像处理方式来应对这些难题。针对肿瘤组织病理图像特性与多实例学习(MIL)下游任务的需求,采用380×380像素的大图块和10×10像素的小分块,重新分配计算资源方向。该方法在多个癌症相关基准上实现最优性能,平均AUC较现有领先模型提升1.5%–7.4%。尤其在仅使用初始数据集10%的情况下,性能差距进一步扩大。结果表明,该方法可有效克服数据稀缺瓶颈,为肿瘤智能(OI)提供新范式,有望改善患者临床结局。

原文摘要 · Abstract (English)

The rapidly evolving field of digital oncopathology faces significant challenges, including the need to address diverse and complex clinical questions, often involving rare conditions, with limited availability of labeled data. These limitations hinder the development of robust AI-driven tools in the biomedical space, where accuracy in probabilistic determinations is of utmost importance. To address this, digital pathology foundation models have begun to emerge, typically developed with the size and diversity of the pre-training dataset and model parameters in mind. Here, we present CanvOI, a ViT-g/10-based foundation model designed to enhance the capabilities of digital pathology by addressing these challenges through a different approach. Considering the unique nature of oncologic histopathological images and the requirements from the embeddings to provide meaningful representations for Multiple Instance Learning (MIL) downstream models, we chose to modify the input image characteristics. By introducing larger tile sizes (380 x 380 pixels) and smaller patch sizes (10 x 10 pixels), we were able to optimize the model's performance, pushing computational resources in a new direction and achieving state-of-the-art performance on cancer-related benchmarks. CanvOI demonstrated a 1.5-7.4% improvement in averaged AUC compared to other leading foundation models built for digital pathology. Moreover, our results demonstrate that CanvOI significantly outperformed the other models, with the performance gap widening substantially when trained on just 10% of the initial cohort. This work highlights an alternative approach that, if integrated with traditional development approaches, has the potential to advance Oncology Intelligence (OI), overcome some of the current barriers and ultimately improve the clinical outcome of cancer patients.

病理图像基础模型小样本学习ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。