arXiv:2510.15138cs.CV2025-10被引 1

用傅里叶变换捕捉病理切片全局信息,提升分类准确率。

Fourier Transform Multiple Instance Learning for Whole Slide Image Classification

  • 引入频域分支,通过快速傅里叶变换提取低频特征。
  • 在三个数据集上平均提升3.51%宏F1和1.51%AUC。
  • 适配多种MIL架构,适合计算病理学研究者使用。

全切片图像(WSI)分类依赖于基于空间块特征的多实例学习(MIL),但现有方法因WSI规模巨大及块嵌入的局部性,难以捕捉全局依赖,影响对粗粒度结构的建模,进而限制诊断预测的鲁棒性。本文提出傅里叶变换多实例学习(FFT-MIL),通过频域分支提供紧凑的全局上下文。利用快速傅里叶变换从WSI中提取低频块,经由包含卷积层与最小-最大归一化的模块化FFT-Block处理,以缓解频率数据的高方差问题。学习到的全局频域特征通过轻量级融合策略与空间块特征结合,兼容多种MIL架构。在BRACS、LUAD和IMP三个公开数据集上,对六种主流MIL方法进行评估,集成FFT-Block后,宏F1均值提升3.51%,AUC提升1.51%,表明该方法在不同架构与数据集上均具一致性增益。结果证实频域学习是捕捉WSI全局依赖的有效且高效机制,可补充空间特征,推动基于MIL的计算病理学的可扩展性与准确性。

原文摘要 · Abstract (English)

Whole Slide Image (WSI) classification relies on Multiple Instance Learning (MIL) with spatial patch features, yet existing methods struggle to capture global dependencies due to the immense size of WSIs and the local nature of patch embeddings. This limitation hinders the modeling of coarse structures essential for robust diagnostic prediction. We propose Fourier Transform Multiple Instance Learning (FFT-MIL), a framework that augments MIL with a frequency-domain branch to provide compact global context. Low-frequency crops are extracted from WSIs via the Fast Fourier Transform and processed through a modular FFT-Block composed of convolutional layers and Min-Max normalization to mitigate the high variance of frequency data. The learned global frequency feature is fused with spatial patch features through lightweight integration strategies, enabling compatibility with diverse MIL architectures. FFT-MIL was evaluated across six state-of-the-art MIL methods on three public datasets (BRACS, LUAD, and IMP). Integration of the FFT-Block improved macro F1 scores by an average of 3.51% and AUC by 1.51%, demonstrating consistent gains across architectures and datasets. These results establish frequency-domain learning as an effective and efficient mechanism for capturing global dependencies in WSI classification, complementing spatial features and advancing the scalability and accuracy of MIL-based computational pathology.

病理图像频域分析多实例学习深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。