arXiv:2410.19166cs.CV2024-10中稿 · 2024 9th Internati…被引 6

用DCT提升轻量Transformer,高效分析乳腺癌病理图像。

DCT-HistoTransformer: Efficient Lightweight Vision Transformer with DCT Integration for histopathological image analysis

  • 引入DCT与MobileConv并行处理,将图像转为频域降低计算开销。
  • 二分类准确率96.00%±0.48%,多分类87.85%±0.93%,媲美顶尖模型。
  • 适合数据少、算力弱的边缘设备,减少对标注数据依赖。

近年来,先进成像技术与深度学习结合显著推动了乳腺癌检测与分类的计算机辅助诊断(CAD)系统发展。尽管视觉变压器(ViTs)在计算机视觉中表现优异,但其应用于高分辨率病理图像时面临两大挑战:一是全切片图像(WSIs)需大量人工标注,成本高昂;二是ViT的二次计算复杂度对大尺寸图像尤其不利,限制了其在资源受限的边缘设备上的应用。本文提出一种新型轻量级乳腺癌分类方法,通过引入离散余弦变换(DCT)注意力与MobileConv并行路径,将图像从空间域转换至频域,利用频域特性过滤高频噪声以降低计算成本。该方法在不依赖大规模数据集的情况下实现高效分类。实验结果表明,二分类准确率达96.00%±0.48%,多分类达87.85%±0.93%,性能接近当前最优模型,同时显著降低计算开销,为病理图像分析提供了更高效的解决方案。

原文摘要 · Abstract (English)

In recent years, the integration of advanced imaging techniques and deep learning methods has significantly advanced computer-aided diagnosis (CAD) systems for breast cancer detection and classification. Transformers, which have shown great promise in computer vision, are now being applied to medical image analysis. However, their application to histopathological images presents challenges due to the need for extensive manual annotations of whole-slide images (WSIs), as these models require large amounts of data to work effectively, which is costly and time-consuming. Furthermore, the quadratic computational cost of Vision Transformers (ViTs) is particularly prohibitive for large, high-resolution histopathological images, especially on edge devices with limited computational resources. In this study, we introduce a novel lightweight breast cancer classification approach using transformers that operates effectively without large datasets. By incorporating parallel processing pathways for Discrete Cosine Transform (DCT) Attention and MobileConv, we convert image data from the spatial domain to the frequency domain to utilize the benefits such as filtering out high frequencies in the image, which reduces computational cost. This demonstrates the potential of our approach to improve breast cancer classification in histopathological images, offering a more efficient solution with reduced reliance on extensive annotated datasets. Our proposed model achieves an accuracy of 96.00% $\pm$ 0.48% for binary classification and 87.85% $\pm$ 0.93% for multiclass classification, which is comparable to state-of-the-art models while significantly reducing computational costs. This demonstrates the potential of our approach to improve breast cancer classification in histopathological images, offering a more efficient solution with reduced reliance on extensive annotated datasets.

轻量模型病理图像TransformerDCT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。