融合图注意力与变换器,提升结肠癌病理图像分类准确率
Multi-Scale Deep Learning for Colon Histopathology: A Hybrid Graph-Transformer Approach
- 设计混合架构,结合变换器与卷积网络捕捉多尺度特征
- 在LC25000数据集上达到更高分类准确率和更低损失值
- 适合关注医学图像分析与多尺度建模的研究者
结肠癌(又称结直肠癌)是全球最致命的癌症之一。早期检测对防止病情恶化至关重要。本文提出一种混合多尺度深度学习架构,融合胶囊网络、图注意力机制、变换器模块与残差学习,用于在肺癌与结肠癌组织病理图像数据集(LC25000)上进行结肠癌分类。所提出的HG-TNet模型采用结合变换器与卷积神经网络优势的混合结构,以捕获组织病理图像中的多尺度特征。具体而言,变换器分支通过基于卷积的图像块嵌入,将图像划分为若干块,并利用变换器编码器提取全局上下文关系;同时,专用的CNN分支通过连续卷积操作捕获精细局部细节。通过融合这些多样化特征,并引入自监督旋转预测目标,生成鲁棒的诊断表示,其性能优于标准架构。结果表明,该方法不仅在准确率和损失函数上表现更优,还借助胶囊网络有效保留空间结构信息,揭示各元素如何组合成整体结构。
原文摘要 · Abstract (English)
Colon cancer also known as Colorectal cancer, is one of the most malignant types of cancer worldwide. Early-stage detection of colon cancer is highly crucial to prevent its deterioration. This research presents a hybrid multi-scale deep learning architecture that synergizes capsule networks, graph attention mechanisms, transformer modules, and residual learning to advance colon cancer classification on the Lung and Colon Cancer Histopathological Image Dataset (LC25000) dataset. The proposed model in this paper utilizes the HG-TNet model that introduces a hybrid architecture that joins strength points in transformers and convolutional neural networks to capture multi-scale features in histopathological images. Mainly, a transformer branch extracts global contextual bonds by partitioning the image into patches by convolution-based patch embedding and then processing these patches through a transformer encoder. Analogously, a dedicated CNN branch captures fine-grained, local details through successive Incorporation these diverse features, combined with a self-supervised rotation prediction objective, produce a robust diagnostic representation that surpasses standard architectures in performance. Results show better performance not only in accuracy or loss function but also in these algorithms by utilizing capsule networks to preserve spatial orders and realize how each element individually combines and forms whole structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。