用频域与状态空间结合,提升医学图像异常检测的精度与效率
SpectMamba: Integrating Frequency and State Space Models for Enhanced Medical Image Detection
- 分频域学习高低频特征,避免信息丢失
- 在多个数据集上达到领先性能,计算开销低
- 适合需要高效高精度的医学影像分析场景
医学影像中的异常检测对诊断至关重要,需兼顾高效与准确。尽管卷积神经网络(CNN)和基于Transformer的模型广泛应用,但各自存在局限:CNN感受野有限,难以捕捉全局上下文;Transformer处理高分辨率医学图像时计算成本过高。Mamba作为自然语言处理新范式,以线性复杂度处理长序列,展现出潜力。本文提出首个面向医学图像检测的Mamba架构——SpectMamba。核心是混合空间-频率注意力(HSFA)模块,分别学习高低频特征,缓解频域偏差导致的信息损失,并关联频域与空间特征,增强全局建模能力。为进一步建模长程依赖,设计视觉状态空间模块(VSSM),引入新型希尔伯特曲线扫描策略,强化空间相关性与局部依赖,优化Mamba框架。大量实验表明,SpectMamba在多种医学图像检测任务中均达当前最优表现,兼具高效与有效。
原文摘要 · Abstract (English)
Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face intrinsic challenges: CNNs have limited receptive fields, restricting their ability to capture broad contextual information, and Transformers encounter prohibitive computational costs when processing high-resolution medical images. Mamba, a recent innovation in natural language processing, has gained attention for its ability to process long sequences with linear complexity, offering a promising alternative. Building on this foundation, we present SpectMamba, the first Mamba-based architecture designed for medical image detection. A key component of SpectMamba is the Hybrid Spatial-Frequency Attention (HSFA) block, which separately learns high- and low-frequency features. This approach effectively mitigates the loss of high-frequency information caused by frequency bias and correlates frequency-domain features with spatial features, thereby enhancing the model's ability to capture global context. To further improve long-range dependencies, we propose the Visual State-Space Module (VSSM) and introduce a novel Hilbert Curve Scanning technique to strengthen spatial correlations and local dependencies, further optimizing the Mamba framework. Comprehensive experiments show that SpectMamba achieves state-of-the-art performance while being both effective and efficient across various medical image detection tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。