用概率采样聚焦小目标,效率提升十倍
Boltzmann Attention Sampling for Image Analysis with Small Objects
- 基于玻尔兹曼分布动态采样注意力区域,随网络加深逐步聚焦
- 在肺结节等小目标上分割性能显著提升,计算量减少90%以上
- 适合医学图像中小而不确定目标的检测与分割任务
检测和分割小目标(如肺结节、肿瘤病灶)仍是图像分析中的关键挑战。这些目标通常仅占图像面积的0.1%以下,导致传统Transformer因对无关区域进行冗余注意力计算而效率低下且性能下降。现有稀疏注意力机制依赖固定层次结构,难以适应小目标位置可变且不确定的特点。本文提出BoltzFormer,一种基于Transformer的新架构,通过动态稀疏注意力解决上述问题。BoltzFormer利用玻尔兹曼分布建模不确定性,并采用退火调度:初期高温使注意力覆盖更广区域,以应对高位置不确定性;后期温度降低,注意力逐渐聚焦,提升效率与精度。该方法通过模块化设计无缝集成至现有Transformer架构。在多个基准数据集上的全面评估表明,BoltzFormer显著提升了小目标分割性能,同时相比之前最先进方法将注意力计算量减少一个数量级。
原文摘要 · Abstract (English)
Detecting and segmenting small objects, such as lung nodules and tumor lesions, remains a critical challenge in image analysis. These objects often occupy less than 0.1% of an image, making traditional transformer architectures inefficient and prone to performance degradation due to redundant attention computations on irrelevant regions. Existing sparse attention mechanisms rely on rigid hierarchical structures, which are poorly suited for detecting small, variable, and uncertain object locations. In this paper, we propose BoltzFormer, a novel transformer-based architecture designed to address these challenges through dynamic sparse attention. BoltzFormer identifies and focuses attention on relevant areas by modeling uncertainty using a Boltzmann distribution with an annealing schedule. Initially, a higher temperature allows broader area sampling in early layers, when object location uncertainty is greatest. As the temperature decreases in later layers, attention becomes more focused, enhancing efficiency and accuracy. BoltzFormer seamlessly integrates into existing transformer architectures via a modular Boltzmann attention sampling mechanism. Comprehensive evaluations on benchmark datasets demonstrate that BoltzFormer significantly improves segmentation performance for small objects while reducing attention computation by an order of magnitude compared to previous state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。