arXiv:2603.09613cs.CV2026-03

模仿人眼快速扫视,用注意力图聚焦关键区域提升图像分类效率

A Saccade-inspired Approach to Image Classification using Vision Transformer Attention Maps

  • 基于Vision Transformer的注意力图模拟人眼扫视,分步聚焦图像关键区
  • 仅处理关键区域即可保持接近全图处理的分类性能,部分情况更优
  • 适用于追求高效、类脑视觉计算的研究者或系统设计者

人类视觉在严格代谢约束下仍具备卓越感知能力,关键在于由快速扫视驱动的选择性注意机制——不断将高分辨率中央凹重新定位到任务相关位置,而传统AI系统则对整幅图像平均处理。本文受此启发,利用DINO(一种自监督Vision Transformer)生成的注意力图,其模式与人类注视轨迹高度相似,提出一种仿扫视的图像分类方法,聚焦视觉空间中的重要区域。在ImageNet标准分类任务中,我们通过测量每次扫视对模型类别得分的影响,验证了该选择性处理策略:既能保持接近全图处理的分类性能,某些情况下甚至表现更优。与现有用于预测人类注视的显著性模型对比,DINO提供的注视引导更为精准。研究结果表明,Vision Transformer的注意力机制是构建生物启发式主动视觉系统的有力基础,为高效、类脑视觉处理开辟新路径。

原文摘要 · Abstract (English)

Human vision achieves remarkable perceptual performance while operating under strict metabolic constraints. A key ingredient is the selective attention mechanism, driven by rapid saccadic eye movements that constantly reposition the high-resolution fovea onto task-relevant locations, unlike conventional AI systems that process entire images with equal emphasis. Our work aims to draw inspiration from the human visual system to create smarter, more efficient image processing models. Using DINO, a self-supervised Vision Transformer that produces attention maps strikingly similar to human gaze patterns, we explore a saccade inspired method to focus the processing of information on key regions in visual space. To do so, we use the ImageNet dataset in a standard classification task and measure how each successive saccade affects the model's class scores. This selective-processing strategy preserves most of the full-image classification performance and can even outperform it in certain cases. By benchmarking against established saliency models built for human gaze prediction, we demonstrate that DINO provides superior fixation guidance for selecting informative regions. These findings highlight Vision Transformer attention as a promising basis for biologically inspired active vision and open new directions for efficient, neuromorphic visual processing.

视觉注意力类脑计算ViT图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。