arXiv:2602.04170cs.CV2026-02中稿 · ICML被引 1

提出环形扫描机制,提升视觉状态空间模型的旋转鲁棒性与效率

Partial Ring Scan: Revisiting Scan Order in Vision State Space Models

  • 用同心环划分图像,环内无序聚合,环间通过短径传递信息
  • ImageNet上达84.5%准确率,3.9G FLOPs,推理速度3054张/秒
  • 对旋转不变性强,固定路径扫描在旋转下性能下降1~2%

状态空间模型(SSMs)作为视觉任务中注意力机制的高效替代,具备线性时间序列处理能力并保持较高精度。然而,视觉SSMs需将二维图像按预设扫描顺序串行化为一维标记序列,这一因素常被忽视。我们发现扫描顺序显著影响性能,会破坏空间邻近性、割裂物体连续性,并在旋转等几何变换下加剧退化。为此,提出部分环形扫描Mamba(PRISMamba),将图像分层为同心环,环内实现顺序无关聚合,环间通过短径状态空间模型传播上下文。进一步引入部分通道过滤机制,仅将最相关信息通道送入循环环路,其余走轻量残差分支。在ImageNet-1K上,PRISMamba达到84.5% Top-1准确率,仅需3.9G FLOPs和3,054张/秒推理速度,优于VMamba,在准确率与吞吐量上均占优,且在旋转条件下表现稳定,而固定路径扫描性能下降1~2%。结果表明,扫描顺序设计与通道过滤是提升视觉SSMs准确性、效率与旋转鲁棒性的关键但未受重视因素。

原文摘要 · Abstract (English)

State Space Models (SSMs) have emerged as efficient alternatives to attention for vision tasks, offering lineartime sequence processing with competitive accuracy. Vision SSMs, however, require serializing 2D images into 1D token sequences along a predefined scan order, a factor often overlooked. We show that scan order critically affects performance by altering spatial adjacency, fracturing object continuity, and amplifying degradation under geometric transformations such as rotation. We present Partial RIng Scan Mamba (PRISMamba), a rotation-robust traversal that partitions an image into concentric rings, performs order-agnostic aggregation within each ring, and propagates context across rings through a set of short radial SSMs. Efficiency is further improved via partial channel filtering, which routes only the most informative channels through the recurrent ring pathway while keeping the rest on a lightweight residual branch. On ImageNet-1K, PRISMamba achieves 84.5% Top-1 with 3.9G FLOPs and 3,054 img/s on A100, outperforming VMamba in both accuracy and throughput while requiring fewer FLOPs. It also maintains performance under rotation, whereas fixed-path scans drop by 1~2%. These results highlight scan-order design, together with channel filtering, as a crucial, underexplored factor for accuracy, efficiency, and rotation robustness in Vision SSMs. Code will be released upon acceptance.

视觉状态空间环形扫描旋转鲁棒高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。