arXiv:2412.12423cs.LG2024-12CVPR被引 7

动态构图的SSM模型,让序列建模更高效。

GG-SSMs: Graph-Generating State Space Models

  • 根据特征关系动态生成图结构,替代固定扫描路径
  • ImageNet上达到84.9%准确率,优于之前SSM模型1%
  • 适合需要捕捉复杂依赖关系的视觉与时序任务

状态空间模型(SSMs)在计算机视觉和时间序列分析中表现强劲,但传统方法受限于固定的单维序列处理,难以建模高维数据中的非局部交互。尽管Mamba和VMamba引入了选择性扫描策略,仍依赖预设路径,无法高效捕捉复杂依赖。本文提出图生成状态空间模型(GG-SSMs),通过基于特征关系动态构建图结构,利用Chazelle最小生成树算法自适应数据内在结构,实现鲁棒的特征传播与复杂依赖建模。我们在11个多样化数据集上验证该模型,涵盖事件相机眼动追踪、ImageNet分类、光流估计及六个时间序列数据集。结果表明,GG-SSMs在所有任务上均达领先性能:ImageNet上取得84.9%的top-1准确率,较先前方法提升1%;KITTI-15误差降至2.77%;眼动追踪检测率最高提升0.33%,且参数更少。这些结果证明,基于特征关系的动态扫描显著增强了SSMs的表达能力与效率,为视觉等领域提供通用工具。

原文摘要 · Abstract (English)

State Space Models (SSMs) are powerful tools for modeling sequential data in computer vision and time series analysis domains. However, traditional SSMs are limited by fixed, one-dimensional sequential processing, which restricts their ability to model non-local interactions in high-dimensional data. While methods like Mamba and VMamba introduce selective and flexible scanning strategies, they rely on predetermined paths, which fails to efficiently capture complex dependencies. We introduce Graph-Generating State Space Models (GG-SSMs), a novel framework that overcomes these limitations by dynamically constructing graphs based on feature relationships. Using Chazelle's Minimum Spanning Tree algorithm, GG-SSMs adapt to the inherent data structure, enabling robust feature propagation across dynamically generated graphs and efficiently modeling complex dependencies. We validate GG-SSMs on 11 diverse datasets, including event-based eye-tracking, ImageNet classification, optical flow estimation, and six time series datasets. GG-SSMs achieve state-of-the-art performance across all tasks, surpassing existing methods by significant margins. Specifically, GG-SSM attains a top-1 accuracy of 84.9% on ImageNet, outperforming prior SSMs by 1%, reducing the KITTI-15 error rate to 2.77%, and improving eye-tracking detection rates by up to 0.33% with fewer parameters. These results demonstrate that dynamic scanning based on feature relationships significantly improves SSMs' representational power and efficiency, offering a versatile tool for various applications in computer vision and beyond.

状态空间模型动态图视觉建模序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。