arXiv:2510.13740cs.CVcs.AI2025-10被引 3

提出新型图构建方法,让视觉GNN在低计算量下实现更高精度。

Multi-Scale High-Resolution Logarithmic Grapher Module for Efficient Vision GNNs

  • 用对数尺度动态控制长程连接,减少冗余信息
  • 小模型在ImageNet上达79.9%准确率,参数减少24.3%
  • 适合追求高效高精度视觉模型的研究者和开发者

视觉图神经网络(ViG)在图像分类与语义分割任务中表现优异,但传统KNN等图构建方法在大图像上计算成本高。现有方法如SVGA因固定步长导致信息过压缩,遗漏多连接。为此,本文提出对数可扩展图构建(LSGC),通过控制长程链接数量提升性能。在此基础上,设计新模型LogViG,融合多尺度、高分辨率分支,实现跨尺度特征融合。大量实验表明,LogViG在准确率、GMACs和参数量上均优于现有ViG、CNN和ViT。最小模型Ti-LogViG在ImageNet-1K上平均顶1准确率达79.9%(标准差0.2%),比同类ViG高出1.7%,参数减少24.3%,GMACs降低35.3%。结果证明,基于LSGC的长程连接设计能超越当前先进ViG。代码已开源:https://github.com/mmunir127/LogViG-Official。

原文摘要 · Abstract (English)

Vision graph neural networks (ViG) have demonstrated promise in vision tasks as a competitive alternative to conventional convolutional neural nets (CNN) and transformers (ViTs); however, common graph construction methods, such as k-nearest neighbor (KNN), can be expensive on larger images. While methods such as Sparse Vision Graph Attention (SVGA) have shown promise, SVGA's fixed step scale can lead to over-squashing and missing multiple connections to gain the same information that could be gained from a long-range link. Through this observation, we propose a new graph construction method, Logarithmic Scalable Graph Construction (LSGC) to enhance performance by limiting the number of long-range links. To this end, we propose LogViG, a novel hybrid CNN-GNN model that utilizes LSGC. Furthermore, inspired by the successes of multi-scale and high-resolution architectures, we introduce and apply a high-resolution branch and fuse features between our high-resolution and low-resolution branches for a multi-scale high-resolution Vision GNN network. Extensive experiments show that LogViG beats existing ViG, CNN, and ViT architectures in terms of accuracy, GMACs, and parameters on image classification and semantic segmentation tasks. Our smallest model, Ti-LogViG, achieves an average top-1 accuracy on ImageNet-1K of 79.9% with a standard deviation of 0.2%, 1.7% higher average accuracy than Vision GNN with a 24.3% reduction in parameters and 35.3% reduction in GMACs. Our work shows that leveraging long-range links in graph construction for ViGs through our proposed LSGC can exceed the performance of current state-of-the-art ViGs. Code is available at https://github.com/mmunir127/LogViG-Official.

视觉GNN图神经网络高效模型多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。