arXiv:2512.03663cs.CV2025-12被引 2

多尺度提示让小图像分类更高效,模型几乎不增加参数

Multi-Scale Visual Prompting for Lightweight Small-Image Classification

  • 用多尺度提示图融合输入图像,通过轻量卷积实现
  • 在MNIST等小图像数据集上提升性能,参数增益低于0.02%
  • 适合想快速提升小图像模型表现的研究者和教学场景

视觉提示近期成为利用可学习参数在输入空间中高效适配视觉模型的策略。然而,现有工作主要针对大型Vision Transformer和高分辨率数据集(如ImageNet)。相比之下,如MNIST、Fashion-MNIST和CIFAR-10等小图像基准在教育、原型设计和研究中仍广泛使用,但提示方法在此类任务中关注甚少。本文提出一种简单通用的模块——多尺度视觉提示(MSVP),通过轻量级$1 \times 1$卷积将全局、中尺度和局部提示图融合到输入图像中。该方法与主干网络无关,参数增加不足0.02%,在CNN和Vision Transformer上均显著提升性能。我们在MNIST、Fashion-MNIST和CIFAR-10上构建统一基准,采用简单CNN、ResNet-18和小型Vision Transformer进行实验。结果表明,本方法在保持极低计算开销的同时持续提升效果。进一步通过提示尺度、融合策略和主干结构的消融分析,以及提示可视化和Grad-CAM定性验证,证明多尺度提示在低分辨率图像中仍能提供有效归纳偏置。

原文摘要 · Abstract (English)

Visual prompting has recently emerged as an efficient strategy to adapt vision models using lightweight, learnable parameters injected into the input space. However, prior work mainly targets large Vision Transformers and high-resolution datasets such as ImageNet. In contrast, small-image benchmarks like MNIST, Fashion-MNIST, and CIFAR-10 remain widely used in education, prototyping, and research, yet have received little attention in the context of prompting. In this paper, we introduce \textbf{Multi-Scale Visual Prompting (MSVP)}, a simple and generic module that learns a set of global, mid-scale, and local prompt maps fused with the input image via a lightweight $1 \times 1$ convolution. MSVP is backbone-agnostic, adds less than $0.02\%$ parameters, and significantly improves performance across CNN and Vision Transformer backbones. We provide a unified benchmark on MNIST, Fashion-MNIST, and CIFAR-10 using a simple CNN, ResNet-18, and a small Vision Transformer. Our method yields consistent improvements with negligible computational overhead. We further include ablations on prompt scales, fusion strategies, and backbone architectures, along with qualitative analyzes using prompt visualizations and Grad-CAM. Our results demonstrate that multi-scale prompting provides an effective inductive bias even on low-resolution images.

视觉提示小图像分类轻量化多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。