arXiv:2603.26551cs.CVcs.AI2026-03IJCV被引 1

提出更符合边缘设备的视觉骨干网络设计标准,提升实际运行速度。

Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones

论文配图:Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones
图 1 · 摘自论文原文
  • 用实测验证MACs指标在边缘设备上不靠谱,提出新优化思路。
  • 设计轻量注意力模块Lowtention,ImageNet上效率与精度双优。
  • 适合追求低延迟、高能效的嵌入式视觉应用开发者。

视觉骨干网络在现代计算机视觉中起核心作用,提升其效率可惠及众多下游任务。当前许多研究以MACs(乘加操作数)作为执行时间的预测指标,本文通过实验揭示该指标在边缘设备上的局限性。对比常见结构元素的MAC数与实际执行时间,识别出影响高效执行的关键因素,并据此提出新型视觉骨干网络LowFormer。LowFormer采用精简的宏微观设计,包含轻量级注意力模块Lowtention,不仅显著提升效率,还在ImageNet上取得更优性能。此外,我们还提供了面向边缘GPU的LowFormer版本,在边缘与桌面GPU上均实现更快推理速度。我们在小型图像分类数据集及目标检测、语义分割、图像检索、视觉目标跟踪等下游任务上验证了LowFormer的广泛适用性,相比近期先进骨干网络,在多种硬件平台上均实现显著加速。代码与模型见:https://github.com/altair199797/LowFormer/blob/main/Beyond_MACs.md。

原文摘要 · Abstract (English)

Vision backbone networks play a central role in modern computer vision. Enhancing their efficiency directly benefits a wide range of downstream applications. To measure efficiency, many publications rely on MACs (Multiply Accumulate operations) as a predictor of execution time. In this paper, we experimentally demonstrate the shortcomings of such a metric, especially in the context of edge devices. By contrasting the MAC count and execution time of common architectural design elements, we identify key factors for efficient execution and provide insights to optimize backbone design. Based on these insights, we present LowFormer, a novel vision backbone family. LowFormer features a streamlined macro and micro design that includes Lowtention, a lightweight alternative to Multi-Head Self-Attention. Lowtention not only proves more efficient, but also enables superior results on ImageNet. Additionally, we present an edge GPU version of LowFormer, that can further improve upon its baseline's speed on edge GPU and desktop GPU. We demonstrate LowFormer's wide applicability by evaluating it on smaller image classification datasets, as well as adapting it to several downstream tasks, such as object detection, semantic segmentation, image retrieval, and visual object tracking. LowFormer models consistently achieve remarkable speed-ups across various hardware platforms compared to recent state-of-the-art backbones. Code and models are available at https://github.com/altair199797/LowFormer/blob/main/Beyond_MACs.md.

视觉骨干边缘计算轻量化注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。