arXiv:2601.08190cs.CV2026-01

模仿人类先看整体再看细节的视觉机制,提升轻量级模型性能。

Human-inspired Global-to-Parallel Multi-scale Encoding for Lightweight Vision Models

  • 先提取全局信息,再并行处理多尺度特征,模拟人眼视觉流程。
  • 在图像分类等任务上,参数和计算量均低于主流轻量模型,性能更优。
  • 适合部署在手机、嵌入式设备等资源受限场景,兼顾精度与效率。

近年来,轻量级视觉网络取得了显著进展,但如何在参数规模、计算开销与任务性能之间取得良好平衡仍具挑战。现有许多轻量模型虽大幅降低计算量,却往往导致参数量显著增加(如 LSNet、MobileMamba),限制了在资源受限设备上的部署。同时,部分受人类视觉感知启发的研究对视觉过程建模过于简化,难以反映真实感知机制。本文重新审视人类视觉系统的协同机制,提出全局到并行的多尺度编码方法 GPM。GPM 首先通过全局洞察生成器(GIG)提取整体线索,随后通过并行分支处理不同尺度特征:LSAE 关注中/大尺度语义关系,IRB(倒置残差块)保留细粒度纹理信息,协同实现全局与局部特征的一致表征。该设计符合人类视觉‘先整体后局部’及‘局部关注时保持上下文感知’的特点。基于 GPM 构建的轻量级 H-GPE 网络,在图像分类、目标检测和语义分割任务上表现优异,相比近期先进轻量模型,在 FLOPs 与参数量之间保持更好平衡,展现出更优的精度-效率权衡。

原文摘要 · Abstract (English)

Lightweight vision networks have witnessed remarkable progress in recent years, yet achieving a satisfactory balance among parameter scale, computational overhead, and task performance remains difficult. Although many existing lightweight models manage to reduce computation considerably, they often do so at the expense of a substantial increase in parameter count (e.g., LSNet, MobileMamba), which still poses obstacles for deployment on resource-limited devices. In parallel, some studies attempt to draw inspiration from human visual perception, but their modeling tends to oversimplify the visual process, making it hard to reflect how perception truly operates. Revisiting the cooperative mechanism of the human visual system, we propose GPM (Global-to-Parallel Multi-scale Encoding). GPM first employs a Global Insight Generator (GIG) to extract holistic cues, and subsequently processes features of different scales through parallel branches: LSAE emphasizes mid-/large-scale semantic relations, while IRB (Inverted Residual Block) preserves fine-grained texture information, jointly enabling coherent representation of global and local features. As such, GPM conforms to two characteristic behaviors of human vision perceiving the whole before focusing on details, and maintaining broad contextual awareness even during local attention. Built upon GPM, we further develop the lightweight H-GPE network. Experiments on image classification, object detection, and semantic segmentation show that H-GPE achieves strong performance while maintaining a balanced footprint in both FLOPs and parameters, delivering a more favorable accuracy-efficiency trade-off compared with recent state-of-the-art lightweight models.

轻量模型多尺度编码视觉感知高效网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。