arXiv:2602.06405cs.CVcs.NE2026-02

基于昆虫视觉的神经形态模型,实现自然图像的稀疏高效编码。

A neuromorphic model of the insect visual system for natural image processing

  • 模仿昆虫视觉机制,将密集图像转为稀疏判别码
  • 自监督对比学习,无需标签即可生成可复用表征
  • 适用于多种任务,支持神经网络与脉冲神经网络部署

昆虫视觉支持复杂行为,如联想学习、导航和目标检测,长期启发计算模型以理解生物视觉处理。然而,许多现代模型侧重任务性能,忽视生物基础路径。本文提出一种生物启发视觉模型,捕捉昆虫视觉原理,将密集视觉输入转化为稀疏、判别性编码。模型采用全自监督对比目标训练,实现无标签表示学习,支持跨任务复用且不依赖特定领域分类器。在花识别任务和自然图像基准测试中,模型持续生成可靠稀疏编码,能区分视觉相似输入。为支持不同建模与部署需求,模型同时实现为人工神经网络和脉冲神经网络。在模拟定位任务中,该方法优于简单图像下采样基线,凸显引入神经形态视觉通路的功能优势。总体而言,这些结果推动了昆虫计算建模,提供了一种可在多样任务中实现稀疏计算的通用生物启发视觉模型。

原文摘要 · Abstract (English)

Insect vision supports complex behaviors including associative learning, navigation, and object detection, and has long motivated computational models for understanding biological visual processing. However, many contemporary models prioritize task performance while neglecting biologically grounded processing pathways. Here, we introduce a bio-inspired vision model that captures principles of the insect visual system to transform dense visual input into sparse, discriminative codes. The model is trained using a fully self-supervised contrastive objective, enabling representation learning without labeled data and supporting reuse across tasks without reliance on domain-specific classifiers. We evaluated the resulting representations on flower recognition tasks and natural image benchmarks. The model consistently produced reliable sparse codes that distinguish visually similar inputs. To support different modelling and deployment uses, we have implemented the model as both an artificial neural network and a spiking neural network. In a simulated localization setting, our approach outperformed a simple image downsampling comparison baseline, highlighting the functional benefit of incorporating neuromorphic visual processing pathways. Collectively, these results advance insect computational modelling by providing a generalizable bio-inspired vision model capable of sparse computation across diverse tasks.

神经形态计算视觉编码自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。