arXiv:2601.13451cs.ROcs.CV2026-01

用脉冲网络实时处理事件数据,提升机器人对未知障碍物的感知与定位能力。

Event-based Heterogeneous Information Processing for Online Vision-based Obstacle Detection and Localization

  • 双路径设计:人工神经网络处理静态图像,脉冲神经网络实时处理事件数据
  • 检测准确率高,计算开销仅为传统方法的几分之一
  • 适合动态复杂环境中需低功耗实时感知的机器人系统

本文提出一种新型机器人视觉导航框架,融合混合神经网络(HNN)与基于脉冲神经网络(SNN)的滤波器,以增强对未建模障碍物的检测与定位能力。系统利用人工神经网络(ANN)和脉冲神经网络(SNN)的互补优势,在保证环境理解精度的同时实现快速、低功耗处理。采用双路径结构:ANN模块以低频处理静态空间特征,SNN模块则实时处理动态事件传感器数据。不同于依赖领域转换的传统混合架构,本系统直接使用编码后的脉冲输入进行定位与状态估计。异常检测结果通过ANN路径提供的上下文信息验证,并持续追踪,支持前瞻式导航策略。仿真结果表明,该方法在保持接近纯SNN实现的计算效率(资源消耗仅为传统方案的几分之一)的同时,仍具备可接受的检测精度。该框架显著推进了类脑导航系统在不可预测动态环境中的应用。

原文摘要 · Abstract (English)

This paper introduces a novel framework for robotic vision-based navigation that integrates Hybrid Neural Networks (HNNs) with Spiking Neural Network (SNN)-based filtering to enhance situational awareness for unmodeled obstacle detection and localization. By leveraging the complementary strengths of Artificial Neural Networks (ANNs) and SNNs, the system achieves both accurate environmental understanding and fast, energy-efficient processing. The proposed architecture employs a dual-pathway approach: an ANN component processes static spatial features at low frequency, while an SNN component handles dynamic, event-based sensor data in real time. Unlike conventional hybrid architectures that rely on domain conversion mechanisms, our system incorporates a pre-developed SNN-based filter that directly utilizes spike-encoded inputs for localization and state estimation. Detected anomalies are validated using contextual information from the ANN pathway and continuously tracked to support anticipatory navigation strategies. Simulation results demonstrate that the proposed method offers acceptable detection accuracy while maintaining computational efficiency close to SNN-only implementations, which operate at a fraction of the resource cost. This framework represents a significant advancement in neuromorphic navigation systems for robots operating in unpredictable and dynamic environments.

类脑计算事件相机障碍物检测低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。