对比两类类脑视觉传感器在高速机器人感知中的表现
Quantitative evaluation of brain-inspired vision sensors in high-speed robotic perception
- 构建统一测试框架,量化评估事件相机与天眸传感器性能
- 天眸在复杂高速场景中表现更稳定,事件相机在稀疏场景下更优
- 为高速机器人视觉选型提供数据支持,适合做动态感知研究者
机器人感知系统在高速动态环境下依赖传统相机时,运动模糊会破坏空间特征完整性并影响任务表现。类脑视觉传感器(BVS)因其高时间分辨率和低带宽功耗受到关注。本文首次提出针对两类代表性BVS的定量评估框架,包括事件相机(EVS)和基于原型的天眸传感器(Tianmouc),后者通过编码时空变化与亮度信息实现互补。建立统一测试协议,涵盖跨传感器标定、标准化平台与质量指标,以解决模态差异问题。从成像角度,分析传感器非理想性如运动畸变对结构信息捕捉的影响;功能基准测试中,在不同转速下评估角点检测与运动估计性能。结果表明:EVS在高速稀疏场景和中等速度复杂场景表现良好,但在高速密集场景因像素级带宽波动与事件率饱和而受限;天眸则在各类场景中均保持稳定性能,得益于其全局、精确、高速的时空梯度采样。研究揭示了不同场景下BVS技术的适用性,为后续发展提供依据。
原文摘要 · Abstract (English)
Perception systems in robotics encounter significant challenges in high-speed and dynamic conditions when relying on traditional cameras, where motion blur can compromise spatial feature integrity and task performance. Brain-inspired vision sensors (BVS) have recently gained attention as an alternative, offering high temporal resolution with reduced bandwidth and power requirements. Here, we present the first quantitative evaluation framework for two representative classes of BVSs in variable-speed robotic sensing, including event-based vision sensors (EVS) that detect asynchronous temporal contrasts, and the primitive-based sensor Tianmouc that employs a complementary mechanism to encode both spatiotemporal changes and intensity. A unified testing protocol is established, including crosssensor calibrations, standardized testing platforms, and quality metrics to address differences in data modality. From an imaging standpoint, we evaluate the effects of sensor non-idealities, such as motion-induced distortion, on the capture of structural information. For functional benchmarking, we examine task performance in corner detection and motion estimation under different rotational speeds. Results indicate that EVS performs well in highspeed, sparse scenarios and in modestly fast, complex scenes, but exhibits performance limitations in high-speed, cluttered settings due to pixel-level bandwidth variations and event rate saturation. In comparison, Tianmouc demonstrates consistent performance across sparse and complex scenarios at various speeds, supported by its global, precise, high-speed spatiotemporal gradient samplings. These findings offer valuable insights into the applicationdependent suitability of BVS technologies and support further advancement in this area.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。