arXiv:2605.17984eess.IVcs.CV2026-05

用事件相机和图像融合实现无训练实时二值化,适合边缘设备

See Silhouettes in Motion with Neuromorphic Vision

论文配图:See Silhouettes in Motion with Neuromorphic Vision
图 1 · 摘自论文原文
  • 结合图像与事件流,无需训练即可实时二值化
  • 在极端光照和高速运动下仍保持清晰轮廓,计算成本低
  • 适合无人机、自动驾驶等资源受限的嵌入式场景

准双模对象(如文字、路标、条形码)在日常视觉通信中扮演基础但关键的角色。通过将其简化为清晰轮廓,二值化以最少语言传递关键视觉线索,尤其适用于需要简单几何与拓扑推理的任务,而非复杂的外观建模。然而,帧式成像在无人机、自动驾驶汽车和水下车辆等移动平台常因快速运动导致严重运动模糊,强光又会冲淡场景细节。为此,基于微秒级时间分辨率和高动态范围的事件相机(event cameras)成为自然解决方案。本文提出一种简单而有效的双模方法,利用图像与事件的协同作用,在仅用CPU的设备上实现无需训练、实时、高帧率的二值化。大量实验表明,该方法在减少模糊伪影方面表现媲美先进方法,并在挑战性光照条件下显著提升性能,且计算开销更低。其异步特性规避了传统时间分箱重建中的事件稀疏性问题,即使在数千赫兹的超高帧率下也能保持目标形状清晰。生成的二值结果可作为可靠表征,支持多种下游任务。本工作为资源受限边缘平台上的轻量级感知与交互开辟了新路径。

原文摘要 · Abstract (English)

Quasi-bimodal objects, such as text, road signs, and barcodes, play a basic yet vital role in daily visual communication. By boiling these down to clear silhouettes, binarization uses a minimal language to convey essential vision cues for maximum downstream efficiency, especially for tasks that require simple geometric, topological reasoning rather than heavy appearance modeling. The catch is that frame-based imaging often struggles on mobile platforms like drones, self-driving cars, and underwater vehicles, in which rapid motion causes severe motion blur and harsh lighting washes out scene details. To overcome these physical limits, neuromorphic vision via event cameras, featuring microsecond time resolution and high dynamic range, steps in as a natural solution. Building upon this event-driven paradigm, we propose a simple yet effective dual-modal approach that harnesses the synergy between frames and events for training-free, real-time, high-frame-rate binarization on CPU-only devices. Extensive evaluations show that it earns competitive performance against leading techniques in reducing blur artifacts and delivers impressive improvements under challenging illumination at a lower computational cost. Besides, its asynchronous nature bypasses long-standing event-scarcity issues that break traditional time-binning reconstruction at fixed time slots, maintaining clear target shapes even at extreme kilohertz frame rates. Its binary results further serve as reliable representations to facilitate a range of downstream tasks. This work paves the way towards lightweight perception and interaction in embodied intelligence on resource-constrained edge platforms.

事件相机二值化边缘计算轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。