用低成本相机实时生成类事件数据,解决高成本难题。
Raw2Event: Converting Raw Frame Camera into Event Camera
- 直接读取原始拜耳数据,跳过ISP处理
- 输出分辨率更高,动态范围更广,接近真实事件相机
- 可部署在树莓派上,适合原型开发与研究
事件相机具有高时间分辨率、低延迟和高动态范围等优势,但在挑战性光照条件下应用日益广泛。然而,其高昂成本、有限分辨率及缺乏自动对焦等功能限制了广泛采用,尤其在早期开发与原型设计阶段。本文提出Raw2Event,一个完整的软硬件系统,可实现低成本原始帧相机实时生成事件数据。通过直接访问原始拜耳数据并绕过传统图像信号处理器(ISP),系统充分利用相机硬件潜力,输出动态范围更高、分辨率更高且更忠实的事件流,优于基于RGB的帧转事件方法。基于DVS-Voltmeter模型,Raw2Event具备可配置仿真框架,优化用于嵌入式平台部署。我们还设计了支持原始数据、RGB和事件流同步录制的数据采集管道,便于下游评估与数据集构建。实验表明,Raw2Event生成的事件流与真实事件相机高度相似,同时具备更高分辨率和自动对焦能力。系统支持直观参数调节,灵活适配不同应用场景。最终在树莓派上实现实时运行,为事件视觉研究与早期系统开发提供可扩展、低成本的解决方案。代码已公开:https://anonymous.4open.science/r/raw2event-BFF2/README.md。
原文摘要 · Abstract (English)
Event cameras offer unique advantages such as high temporal resolution, low latency, and high dynamic range, making them more and more popular for vision tasks under challenging light conditions. However, their high cost, limited resolution, and lack of features such as autofocus hinder their broad adoption, particularly for early-stage development and prototyping. In this work, we present Raw2Event, a complete hardware-software system that enables real-time event generation from low-cost raw frame-based cameras. By leveraging direct access to raw Bayer data and bypassing traditional image signal processors (ISP), our system is able to utilize the full potential of camera hardware, delivering higher dynamic range, higher resolution, and more faithful output than RGB-based frame-to-event converters. Built upon the DVS-Voltmeter model, Raw2Event features a configurable simulation framework optimized for deployment on embedded platforms. We further design a data acquisition pipeline that supports synchronized recording of raw, RGB, and event streams, facilitating downstream evaluation and dataset creation. Experimental results show that Raw2Event can generate event streams closely resembling those from real event cameras, while benefiting from higher resolution and autofocus capabilities. The system also supports user-intuitive parameter tuning, enabling flexible adaptation to various application requirements. Finally, we deploy the system on a Raspberry Pi for real-time operation, providing a scalable and cost-effective solution for event-based vision research and early-stage system development. The codes are available online: https://anonymous.4open.science/r/raw2event-BFF2/README.md.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。