用编码脉冲流实现每秒1000帧的全彩高动态成像。
High-Speed Full-Color HDR Imaging via Unwrapping Modulo-Encoded Spike Streams

- 通过解耦曝光的模运算成像,实现多测量时间交错采集。
- 无需迭代的算法结合生成先验,高效还原物理一致的HDR图像。
- 硬件实测达1000帧/秒,数据量从20吉比特降至6吉比特。
传统基于RGB的高动态范围(HDR)成像在多曝光捕获中存在运动伪影,单帧技术则导致不可逆信息丢失。模运算传感器通过将理论上无界的动态范围编码为包裹测量值,提供了有前景的替代方案。然而,现有模运算方法受限于迭代解包裹的计算开销和硬件约束,仅能实现低速、灰度成像。本文提出一个完整的模运算基HDR成像系统,实现了高速、全彩HDR采集,同时在传感建模与解包裹算法上协同创新。核心在于一种曝光解耦的模运算成像公式,允许多组测量在时间上交错进行,保持清晰的观测模型。在此基础上,提出一种无需迭代的解包裹算法,融合基于扩散的生成先验与模图像的物理最小绝对余数特性,支持高效且物理一致的HDR重建。最后,我们基于模编码脉冲流实现了一个概念验证硬件系统,保留了脉冲相机原有的高时间分辨率,达到1000帧/秒的全彩成像,同时将输出数据带宽从约20 Gbps降低至6 Gbps。大量评估表明,该协同方法成功克服了关键系统瓶颈,证明了模运算成像在动态场景中的可行性。
原文摘要 · Abstract (English)
Conventional RGB-based high dynamic range (HDR) imaging faces a fundamental trade-off between motion artifacts in multi-exposure captures and irreversible information loss in single-shot techniques. Modulo sensors offer a promising alternative by encoding theoretically unbounded dynamic range into wrapped measurements. However, existing modulo solutions remain bottlenecked by iterative unwrapping overhead and hardware constraints limiting them to low-speed, grayscale capture. In this work, we present a complete modulo-based HDR imaging system that enables high-speed, full-color HDR acquisition by synergistically advancing both the sensing formulation and the unwrapping algorithm. At the core of our approach is an exposure-decoupled formulation of modulo imaging that allows multiple measurements to be interleaved in time, preserving a clean, observation-wise measurement model. Building upon this, we introduce an iteration-free unwrapping algorithm that integrates diffusion-based generative priors with the physical least absolute remainder property of modulo images, supporting highly efficient, physics-consistent HDR reconstruction. Finally, to validate the practical viability of our system, we demonstrate a proof-of-concept hardware implementation based on modulo-encoded spike streams. This setup preserves the native high temporal resolution of spike cameras, achieving 1000 FPS full-color imaging while reducing output data bandwidth from approximately 20 Gbps to 6 Gbps. Extensive evaluations indicate that our coordinated approach successfully overcomes key systemic bottlenecks, demonstrating the feasibility of deploying modulo imaging in dynamic scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。