arXiv:2506.20222cs.CVeess.SP2025-06

动态分配带宽,让事件相机和图像相机协同传输更高效。

Dynamic Bandwidth Allocation for Hybrid Event-RGB Transmission

  • 用贝叶斯建模和信息瓶颈分离共享与特定信息
  • 根据场景动态自动分配带宽,提升重建质量
  • 适合需要实时去模糊的视觉系统开发人员

事件相机以极低延迟异步捕捉像素级亮度变化,常与RGB相机联合用于各类视觉应用。但混合系统面临事件数据和图像数据量大带来的传输挑战。为此,我们提出一种传输方案,在保证双源高效重建的同时实现并行实时去模糊。传统RGB相机与事件相机对同一场景的捕获方式不同,常导致输出间存在大量冗余信息。为此,我们构建了联合事件-图像(E-I)传输框架以消除冗余,优化信道带宽利用。该方法采用贝叶斯建模与信息瓶颈法,分离输入中的共享信息与域特异性信息,确保提取的信息既紧凑又富含信息量。此外,系统根据场景动态自适应分配带宽:动态场景多传事件数据以保留细节,静态场景多传图像数据以保持清晰度。仿真结果表明,该方案不仅重建质量优于传统系统,还显著提升了去模糊性能。

原文摘要 · Abstract (English)

Event cameras asynchronously capture pixel-level intensity changes with extremely low latency. They are increasingly used in conjunction with RGB cameras for a wide range of vision-related applications. However, a major challenge in these hybrid systems lies in the transmission of the large volume of triggered events and RGB images. To address this, we propose a transmission scheme that retains efficient reconstruction performance of both sources while accomplishing real-time deblurring in parallel. Conventional RGB cameras and event cameras typically capture the same scene in different ways, often resulting in significant redundant information across their outputs. To address this, we develop a joint event and image (E-I) transmission framework to eliminate redundancy and thereby optimize channel bandwidth utilization. Our approach employs Bayesian modeling and the information bottleneck method to disentangle the shared and domain-specific information within the E-I inputs. This disentangled information bottleneck framework ensures both the compactness and informativeness of extracted shared and domain-specific information. Moreover, it adaptively allocates transmission bandwidth based on scene dynamics, i.e., more symbols are allocated to events for dynamic details or to images for static information. Simulation results demonstrate that the proposed scheme not only achieves superior reconstruction quality compared to conventional systems but also delivers enhanced deblurring performance.

事件相机带宽分配多模态传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。