提出可自适应压缩事件相机数据的实时系统,解决稀疏输出与机器人系统兼容难题。
Efficient Event Camera Volume System
- 将事件流建模为连续时间脉冲序列,直接在事件时刻计算变换,避免分桶伪影。
- 在EHPT-XC和MVSEC上实现更优重建质量,DTFT使地球移动距离最低。
- 支持跨数据集强泛化,实测推理延迟仅1.5毫秒,适合实时机器人应用。
事件相机具有低延迟和高动态范围的优势,但其稀疏输出难以融入标准机器人处理流程。我们提出名为EECVS(高效事件相机体系统)的新框架,将事件流建模为连续时间狄拉克脉冲序列,通过在事件发生时刻直接评估变换实现无伪影压缩。核心创新在于结合密度驱动的自适应选择机制,在DCT、DTFT和DWT之间动态选择最优变换,并针对每种变换的稀疏特性设计专用系数剪枝策略。该框架消除了时间分桶带来的伪影,能根据实时事件密度自动调整压缩策略。在EHPT-XC和MVSEC数据集上,该框架实现了更优的重建保真度,其中DTFT取得最低地球移动距离。下游分割任务中,EECVS展现出鲁棒泛化能力。值得注意的是,其跨数据集泛化表现优异:使用EventSAM进行分割时,于MVSEC上获得0.87平均交并比,远超24通道体素网格的0.44;同时在EHPT-XC上保持竞争力。我们的ROS2实现支持实时部署,采用DCT处理时延迟仅为1.5毫秒,吞吐量达其他变换的2.7倍,首次构建了一个兼具计算效率与跨场景优异泛化性的自适应事件压缩框架。
原文摘要 · Abstract (English)
Event cameras promise low latency and high dynamic range, yet their sparse output challenges integration into standard robotic pipelines. We introduce \nameframew (Efficient Event Camera Volume System), a novel framework that models event streams as continuous-time Dirac impulse trains, enabling artifact-free compression through direct transform evaluation at event timestamps. Our key innovation combines density-driven adaptive selection among DCT, DTFT, and DWT transforms with transform-specific coefficient pruning strategies tailored to each domain's sparsity characteristics. The framework eliminates temporal binning artifacts while automatically adapting compression strategies based on real-time event density analysis. On EHPT-XC and MVSEC datasets, our framework achieves superior reconstruction fidelity with DTFT delivering the lowest earth mover distance. In downstream segmentation tasks, EECVS demonstrates robust generalization. Notably, our approach demonstrates exceptional cross-dataset generalization: when evaluated with EventSAM segmentation, EECVS achieves mean IoU 0.87 on MVSEC versus 0.44 for voxel grids at 24 channels, while remaining competitive on EHPT-XC. Our ROS2 implementation provides real-time deployment with DCT processing achieving 1.5 ms latency and 2.7X higher throughput than alternative transforms, establishing the first adaptive event compression framework that maintains both computational efficiency and superior generalization across diverse robotic scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。