arXiv:2603.27757cs.CVcs.RO2026-03

轻量级事件流预测模型,高效捕捉动态运动。

E-TIDE: Fast, Structure-Preserving Motion Forecasting from Event Sequences

  • 设计稀疏事件张量的时序交互模块,低复杂度建模时间依赖
  • 在标准数据集上性能接近顶尖方法,模型体积更小
  • 无需大规模预训练,适合嵌入式设备实时部署

事件相机以异步像素亮度变化流的形式捕捉视觉信息,生成稀疏且时间精度高的数据。相比传统帧基传感器,它们在捕捉高速动态的同时功耗显著更低。从历史观测中预测未来事件表示是重要问题,可支持未来语义分割或物体跟踪等下游任务,而无需访问未来传感器数据。尽管现有先进方法表现优异,但常依赖计算密集型主干网络和大规模预训练,限制了在资源受限场景的应用。本文提出E-TIDE,一种轻量级、端到端可训练的事件张量预测架构,无需大规模预训练即可高效运行。该方法采用TIDE模块(时序动态事件交互),通过大核混合与活动感知门控机制,在保持低计算复杂度的前提下捕捉时序依赖。在标准事件数据集上的实验表明,本方法在显著降低模型规模与训练需求的同时,达到具有竞争力的性能,非常适合在严苛延迟与内存预算下实现实时部署。

原文摘要 · Abstract (English)

Event-based cameras capture visual information as asynchronous streams of per-pixel brightness changes, generating sparse, temporally precise data. Compared to conventional frame-based sensors, they offer significant advantages in capturing high-speed dynamics while consuming substantially less power. Predicting future event representations from past observations is an important problem, enabling downstream tasks such as future semantic segmentation or object tracking without requiring access to future sensor measurements. While recent state-of-the-art approaches achieve strong performance, they often rely on computationally heavy backbones and, in some cases, large-scale pretraining, limiting their applicability in resource-constrained scenarios. In this work, we introduce E-TIDE, a lightweight, end-to-end trainable architecture for event-tensor prediction that is designed to operate efficiently without large-scale pretraining. Our approach employs the TIDE module (Temporal Interaction for Dynamic Events), motivated by efficient spatiotemporal interaction design for sparse event tensors, to capture temporal dependencies via large-kernel mixing and activity-aware gating while maintaining low computational complexity. Experiments on standard event-based datasets demonstrate that our method achieves competitive performance with significantly reduced model size and training requirements, making it well-suited for real-time deployment under tight latency and memory budgets.

事件相机运动预测轻量化模型实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。