arXiv:2602.12590cs.CV2026-02

解决事件相机分帧时梯度消失问题,让直接处理原始事件更高效。

Unbiased Gradient Estimation for Event Binning via Functional Backpropagation

  • 通过函数反向传播技术,在不改变前向输出的前提下计算无偏梯度。
  • 实验显示在自监督光流任务中误差降低9.4%,SLAM误差降5.1%。
  • 适合想直接用原始事件做视觉感知的研究者,尤其关注梯度稳定性。

事件相机将动态场景编码为异步的时空尖峰信号(事件)。为适配传统图像处理流程,通常将事件分帧成图像。然而,分帧函数是不连续的,导致帧级梯度截断,迫使多数事件算法仅依赖帧特征。直接学习原始事件可避免此限制,但因分帧操作的不连续性,仍面临梯度估计偏差,影响学习效率。为此,本文提出一种新框架,通过在反向传播中合成弱导数,实现任意分帧函数的无偏梯度估计,同时保持前向输出不变。核心思想是利用分部积分:将目标函数提升为泛函后,反向传播中导数表现为积分形式,自然引入余切函数。通过重构采样余切向量中的余切函数,计算出与长程有限差分一致的弱导数,适用于光滑与非光滑目标。实验表明,该方法使基于优化的自运动估计误差降低3.2%,收敛速度提升1.57倍;在复杂下游任务中,自监督光流的端点误差(EPE)降低9.4%,SLAM的均方根误差(RMS error)降低5.1%,验证了其在事件视觉感知中的广泛优势。代码开源地址:https://github.com/chjz1024/EventFBP。

原文摘要 · Abstract (English)

Event-based vision encodes dynamic scenes as asynchronous spatio-temporal spikes called events. To leverage conventional image processing pipelines, events are typically binned into frames. However, binning functions are discontinuous, which truncates gradients at the frame level and forces most event-based algorithms to rely solely on frame-based features. Attempts to directly learn from raw events avoid this restriction but instead suffer from biased gradient estimation due to the discontinuities of the binning operation, ultimately limiting their learning efficiency. To address this challenge, we propose a novel framework for unbiased gradient estimation of arbitrary binning functions by synthesizing weak derivatives during backpropagation while keeping the forward output unchanged. The key idea is to exploit integration by parts: lifting the target functions to functionals yields an integral form of the derivative of the binning function during backpropagation, where the cotangent function naturally arises. By reconstructing this cotangent function from the sampled cotangent vector, we compute weak derivatives that provably match long-range finite differences of both smooth and non-smooth targets. Experimentally, our method improves simple optimization-based egomotion estimation with 3.2\% lower RMS error and 1.57$\times$ faster convergence. On complex downstream tasks, we achieve 9.4\% lower EPE in self-supervised optical flow, and 5.1\% lower RMS error in SLAM, demonstrating broad benefits for event-based visual perception. Source code can be found at https://github.com/chjz1024/EventFBP.

事件相机梯度估计反向传播视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。