arXiv:2604.18744cs.CV2026-04中稿 · ECCV被引 2

首个零样本跨数据集事件相机大视差匹配模型,无需微调即可泛化。

Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras

  • 设计抗运动干扰的注意力主干,融合多时序事件特征
  • 在多个基准上比之前最佳方法提升37.7%匹配准确率
  • 适合需要跨场景泛化的事件相机应用开发者

事件相机因其对低光和高速运动的鲁棒性,在瞬时运动估计方面展现出潜力。然而,任意两视角间的大视差对应关系计算仍面临挑战,因运动导致事件外观显著变化,且基于学习的方法受限于可扩展性与有限的大视差监督。为此,我们提出首个可在零样本下实现跨数据集大视差对应关系的事件匹配模型:仅需一次训练,即可部署于未见过的数据集而无需目标域微调或适配。为实现此能力,我们引入一种抗运动且计算高效的注意力主干,从事件流中学习多时序特征,并结合稀疏感知的事件令牌选择,使大规模多样化大视差监督下的训练成为可能。为提供大视差泛化所需的监督,我们构建了鲁棒的事件运动合成框架,生成包含增强视角、模态和运动的大规模事件匹配数据集。在多个基准上的实验表明,该框架相比之前最佳事件特征匹配方法提升37.7%。代码与数据见:https://github.com/spikelab-jhu/Match-Any-Events。

原文摘要 · Abstract (English)

Event cameras have recently shown promising capabilities in instantaneous motion estimation due to their robustness to low light and fast motions. However, computing wide-baseline correspondence between two arbitrary views remains a significant challenge, since event appearance changes substantially with motion, and learning-based approaches are constrained by both scalability and limited wide-baseline supervision. We therefore introduce the first event matching model that achieves cross-dataset wide-baseline correspondence in a zero-shot manner: a single model trained once is deployed on unseen datasets without any target-domain fine-tuning or adaptation. To enable this capability, we introduce a motion-robust and computationally efficient attention backbone that learns multi-timescale features from event streams, augmented with sparsity-aware event token selection, making large-scale training on diverse wide-baseline supervision computationally feasible. To provide the supervision needed for wide-baseline generalization, we develop a robust event motion synthesis framework to generate large-scale event-matching datasets with augmented viewpoints, modalities, and motions. Extensive experiments across multiple benchmarks show that our framework achieves a 37.7% improvement over the previous best event feature matching methods. Code and data are available at: https://github.com/spikelab-jhu/Match-Any-Events.

事件相机大视差匹配零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。