用事件相机提升步态识别鲁棒性,尤其在低光环境下表现更优。
EventGait: Towards Robust Gait Recognition with Event Streams

- 双流架构分别建模动态与静态特征,保留事件数据的精细时间信息。
- 在低光照下性能显著超越传统摄像头方法,合成与真实数据均达新高。
- 首次发布两个大规模事件流步态数据集,推动领域发展。
步态识别可实现非侵入式、保护隐私的身份验证,但传统摄像头在光照变化和运动模糊下表现不佳。本文探索使用事件相机进行步态识别,其具备微秒级时间分辨率和高动态范围,能自然捕捉动态线索并抑制静态噪声。现有方法通常将事件流聚合为事件图像,丢失了步态识别关键的精细运动动态。为此,我们提出端到端的双流框架EventGait:动态流采用带多样神经元参数的脉冲专家混合(MoSE),增强复杂光照与运动下的动态感知;静态流通过跨模态结构对齐(CroSA)与大视觉基础模型学习密集形状表征。为弥补缺乏大规模事件步态数据,我们构建合成管道并发布两个新基准:SUSTech1K-E 和 CCGR-Mini-E。大量实验表明,事件基步态识别在正常条件下性能接近传统方法,在低光场景中显著超越,且在合成与真实事件数据上均达到新基准水平,凸显事件驱动步态分析的鲁棒性与潜力。代码与数据已开源。
原文摘要 · Abstract (English)
Gait recognition enables non-intrusive, privacy-preserving identification but suffers in uncontrolled environments due to illumination and motion sensitivity of conventional cameras. In this work, we explore gait recognition using event cameras, which offer microsecond temporal resolution and high dynamic range, naturally capturing robust dynamic cues and suppressing static noise. Existing event-based approaches typically aggregate event streams into event images over long time windows, thereby discarding fine-grained motion dynamics critical for gait recognition. Therefore, we propose \textbf{EventGait}, an end-to-end dual-stream framework that separately models motion and shape while preserving the advantages of events. Our dynamic stream leverages a Mixture of Spiking Experts (MoSE) with diverse neuron constants for robust dynamic perception across complex motion and illumination scenes, while the static stream learns dense shape representations via Cross-modal Structure Alignment (CroSA) with large vision foundation models. To address the absence of large-scale event-based gait datasets, we introduce a synthesis pipeline and release two new benchmarks: SUSTech1K-E and CCGR-Mini-E. Extensive experiments have shown that event-based gait recognition not only achieves results comparable to camera-based gait recognition under normal conditions but also significantly outperforms it in low-light scenarios. Our approach sets a new state of the art on both synthesized and real-world event-based gait benchmarks, highlighting the robustness and potential of event-driven gait analysis. The code and datasets are released at https://github.com/QUEAHREN/EventGait.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。