arXiv:2510.24231cs.CV2025-10中稿 · British Machine Vi…被引 4

用事件相机构建微眼动数据集,实现高精度小运动识别

Benchmarking Microsaccade Recognition with Event Cameras: A Novel Dataset and Evaluation

  • 用Blender生成7类0.5~2.0度微眼动事件流,保留毫秒级动态
  • 基于脉冲网络的模型达到90%准确率,不依赖事件数量或持续时间
  • 为认知计算中的细粒度运动识别提供新基准和开源资源

微眼动是视觉感知与神经处理中至关重要的微小、非自主眼动。传统研究多依赖眼动仪或帧基分析,虽精度高但成本高且难以扩展。事件传感器可高效捕捉精细时空变化,具备高速与低延迟优势。本文首次构建事件相机驱动的微眼动数据集,利用Blender生成高保真眼动场景,模拟0.5至2.0度角位移的微眼动,分为七类,并通过v2e转换为事件流,保留微眼动自然时序动态,持续时间在0.25至2.25毫秒之间。采用Spiking-VGG11、Spiking-VGG13及改进版Spiking-VGG16Flow(基于SpikingJelly)进行评估,模型平均准确率达约90%,可按角位移准确分类,且不受事件总数或持续时间影响。结果表明脉冲神经网络在精细运动识别中的潜力,为事件视觉研究建立新基准。数据集、代码与训练模型将公开于https://waseemshariff126.github.io/microsaccades/。

原文摘要 · Abstract (English)

Microsaccades are small, involuntary eye movements vital for visual perception and neural processing. Traditional microsaccade studies typically use eye trackers or frame-based analysis, which, while precise, are costly and limited in scalability and temporal resolution. Event-based sensing offers a high-speed, low-latency alternative by capturing fine-grained spatiotemporal changes efficiently. This work introduces a pioneering event-based microsaccade dataset to support research on small eye movement dynamics in cognitive computing. Using Blender, we render high-fidelity eye movement scenarios and simulate microsaccades with angular displacements from 0.5 to 2.0 degrees, divided into seven distinct classes. These are converted to event streams using v2e, preserving the natural temporal dynamics of microsaccades, with durations ranging from 0.25 ms to 2.25 ms. We evaluate the dataset using Spiking-VGG11, Spiking-VGG13, and Spiking-VGG16, and propose Spiking-VGG16Flow, an optical-flow-enhanced variant implemented in SpikingJelly. The models achieve around 90 percent average accuracy, successfully classifying microsaccades by angular displacement, independent of event count or duration. These results demonstrate the potential of spiking neural networks for fine motion recognition and establish a benchmark for event-based vision research. The dataset, code, and trained models will be publicly available at https://waseemshariff126.github.io/microsaccades/ .

事件相机微眼动脉冲网络运动识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。