arXiv:2605.22775cs.LGcs.AI2026-05

用双向Mamba+显式缺失建模,提升眼动数据实时认知负荷评估精度。

MambaGaze: Bidirectional Mamba with Explicit Missing Data Modeling for Cognitive Load Assessment from Eye-Gaze Tracking Data

论文配图:MambaGaze: Bidirectional Mamba with Explicit Missing Data Modeling for Cognitive Load Assessment from Eye-Gaze Tracking Data
图 1 · 摘自论文原文
  • 引入XMD编码,用观察掩码和时间差显式建模眨眼等数据缺失
  • 双向Mamba-2实现线性复杂度长时依赖建模,精度达77.1%准确率
  • 可部署于边缘设备,36FPS且功耗低于6.6W,适合车载等实时场景

从眼动信号实时评估认知负荷可支持驾驶警觉监控等关键应用,但面临两大挑战:频繁的数据缺失(如眨眼)和长程时序依赖的高效建模。本文提出MambaGaze(Bi-Mamba)框架,通过(1)XMD编码,将观测掩码与时间差加入原始特征以显式建模数据不确定性;(2)双向Mamba-2,以线性计算复杂度捕捉时序依赖。在CLARE与CL-Drive数据集上,采用留一被试者交叉验证,分别取得77.1%准确率与59.2%宏F1,69.4%准确率与51.5%宏F1,所有对比模型中平均留一被试者宏F1最高(55.3%)。输入流消融实验表明,对数缩放的时间差是单一最强通道,三路XMD融合带来5-20个百分点的宏F1提升。在三款NVIDIA Jetson Orin平台上部署测试,实现实时推理27-36 FPS,功耗低于6.6 W,验证了嵌入式认知负荷监测的可行性。

原文摘要 · Abstract (English)

Real-time cognitive load assessment from eye-tracking signals could enable adaptive human-centered AI in safety-critical applications such as driver vigilance monitoring or automated flight deck assistance, yet two challenges persist: handling frequent data missingness from blinks and tracking failures, and efficiently modeling long-range temporal dependencies. We propose MambaGaze (Bi-Mamba), a framework that addresses these challenges through (1) XMD encoding, which augments raw features with observation masks and time-deltas to explicitly model data uncertainty, and (2) bidirectional Mamba-2, which captures temporal dependencies with linear computational complexity. Experiments on CLARE and CL-Drive datasets under leave-one-subject-out evaluation show that MambaGaze achieves 77.1% accuracy and 59.2% macro-F1 on CLARE, and 69.4% accuracy and 51.5% macro-F1 on CL-Drive, attaining the highest average LOSO macro-F1 (55.3%) across all ten compared models. Input-stream ablation indicates that log-scaled time-deltas are the strongest single channel in our setting, and combining all three XMD streams provides consistent gains of 5-20 pp macro-F1. Edge deployment benchmarks on three NVIDIA Jetson Orin platforms show real-time inference at 27-36 FPS with power consumption below 6.6 W, supporting feasibility for embedded cognitive load monitoring.

认知负荷眼动追踪边缘计算Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。