arXiv:2608.15815cs.LG2026-08

用WiFi信号预测人体动作,避免误差累积,可提前多步预测。

KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum

论文配图:KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum
图 1 · 摘自论文原文
  • 将噪声的WiFi姿态序列映射到线性动力学空间,实现非迭代预测。
  • 在MM-Fi和WiPose数据集上,长短期预测均显著优于现有方法。
  • 适合需要隐私保护的智能监控、养老看护等场景。

WiFi信道状态信息(CSI)已成为替代摄像头进行人体姿态估计的隐私友好方案。然而,现有方法将姿态推断视为瞬时回归问题,未建模时间动态,无法实现未来运动预测。直接套用视觉预测方法会放大已有CSI姿态估计噪声,因自回归展开每一步都累积误差。本文提出KOALA框架,通过将噪声的CSI导出姿态序列提升至学习到的Koopman隐空间,使非线性动力学变为线性,从而无需自回归迭代或误差积累,仅通过矩阵-向量乘法即可实现多步预测。引入残差CSI条件化算子解决Koopman公式固有的恒等吸引子问题,锚点-增量预测头消除将当前姿态复制到所有预测时刻的退化捷径。为联合正则化提升与算子,设计了基于时序编码特征空间的Koopman锚定隐空间(KAL)损失,无需对比、谱或辅助损失即可强制各预测时长远动一致性。在MM-Fi和WiPose数据集上的实验表明,KOALA在短时和长时预测中均表现稳健且一致,大幅超越所有基线方法。

原文摘要 · Abstract (English)

WiFi Channel State Information (CSI) has emerged as a privacy-preserving alternative to cameras for human pose estimation. However, existing approaches treat pose inference as an instantaneous regression problem and do not model temporal dynamics, making future motion prediction infeasible. Naively applying vision-based prediction methods compounds the estimation noise already present in CSI-derived poses, as autoregressive rollouts amplify errors at every step. We propose KOALA, the framework for human motion prediction directly from WiFi CSI, by lifting noisy CSI-derived pose sequences into a learned Koopman latent space where nonlinear dynamics become linear, enabling multi-horizon prediction via simple matrix-vector products without autoregressive iteration or error accumulation. A residual CSI-conditioned operator resolves the identity attractor problem inherent from Koopman formulations, and an anchor-delta prediction head eliminates the degenerate shortcut of copying the current pose across all horizons. To regularise the lifting and operator jointly, we introduce a Koopman Anchored Latent (KAL) loss that operates in the temporal-encoder feature space, enforcing dynamical consistency across prediction horizons without requiring contrastive, spectral, or auxiliary losses. Experiments on MM-Fi and WiPose show that KOALA achieves robust, consistent performance across both short- and long-term prediction horizons, outperforming all baselines by a substantial margin.

WiFi感知动作预测Koopman隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。