首次实现稀疏毫米波雷达点云下的开放集步态识别,提升未知身份检测能力。
Open-Set Gait Recognition from Sparse mmWave Radar Point Clouds
- 融合有监督分类与无监督重建,构建鲁棒的步态特征隐空间
- 在多开放度下平均提升F1分数24%,优于现有方法
- 适用于边缘计算场景,适合隐私敏感的步态识别应用
毫米波雷达因其高效性、环境适应性强及隐私保护特性,近年来在人体感知尤其是步态识别中受到广泛关注。本文首次解决稀疏毫米波雷达点云下的开放集步态识别(OSGR)问题,突破传统封闭集假设,考虑推理时可能出现未知个体的情形。点云虽适配资源受限的边缘计算,但易受噪声和波动影响。为此,提出一种新型神经网络架构,结合监督分类与点云无监督重建,生成丰富且高度正则化的步态特征隐空间。为检测未知主体,设计基于概率的异常检测算法,利用结构化隐空间,在推理速度与精度间提供可调权衡。随论文发布新的mmGait10数据集,包含10名受试者超过5小时、多种行走模式的测量数据。大量实验表明,本方案在多个开放度水平下,平均相较现有点云方法提升F1分数24%。
原文摘要 · Abstract (English)
The adoption of Millimeter-Wave (mmWave) radar devices for human sensing, particularly gait recognition, has recently gathered significant attention due to their efficiency, resilience to environmental conditions, and privacy-preserving nature. In this work, we tackle the challenging problem of Open-set Gait Recognition (OSGR) from sparse mmWave radar point clouds. Unlike most existing research, which assumes a closed-set scenario, our work considers the more realistic open-set case, where unknown subjects might be present at inference time, and should be correctly recognized by the system. Point clouds are well-suited for edge computing applications with resource constraints, but are more significantly affected by noise and random fluctuations than other representations, like the more common micro-Doppler signature. This is the first work addressing open-set gait recognition with sparse point cloud data. To do so, we propose a novel neural network architecture that combines supervised classification with unsupervised reconstruction of the point clouds, creating a robust, rich, and highly regularized latent space of gait features. To detect unknown subjects at inference time, we introduce a probabilistic novelty detection algorithm that leverages the structured latent space and offers a tunable trade-off between inference speed and prediction accuracy. Along with this paper, we release mmGait10, an original human gait dataset featuring over five hours of measurements from ten subjects, under varied walking modalities. Extensive experimental results show that our solution attains F1-Score improvements by 24% over state-of-the-art methods adapted for point clouds, on average, and across multiple openness levels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。