用日常活动点云实现身份识别,突破仅靠走路的局限。
Beyond Gait: Person Identification from Millimeter-Wave Point Clouds Across Activities of Daily Living

- 按活动类型分发数据,用专家路由机制提升识别精度。
- 在双人场景下,mAP从57.2%提升至75.4%,Rank-1达82.1%。
- 适用于室内可控环境下的身份验证,尤其适合非行走状态。
毫米波(mmWave)点云中的人体识别传统上依赖步态。然而,室内行走常短暂且中断,其他日常生活活动(ADLs)可能提供互补的身份信息。本文构建了包含11名受试者、覆盖七种ADLs的新型点云数据集mm-ADL,研究活动状态及其变化对身份表征学习的影响。提出一种活动条件化框架,通过人体活动识别路由器将视频片段分配给特定活动的身份专家。该框架采用双流静态-动态PointNet(DS-SDPNet),融合时间聚合的空间结构与帧间动态信息。在封闭集识别(ID)和主体无关重识别(ReID)任务中评估:使用硬路由后,ID准确率从62.1%提升至68.0%;在双人ReID设置下,mAP由57.2%升至75.4%,Rank-1准确率从59.1%升至82.1%。在匹配画廊划分下,特定活动专家仍优于共享嵌入,表明增益不仅限于画廊限制。结果证实,在受控室内条件下,利用超越步态的日常活动进行身份识别是可行的,活动条件化具有显著价值。
原文摘要 · Abstract (English)
Person identification from millimeter-wave (mmWave) point clouds has mainly relied on gait. Indoor walking, however, is often brief and interrupted, while other activities of daily living (ADLs) may provide complementary identity information. We investigate identification across seven ADLs using mm-ADL, a new point-cloud dataset collected from 11 subjects under a controlled protocol. This extension introduces heterogeneous states and transitions whose spatial and temporal characteristics vary with activity. We therefore study whether activity can provide useful context for learning identity representations. We propose an activity-conditioned framework in which a human activity recognition router dispatches each clip to an activity-specific identity expert. The framework is implemented as a supervised mixture of experts, using a dual-stream static-dynamic PointNet (DS-SDPNet) to combine time-aggregated spatial structure with frame-to-frame information. We evaluate closed-set identification (ID) and subject-disjoint re-identification (ReID). With learned hard routing, ID accuracy increases from 62.1% to 68.0%. In a two-occupant ReID setting, hard routing increases mAP from 57.2% to 75.4% and Rank-1 accuracy from 59.1% to 82.1%. Under a matched gallery partition, activity-specific experts also outperform a shared embedding, showing that the gain extends beyond restricting the gallery. These results support the feasibility of using ADLs beyond gait for identification and the value of activity conditioning under controlled indoor conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。