arXiv:2511.09147cs.CVcs.AI2025-11AAAI

用压力信号实现多人动作捕捉,隐私安全且不受遮挡影响。

PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery

  • 通过追踪检测分离多人压力信号,再分别做人体网格重建。
  • 在多人群体场景下达到89.2mm MPJPE和112.6mm WA-MPJPE₁₀₀。
  • 适用于需要隐私保护的公共空间动作识别,如智能场馆、无障碍设计。

多人全局人体网格重建(HMR)对于理解人群动态与交互至关重要。传统视觉方法在真实场景中常受相互遮挡、光照不足及隐私问题限制。人体-地面触觉交互提供了一种无遮挡、隐私友好的运动捕捉方式。已有研究证明,从触觉垫获取的压力信号可有效估计单人姿态。然而,当多人同时随机行走时,如何区分交织的压力信号并提取个体的时间序列数据,仍是扩展压力驱动HMR至多人场景的关键挑战。本文提出 extbf{PressTrack-HMR},一种基于压力信号的自顶向下多人全局人体网格重建方法。该方法采用追踪-检测策略,先从原始压力数据中识别并分割每位个体的压力信号,再对每个提取信号执行人体网格重建。此外,我们构建了多人交互压力数据集 extbf{MIP},以推动压力驱动人体运动分析的研究。实验表明,本方法在压力数据上的多人HMR表现优异,达到89.2 $mm$ MPJPE 和 112.6 $mm$ WA-MPJPE$_{100}$,展示了触觉垫在普适性、隐私保护式多人动作识别中的潜力。代码与数据集已开源:https://github.com/Jiayue-Yuan/PressTrack-HMR。

原文摘要 · Abstract (English)

Multi-person global human mesh recovery (HMR) is crucial for understanding crowd dynamics and interactions. Traditional vision-based HMR methods sometimes face limitations in real-world scenarios due to mutual occlusions, insufficient lighting, and privacy concerns. Human-floor tactile interactions offer an occlusion-free and privacy-friendly alternative for capturing human motion. Existing research indicates that pressure signals acquired from tactile mats can effectively estimate human pose in single-person scenarios. However, when multiple individuals walk randomly on the mat simultaneously, how to distinguish intermingled pressure signals generated by different persons and subsequently acquire individual temporal pressure data remains a pending challenge for extending pressure-based HMR to the multi-person situation. In this paper, we present \textbf{PressTrack-HMR}, a top-down pipeline that recovers multi-person global human meshes solely from pressure signals. This pipeline leverages a tracking-by-detection strategy to first identify and segment each individual's pressure signal from the raw pressure data, and subsequently performs HMR for each extracted individual signal. Furthermore, we build a multi-person interaction pressure dataset \textbf{MIP}, which facilitates further research into pressure-based human motion analysis in multi-person scenarios. Experimental results demonstrate that our method excels in multi-person HMR using pressure data, with 89.2 $mm$ MPJPE and 112.6 $mm$ WA-MPJPE$_{100}$, and these showcase the potential of tactile mats for ubiquitous, privacy-preserving multi-person action recognition. Our dataset & code are available at https://github.com/Jiayue-Yuan/PressTrack-HMR.

压力感知多人追踪隐私保护动作识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。