arXiv:2511.05038cs.CV2025-11被引 1

用脚底压力和文字描述重建人体动作,无需摄像头设备。

Pressure2Motion: Hierarchical Human Motion Reconstruction from Ground Pressure with Text Guidance

  • 双层特征提取+分层扩散模型解析压力数据
  • 生成高保真、符合物理规律的动作序列
  • 适合隐私保护、低光照等低成本场景

我们提出 Pressure2Motion,一种从地面压力序列与文本提示中重建人体动作的新颖运动捕捉算法。推理时仅需压力垫,无需特殊照明、摄像头或可穿戴设备,适用于隐私保护、低光及低成本场景。该任务因压力信号与全身动作间存在严重不确定性而极具挑战。为此,我们设计一个生成模型,以压力特征为输入,文本提示作为高层约束来消除歧义。模型采用双层特征提取器精准解析压力数据,并通过分层扩散模型分别识别大尺度运动轨迹与细微姿态调整。结合压力带来的物理线索与文本提供的语义引导,实现高精度动作估计。据我们所知,Pressure2Motion是首个同时利用压力数据与语言先验进行动作重建的工作,所建立的MPL基准是该新兴任务的首个基准。实验表明,本方法生成高质量、符合物理规律的动作,达到该任务新基准水平。代码与基准将公开发表后开放。

原文摘要 · Abstract (English)

We present Pressure2Motion, a novel motion capture algorithm that reconstructs human motion from a ground pressure sequence and text prompt. At inference time, Pressure2Motion requires only a pressure mat, eliminating the need for specialized lighting setups, cameras, or wearable devices, making it suitable for privacy-preserving, low-light, and low-cost motion capture scenarios. Such a task is severely ill-posed due to the indeterminacy of pressure signals with respect to full-body motion. To address this issue, we introduce Pressure2Motion, a generative model that leverages pressure features as input and utilizes a text prompt as a high-level guiding constraint to resolve ambiguities. Specifically, our model adopts a dual-level feature extractor to accurately interpret pressure data, followed by a hierarchical diffusion model that discerns broad-scale movement trajectories and subtle posture adjustments. Both the physical cues gained from the pressure sequence and the semantic guidance derived from descriptive texts are leveraged to guide the motion estimation with precision. To the best of our knowledge, Pressure2Motion is a pioneering work in leveraging both pressure data and linguistic priors for motion reconstruction, and the established MPL benchmark is the first benchmark for this novel motion capture task. Experiments show that our method generates high-fidelity, physically plausible motions, establishing a new state of the art for this task. The codes and benchmarks will be publicly released upon publication.

动作重建压力感应文本引导扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。