arXiv:2507.20170cs.CV2025-07ICCV被引 2

用点云统一人体动作数据,让不同体型角色共享运动能力。

PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks

  • 将动作转为无结构点云,绕过骨骼差异限制
  • 预训练后无需标注即能预测、过渡和补关键帧
  • 适合跨体型动作生成与通用动作建模任务

运动骨骼通过骨骼层级变换驱动3D角色动画,但体型或结构差异导致动作数据难以跨骨架迁移,制约数据驱动的动作合成。时间点云(Temporal Point Clouds, TPCs)提供一种无结构的跨兼容动作表示,虽可还原为骨骼,但主要用于兼容性而非直接用于动作任务学习。实现该目标需具备对TPC格式的数据生成能力,这带来了独特的时序一致性与点可辨识性挑战。为此,我们提出PUMPS——首个专为TPC数据设计的原始自编码架构。PUMPS独立将每帧点云压缩为可采样的特征向量,解码器利用潜在高斯噪声向量作为采样标识,提取具有时序一致性的独立时间点。引入基于线性分配的点对齐机制优化重建过程,并避免使用昂贵的逐点注意力机制。基于这些潜在特征,我们构建了可执行动作预测、过渡生成和关键帧插值的预训练模型。在无原生数据集监督下,PUMPS在各项预训练任务中表现优异,达到顶尖水平。微调用于去噪或估计任务时,仍优于多数专用方法,且不偏离其通用架构设计。

原文摘要 · Abstract (English)

Motion skeletons drive 3D character animation by transforming bone hierarchies, but differences in proportions or structure make motion data hard to transfer across skeletons, posing challenges for data-driven motion synthesis. Temporal Point Clouds (TPCs) offer an unstructured, cross-compatible motion representation. Though reversible with skeletons, TPCs mainly serve for compatibility, not for direct motion task learning. Doing so would require data synthesis capabilities for the TPC format, which presents unexplored challenges regarding its unique temporal consistency and point identifiability. Therefore, we propose PUMPS, the primordial autoencoder architecture for TPC data. PUMPS independently reduces frame-wise point clouds into sampleable feature vectors, from which a decoder extracts distinct temporal points using latent Gaussian noise vectors as sampling identifiers. We introduce linear assignment-based point pairing to optimise the TPC reconstruction process, and negate the use of expensive point-wise attention mechanisms in the architecture. Using these latent features, we pre-train a motion synthesis model capable of performing motion prediction, transition generation, and keyframe interpolation. For these pre-training tasks, PUMPS performs remarkably well even without native dataset supervision, matching state-of-the-art performance. When fine-tuned for motion denoising or estimation, PUMPS outperforms many respective methods without deviating from its generalist architecture.

动作生成点云预训练跨骨架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。