用扩散模型提升动态点云预训练,更好捕捉运动不确定性。
Diffusion Masked Pretraining for Dynamic Point Cloud

- 用扩散模型预测被掩码的点云轨迹中心,避免位置信息泄露。
- 通过噪声预测建模运动分布,比单一确定性估计提升精度13.65%。
- 适合做动作识别、轨迹预测等动态点云下游任务的研究者。
动态点云预训练仍以掩码重建为目标,但存在两大缺陷:现有方法将真实轨迹中心作为解码器位置嵌入,导致时空位置信息泄露;同时用确定性代理目标监督帧间运动,忽略多模态轨迹不确定性。为此,我们提出扩散掩码预训练(DiMP),统一建模位置推断与运动学习。DiMP仅对掩码轨迹中心施加前向扩散噪声,从可见时空上下文中预测干净中心,消除位置泄露并保留可见坐标作为时间锚点。同时将点级帧间位移监督重构为基于解码表示的DDPM噪声预测目标,驱动编码器学习可实现运动的完整条件分布,而非退化到单一定量估计。大量实验表明,相较于基线模型,DiMP在离线动作分割上绝对提升11.21%,在线推理下提升13.65%。代码已开源。
原文摘要 · Abstract (English)
Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embeddings, causing spatio-temporal positional leakage. Moreover, they supervise inter-frame motion with deterministic proxy targets that systematically discard distributional structure by collapsing multimodal trajectory uncertainty into conditional means. To address these limitations, we propose Diffusion Masked Pretraining (DiMP), a unified self-supervised framework for dynamic point clouds. DiMP introduces diffusion modeling into both positional inference and motion learning. It first applies forward diffusion noise only to masked tube centers, then predicts clean centers from visible spatio-temporal context. This removes positional leakage while preserving visible coordinates as clean temporal anchors. DiMP also reformulates point-wise inter-frame displacement supervision as a DDPM noise-prediction objective conditioned on decoded representations. This design drives the encoder to target the full conditional distribution of plausible motions under a variational surrogate, rather than collapsing to a single deterministic estimate. Extensive experiments demonstrate that DiMP consistently improves downstream accuracy over the backbone alone, with absolute gains of 11.21% on offline action segmentation and 13.65% under causally constrained online inference.Codes are available at https://github.com/InitalZ/DiMP.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。