用无配对数据训练动作清理模型,自动修复捕捉数据中的抖动和卡顿。
StableMotion: Training Motion Cleanup Models with Unpaired Corrupted Data
- 通过质量指标实现无配对数据训练,无需成对标注。
- 在真实足球动作数据上减少68%抖动、81%卡帧。
- 适合需要自动化清理大规模动作数据的工业场景。
动作捕捉数据常因传感器误差和后处理产生视觉突兀的伪影,传统清理依赖人工,成本高昂。以往数据驱动方法需领域内配对的带噪-干净数据,而高质量数据获取困难。本文提出StableMotion,一种直接从无配对带噪数据训练动作清理模型的方法。核心是引入可便捷标注的动作质量指标,使模型能在混合质量的原始数据上学习生成高质量动作。测试时,模型可根据质量指标生成高保真动作。该方法基于简单扩散框架,构建统一生成-判别模型,既能识别又能修复异常帧。在包含245小时真实伪影的SoccerMocap数据集上验证,模型有效纠正多种动作伪影,使运动抖动减少68%,冻结帧减少81%。代码与结果见https://yxmu.foo/stablemotion-page。
原文摘要 · Abstract (English)
Motion capture (mocap) data often exhibits visually jarring artifacts due to inaccurate sensors and post-processing. Cleaning this corrupted data can require substantial manual effort from human experts, which can be a costly and time-consuming process. Previous data-driven motion cleanup methods offer the promise of automating this cleanup process, but often require in-domain paired corrupted-to-clean training data. Constructing such paired datasets requires access to high-quality, relatively artifact-free motion clips, which often necessitates laborious manual cleanup. In this work, we present StableMotion, a simple yet effective method for training motion cleanup models directly from unpaired corrupted datasets that need cleanup. The core component of our method is the introduction of motion quality indicators, which can be easily annotated - through manual labeling or heuristic algorithms - and enable training of quality-aware motion generation models on raw motion data with mixed quality. At test time, the model can be prompted to generate high-quality motions using the quality indicators. Our method can be implemented through a simple diffusion-based framework, leading to a unified motion generate-discriminate model, which can be used to both identify and fix corrupted frames. We demonstrate that our proposed method is effective for training motion cleanup models on raw mocap data in production scenarios by applying StableMotion to SoccerMocap, a 245-hour soccer mocap dataset containing real-world motion artifacts. The trained model effectively corrects a wide range of motion artifacts, reducing motion pops and frozen frames by 68% and 81%, respectively. Results and code are available at https://yxmu.foo/stablemotion-page
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。