RoMo可自动修复光学动捕数据中的标签错误与位置误差,减少人工干预。
RoMo: A Robust Solver for Full-body Unlabeled Optical Motion Capture
- 分步处理:先分组标记点,再分割身体区域,最后精准标注各部位
- 真实数据上手部标签F1分数从0.94提升至0.98,关节误差降低25%
- 适合无商业系统可用的复杂场景,无需依赖昂贵设备
光学动捕(MoCap)是捕捉全身动作的“金标准”,但原始数据常存在标签错误、遮挡和位置偏差,需大量人工修正。为此,本文提出学习型框架RoMo,实现鲁棒的标记与运动求解。在标记阶段,采用分治策略将复杂任务分解为对齐、全身体分割和部位特异性标注三个子任务;通过基于K部图聚类算法生成标记轨迹,利用位置与特征相似性构建边关系。在运动求解阶段,设计混合逆运动学求解器,以关节位置为中间表示,并调整模板骨骼匹配估计结果,防止误差沿运动链累积。实验表明,RoMo在多个指标与数据集上均表现优异,优于现有最先进方法。在真实数据集上,手部标签的F1分数由0.94提升至0.98,身体运动求解的关节位置误差降低25%。该方法适用于商业系统无法胜任的场景。代码与数据已公开于https://github.com/non-void/RoMo。
原文摘要 · Abstract (English)
Optical motion capture (MoCap) is the "gold standard" for accurately capturing full-body motions. To make use of raw MoCap point data, the system labels the points with corresponding body part locations and solves the full-body motions. However, MoCap data often contains mislabeling, occlusion and positional errors, requiring extensive manual correction. To alleviate this burden, we introduce RoMo, a learning-based framework for robustly labeling and solving raw optical motion capture data. In the labeling stage, RoMo employs a divide-and-conquer strategy to break down the complex full-body labeling challenge into manageable subtasks: alignment, full-body segmentation and part-specific labeling. To utilize the temporal continuity of markers, RoMo generates marker tracklets using a K-partite graph-based clustering algorithm, where markers serve as nodes, and edges are formed based on positional and feature similarities. For motion solving, to prevent error accumulation along the kinematic chain, we introduce a hybrid inverse kinematic solver that utilizes joint positions as intermediate representations and adjusts the template skeleton to match estimated joint positions. We demonstrate that RoMo achieves high labeling and solving accuracy across multiple metrics and various datasets. Extensive comparisons show that our method outperforms state-of-the-art research methods. On a real dataset, RoMo improves the F1 score of hand labeling from 0.94 to 0.98, and reduces joint position error of body motion solving by 25%. Furthermore, RoMo can be applied in scenarios where commercial systems are inadequate. The code and data for RoMo are available at https://github.com/non-void/RoMo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。