arXiv:2606.01014cs.CVcs.AI2026-06被引 1

让3D人体动作编辑更精准,能识别具体要动的关节。

Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing

论文配图:Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing
图 1 · 摘自论文原文
  • 用双轴注意力网络分别捕捉关节和时间特征,再融合
  • 引入软DTW距离回归辅助任务,定位需修改的关节
  • 在MotionFix数据集上效果领先,生成动作更符合指令

我们研究基于文本的3D人体动作编辑,目标是在保持源动作风格与结构的前提下,根据自然语言指令进行修改。MotionFix数据集的发布推动了基于训练的扩散模型发展,这类模型可直接从源动作和文本指令生成编辑后动作。以往工作主要关注编辑发生的时间点,而我们的目标是让模型不仅理解时间,还能识别具体哪些关节需要改变。为此,我们提出一种新架构和一个辅助任务。该架构包含两个轴向锚定的Transformer:一个提取关节维度特征,另一个提取时间维度特征,并通过交叉轴融合模块整合表示。我们还引入一个辅助任务,训练关节锚定Transformer回归源与目标关节旋转间的软DTW距离,使模块学会判断应修改或保留的关节。在MotionFix数据集上的全面实验表明,我们的方法显著提升了生成动作与文本指令及源动作的语义对齐度,同时提高了动作整体保真度,达到当前最优性能。

原文摘要 · Abstract (English)

We address text-based 3D human motion editing, where the goal is to preserve the style and structure of a source motion while applying edits described in natural language. The release of the MotionFix dataset has spurred active research into training-based diffusion models that directly generate an edited motion from a source motion and a text instruction. While previous works have focused primarily on learning when an edit should occur temporally, our goal is to create a model that understands not only this temporal aspect but also which specific joints are responsible for the change. Targeting this, we propose a novel architecture and a complementary auxiliary task to aid its training. Our architecture consists of two axis-anchored transformers, which extract distinct features along the joint and time dimensions respectively, and a cross-axis fusion block that integrates these representations. We further introduce an auxiliary task that trains the joint-anchored transformer to regress the Soft-DTW distance between source and target joint rotations. This objective teaches the module to understand which joints to modify and which to preserve. Through comprehensive experiments on the MotionFix dataset, we demonstrate that our method significantly improves semantic alignment with both the text instruction and the source motion, as well as the overall fidelity of the generated motion, achieving state-of-the-art results.

动作编辑扩散模型关节定位文本控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。