提出新框架,让文本驱动的人体动作编辑既改得准又不失原节奏和结构。
Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing

- 分离空间姿态与时间节奏,分别设计学习机制
- 在两个数据集上实现最优编辑对齐与结构保真度
- 适合需要精细动作编辑的影视、游戏开发场景
文本驱动的人体动作编辑旨在根据自然语言指令修改已有动作序列,同时保持原始动作的结构一致性。现有基于扩散的方法难以平衡文本响应的‘变化’与固有的‘不变性’,常依赖粗粒度空间约束和固定时间假设,导致空间动作失真及内在物理节奏破坏。为此,我们提出统一框架CIME,将变化与不变性全面解耦至空间姿态与时间节奏维度。针对空间姿态,引入全监督正负样本学习机制,包含分层回溯特征监督、细微动作保留与基于三元组的语义对齐;针对时间节奏,提出黎曼非均匀积分流形映射(RNIMM)模块,通过考虑运动学的非均匀时间戳实现编辑后物理节拍的高保真还原。在MotionFix与STANCE Adjustment数据集上的大量实验表明,CIME在编辑对齐与结构保真度上达到当前最佳性能,验证了统一架构的有效性。代码与模型已开源:github.com/ZhenwuShi/CIME.git
原文摘要 · Abstract (English)
Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。