让动作编辑更精准:只换身体局部风格,不乱动其他部分。
MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfer

- 按身体部位分解动作内容与参考特征,分路控制
- 局部替换后保留区域误差降为66.45毫米,干扰泄漏减半
- 适合需要精细控制动作细节的研究者与动画师
动作编辑常需将某一姿态或步态从参考动作中迁移,同时保持源动作、时间、根部轨迹及未选部位不变。现有数据集极少提供任意局部内容与参考的成对样本,自重建训练可能导致扩散模型复制内容动作却未能有效利用指定参考。本文提出MoSAIC,一种基于潜在扩散的局部动作风格迁移框架。该方法按解剖区域分解内容与参考特征,通过独立路径保留根部轨迹,并将用户选择的参考路由至各身体部位。核心创新为对齐干预监督机制,通过可控局部变换构建同步参考与反事实目标,使请求的局部响应与需保留的动作在训练中均清晰可见。冻结评估显示,在128个动作、896种路由条件下,局部掩码路由使保留区域误差从70.64降至66.45毫米,非目标区域噪声泄漏从18.08降至9.88毫米,同时保持正向目标响应;预算受限延续实验进一步表明,保留对齐干预监督可使目标响应提升8.8%,路由影响集中度提高2.0个百分点。结果表明,MoSAIC显著改善了局部动作编辑中响应与保留之间的权衡。
原文摘要 · Abstract (English)
Editing character motion often requires transferring a gesture or gait from one or more reference motions while preserving the source action, timing, root trajectory, and unselected body regions. Existing motion datasets, however, rarely provide paired targets for arbitrary part-local content--reference combinations, and self-reconstruction training may allow a diffusion model to reproduce the content motion while underusing the routed reference. We present MoSAIC, a latent diffusion framework for part-local reference-conditioned motion style transfer. MoSAIC factorizes content and reference features by anatomical region, preserves the root trajectory through a separate conditioning pathway, and routes user-selected references to individual body parts. Its central contribution is aligned intervention supervision, which constructs synchronized references and counterfactual targets through controlled local transformations, making both the requested regional response and the motion to be preserved directly observable during training. In a frozen evaluation comprising 128 motions and 896 routed conditions, part-masked routing reduces preserved-region error from 70.64 to 66.45~mm and matched-noise off-target leakage from 18.08 to 9.88~mm relative to whole-body routing, while retaining a positive selected-region response. A matched-budget continuation study further shows that retaining aligned intervention supervision produces an 8.8\% relative increase in selected-target response and a 2.0-percentage-point increase in requested-route influence concentration. These results demonstrate that MoSAIC improves the response--preservation trade-off required for selective and controllable part-local motion editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。