SafeMo通过连续空间去学习,让文本生成动作更安全且自然。
SafeMo: Linguistically Grounded Unlearning for Trustworthy Text-to-Motion Generation
- 在连续空间中进行最小运动去学习,避免离散编码替换的副作用。
- 相比当前最强方法,对危险提示的遗忘能力提升2.5倍至14.4倍。
- 适合需要安全可靠动作生成的应用,如虚拟人、游戏与康复训练。
以扩散模型为基础的文本生成动作(T2M)方法虽具强真实感与对齐性,但安全性问题日益凸显。现有方法通过替换离散VQ-VAE码本条目来规避不安全行为,但存在两大缺陷:其一,码本条目被正常提示复用,导致日常任务性能下降;其二,基于离散标记的方法引入量化与平滑损失,造成伪影和动作不连贯。此外,现有数据集天然包含不安全意图及对应动作,不适合用于安全驱动的学习。为此,我们提出SafeMo,一种可信动作生成框架,融合最小运动去学习(MMU)策略,采用两阶段机器去学习机制,在连续空间中实现安全动作生成,保留连续运动学特性,无码本损失,并在安全-效用权衡上优于现有基线。我们还构建了首个安全文本生成动作数据集SafeMoVAE-29K,包含重写的安全文本提示与连续优化的动作。基于DiP架构,SafeMo能高效生成自然过渡的安全动作。实验表明,相比前序最先进方法LCR,SafeMo在HumanML3D和Motion-X上的遗忘集FID分别提升2.5倍与14.4倍,同时对安全提示的良性表现保持良好或相当。
原文摘要 · Abstract (English)
Text-to-motion (T2M) generation with diffusion backbones achieves strong realism and alignment. Safety concerns in T2M methods have been raised in recent years; existing methods replace discrete VQ-VAE codebook entries to steer the model away from unsafe behaviors. However, discrete codebook replacement-based methods have two critical flaws: firstly, replacing codebook entries which are reused by benign prompts leads to drifts on everyday tasks, degrading the model's benign performance; secondly, discrete token-based methods introduce quantization and smoothness loss, resulting in artifacts and jerky transitions. Moreover, existing text-to-motion datasets naturally contain unsafe intents and corresponding motions, making them unsuitable for safety-driven machine learning. To address these challenges, we propose SafeMo, a trustworthy motion generative framework integrating Minimal Motion Unlearning (MMU), a two-stage machine unlearning strategy, enabling safe human motion generation in continuous space, preserving continuous kinematics without codebook loss and delivering strong safety-utility trade-offs compared to current baselines. Additionally, we present the first safe text-to-motion dataset SafeMoVAE-29K integrating rewritten safe text prompts and continuous refined motion for trustworthy human motion unlearning. Built upon DiP, SafeMo efficiently generates safe human motions with natural transitions. Experiments demonstrate effective unlearning performance of SafeMo by showing strengthened forgetting on unsafe prompts, reaching 2.5x and 14.4x higher forget-set FID on HumanML3D and Motion-X respectively, compared to the previous SOTA human motion unlearning method LCR, with benign performance on safe prompts being better or comparable. Code: https://github.com/AIGeeksGroup/SafeMo. Website: https://aigeeksgroup.github.io/SafeMo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。