arXiv:2606.05624cs.CVcs.GR2026-06被引 1

让文字生成动作更精准,能按轨迹控制角色运动。

KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motion

论文配图:KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motion
图 1 · 摘自论文原文
  • 在注意力层注入控制记忆,不修改原有模型结构。
  • 可精准跟踪根节点和多关节轨迹,误差小于1厘米。
  • 适配动画制作与智能体交互,控制轻量透明。

文本驱动的3D人体动作生成模型已能根据提示合成合理动作,但实际动画与具身智能体应用常需额外轨迹控制:如跟随绘制的根部路径、到达末端执行器目标或满足多关节运动轨迹,同时保持语言描述的步态、风格与意图。现有方法要么复制大量生成器以恢复逐层控制,要么将计算负担转移至推理阶段。本文提出KV-Control,一种针对冻结的掩码文本到动作变压器的紧凑注意力侧控制接口。核心思想是将几何约束作为记忆嵌入自注意力机制内部,而非通过全局姿态标记或仅在输出端施加约束。为此,我们协同设计了部件分词的动作底座与控制器:PartVQ学习解剖对齐的部件码本,T-Concat使每帧-部件标记成为可被注意力访问的位置,而KV-Control在每个自注意力层注入受控的关键/值记忆,同时保留预训练查询流、文本交叉注意力、前馈网络及所有主干权重。该适配器仅增加可训练注入参数,依托共享轨迹编码器,在继承的优化协议下实现亚厘米级精度的根部与多关节轨迹追踪,同时维持文本条件动作质量。KV-Control将轨迹控制重新定义为轻量级记忆检索,提供小型、精确且透明的文本到动作生成控制接口。

原文摘要 · Abstract (English)

Text-conditioned 3D human motion models now synthesize plausible motions from prompts, but practical animation and embodied-agent workflows rarely stop at text: a character may need to follow a sketched root path, hit an end-effector target, or satisfy a multi-joint trajectory while still preserving the gait, style, and intent described by language. This exposes a control trade-off. A trajectory controller should be precise without overwriting the pretrained text-conditioned motion prior, yet existing solutions either duplicate large portions of the generator to regain per-layer control access or move much of the cost to test-time optimization. We introduce KV-Control, a compact attention-side control interface for frozen masked text-to-motion transformers. The key idea is to make geometric constraints available as memory inside self-attention rather than injecting them through a global pose token or enforcing them only at the output side. To support this interface, we co-design a part-tokenized motion substrate and controller: \textbf{PartVQ} learns anatomy-aligned part codebooks, T-Concat exposes each frame--part token as an attention-addressable site, and KV-Control injects control-conditioned key/value memories at every self-attention layer while preserving the pretrained query stream, text cross-attention, FFN, and all backbone weights. The resulting adapter adds only trainable injection parameters atop a shared trajectory encoder, yet tracks root and multi-joint constraints with sub-centimeter accuracy under the inherited refinement protocol while retaining text-conditioned motion quality. KV-Control reframes trajectory conditioning as lightweight memory retrieval, providing a small, precise, and transparent control interface for text-to-motion generation.

动作生成轨迹控制注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。