让语言直接生成机器人动作策略,避免视觉捷径,提升真实场景泛化能力。
DISC: Decoupling Instruction from State-Conditioned Control via Policy Generation

- 用超网络从指令生成完整策略参数,不直接读取视觉信息。
- 在LIBERO-90和Meta-World上超越所有基线,复杂任务优势更明显。
- 支持少样本适应与指令改写泛化,适合真实世界机器人控制。
语言驱动的操控策略通常共享网络参数处理指令与观测,导致任务状态耦合,引发观测泄露——网络学习跳过语言理解的视觉到动作捷径。DISC 从结构上消除此问题:不使用通用策略,而是通过超网络仅凭指令生成特定任务的视觉运动策略全部参数。生成的策略不直接访问语言,其任务感知必须来自语言输入,因此观测泄露无处可逃。同时,高维策略参数生成本身极具挑战,我们设计两阶段超网络,其中优化阶段将梯度优化结构作为前馈归纳偏置,无需实际梯度计算即可生成全局一致参数。完全从零训练,不依赖外部预训练数据,在标准数据预算下,DISC 在 LIBERO-90 与 Meta-World 上全面超越所有耦合基线,尤其在复杂长程任务中优势扩大,并超过大规模预训练模型 π₀。在真实世界基准测试中,所有任务共享相同视觉环境,DISC 显著优于耦合方法,直接证明行为由语言生成的策略参数驱动,而非视觉捷径。超网络还学习到语义结构化的参数流形,实现少量示范下的快速适应及对指令改写的鲁棒泛化。代码已公开:https://github.com/ReNginx/DISC。
原文摘要 · Abstract (English)
Language-conditioned manipulation policies typically process instructions and observations through shared network parameters. This task-state entanglement provides a pathway for observation leakage -- networks learn scene-to-action shortcuts that bypass language grounding entirely. DISC eliminates this failure structurally. Rather than conditioning a universal policy on language, DISC uses a hypernetwork to generate the entire parameter set of a task-specific visuomotor policy from the instruction alone. The generated policy never directly accesses language; therefore, its task-awareness must come from the language. Consequently, observation leakage has no pathway to emerge. On the other hand, generating coherent high-dimensional policy weights is itself a challenging problem. We address it with a two-stage hypernetwork whose refinement stage embeds the structure of gradient-based optimization as a feed-forward inductive bias, producing globally consistent parameters without actual gradient computation. Trained entirely from scratch on standard data budgets, DISC outperforms all entangled baselines on LIBERO-90 and Meta-World, with advantages that widen on complex, long-horizon tasks -- and surpasses the large-scale pretrained $π_0$ despite using no external pretraining data. On a real-world benchmark where all tasks share identical visual context, DISC substantially outperforms entangled alternatives, directly confirming that language-generated policy parameters, not visual shortcuts, drive behavior. The hypernetwork further learns a semantically structured parameter manifold that enables few-shot adaptation from minimal demonstrations and robust generalization across paraphrased instructions. Our code is available at: {https://github.com/ReNginx/DISC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。