arXiv:2607.29687cs.RO2026-07

通过分解指令空间覆盖不足的三类原因,发现只需覆盖关键依赖关系即可实现强泛化。

Diagnosing Compositional Generalization in Sequential Robot Tasks

论文配图:Diagnosing Compositional Generalization in Sequential Robot Tasks
图 1 · 摘自论文原文
  • 将泛化差距拆解为指令分布、组合与上下文-动作三类偏移
  • 仅需全任务空间四分之一的结构化数据,即可在分布外任务上达到54.7%成功率
  • 适合关注机器人指令泛化与高效数据采集的研究者

序列化机器人操作需要策略能执行已知指令成分的新组合。然而,收集所有可能指令元组的演示成本呈组合爆炸式增长,而稀疏覆盖的数据集在分布外重组时往往失效。本文从指令空间覆盖的角度研究组合泛化问题,将泛化差距分解为三类:边缘指令偏移、指令组合偏移和上下文-动作偏移。该分解可诊断稀疏训练覆盖是否足够,并揭示训练集应保留何种结构以实现可靠动作预测。结果表明,无需穷举所有元组:只要覆盖与动作相关的关键依赖关系,即使仅为全任务空间的四分之一,也能恢复强大的分布外性能。进一步发现,稀疏训练失败主要源于指令引导问题,而非低层技能缺失;每任务微调一个示范即可将分布外成功率达0.4%提升至54.7%。对于语义相关的任务,有效覆盖必须捕捉关系结构,而不仅是因子多样性。这些发现表明,高效的机器人数据收集应优先关注指令空间中的依赖覆盖,而非全面扩展任务种类。更多结果见补充材料。项目网站:https://yixiaowang7.github.io/Diagnosing_Compositional_Generalization_Robot_Page/

原文摘要 · Abstract (English)

Sequential robot manipulation requires policies to execute novel combinations of familiar instruction components. However, collecting demonstrations for all possible instruction tuples is combinatorially expensive, while sparsely covered datasets often fail under out-of-distribution recombination. This paper studies compositional generalization through the lens of instruction-space coverage. We decompose the generalization gap into three sources: \textit{marginal instruction shift}, \textit{instruction-compositional shift}, and \textit{context--action shift}. This decomposition allows us to diagnose when sparse training coverage is sufficient, and what structure the training set must preserve for reliable action prediction. Our results show that exhaustive tuple enumeration is unnecessary: a structured subset, as small as one quarter of the full task space, can recover strong out-of-distribution performance when it covers action-relevant dependencies. We further find that sparse training often fails due to instruction steering rather than missing low-level skills; finetuning only one demonstration per task improves OOD success from \(0.4\%\) to \(54.7\%\). For semantically dependent tasks, effective coverage must capture relational structure rather than only factor diversity. These findings suggest that efficient robot data collection should prioritize dependency coverage in instruction space over exhaustive task expansion. More results are available in the supplementary material. Project website: https://yixiaowang7.github.io/Diagnosing_Compositional_Generalization_Robot_Page/.

机器人组合泛化指令覆盖数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。