让机器人决策过程可解释,通过概念树追踪每一步判断依据。
ConceptTree: Bringing Semantic Transparency to Black-Box Decision Making for Robotic Manipulation

- 用可视输入构建可理解的概念空间,再通过决策树选择操作技能。
- 在复杂长序列任务中性能优于现有方法,错误率显著降低。
- 支持人工逐个修改概念,无需重训即可纠正决策错误。
在长时程机器人操作中实现可解释的决策过程对保障人类监督与干预至关重要。然而,现有方法大多将技能选择视为从观测到动作的黑箱映射,难以揭示决策形成机制。本文提出ConceptTree框架,将高层操作技能选择重构为对人类可理解概念的推理,将高层策略表示为视觉观测上的概念级谓词序列。该方法不依赖隐式表征,而是基于视觉输入学习一个归一化的概念空间,并在此上训练决策树以预测高层技能。这一设计实现了可追溯、可干预的透明决策流程,支持直接检查和修改策略行为。我们在一系列真实世界机器人操作任务上评估该方法,实验结果表明ConceptTree在复杂、长时程场景中持续优于现有基于概念的基线方法。此外,定性案例研究显示,通过修改单个概念可实现细粒度干预,能针对性修正决策错误而无需重新训练。
原文摘要 · Abstract (English)
Establishing interpretable decision-making processes in long-horizon robotic manipulation is critical for enabling reliable human oversight and intervention. However, existing approaches to robotic manipulation largely treat skill selection as opaque mappings from observations to actions, offering limited transparency into how decisions are formed. In this work, we propose ConceptTree, a framework that reframes high-level manipulation skill selection as reasoning over human-interpretable concepts, representing high-level policies as a sequence of concept-level predicates over visual observations. Rather than relying on implicit latent representations, our method learns a normalized concept space grounded in visual inputs, over which a decision tree is trained to predict high-level skills. This formulation yields a transparent decision process that is both traceable and intervenable, enabling direct inspection and modification of policy behavior. We evaluate our approach on a set of real-world robotic manipulation tasks with increasing complexity. Experimental results show that ConceptTree consistently outperforms existing concept-based baselines, particularly in complex, long-horizon scenarios. Furthermore, we provide qualitative case studies showing that our model supports fine-grained intervention by modifying individual concepts, enabling targeted correction of decision errors without retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。