让机器人通过可编辑的知识库自我修复策略,透明又可靠。
Kintsugi: Learning Policies by Repairing Executable Knowledge Bases

- 用类型化可执行知识库表示任务策略,支持局部精准修改。
- 在长程任务中达成强性能,且修改后验证通过率超90%。
- 适合需要可解释、可调试智能体的科研与工业场景。
现代具身智能体表现优异,但其任务知识通常存储于神经权重、隐状态或提示内存中,难以检查、验证、重组和复用。我们提出Kintsugi,一种白盒策略学习框架,将具身策略改进视为带验证器约束的知识库构建过程。Kintsugi将任务级策略知识表示为可组合的类型化条目——谓词、操作符、策略模板、监控器、恢复规则、经验记录和目标,并通过回溯证据驱动的局部类型化编辑来优化该知识库,而非依赖推理时的语言模型。在回溯之间,工具受限的智能体编辑循环诊断轨迹失败,定位到可编辑的知识层并提出候选修改;仅当候选类型匹配、知识库可执行且焦点验证成功或轨迹健康度提升,同时不违反保护性回归检查时,才允许修改。推理阶段,经批准的知识库由确定性符号执行器执行,无需调用大语言模型。在长周期文本代理基准和典型物体中心操控设置中,Kintsugi实现了优异的终点性能,同时保持了可检查性、局部可编辑性和验证器约束的部署能力。结果表明,具身策略改进可围绕可执行任务知识组织。
原文摘要 · Abstract (English)
Modern embodied agents achieve impressive performance, but their task knowledge is often stored in neural weights, latent state, or prompt-bound memory, making individual policy knowledge difficult to inspect, validate, recombine, and reuse. We introduce \textbf{Kintsugi}, a white-box policy-learning framework that treats embodied policy improvement as verifier-gated construction of a typed executable Knowledge Base (KB). Kintsugi represents task-level policy knowledge as composable typed entries -- predicates, operators, policy schemas, monitors, recovery rules, experience records, and goals -- and improves this artifact through localized typed edits induced from rollout evidence, rather than relying on test-time language-model reasoning. Between rollouts, a tool-constrained agentic editing loop diagnoses trajectory failures, localizes them to editable KB layers, and proposes candidate edits. A deterministic verification gate admits an edit only when the candidate type-checks, the resulting KB executes, and focused validation success or trajectory-health metrics improve without violating protected-regression checks. At inference, the accepted KB is executed by a deterministic symbolic executor with zero LLM calls. Across long-horizon text-agent benchmarks and representative object-centric manipulation settings, Kintsugi achieves strong endpoint performance while preserving inspectability, local editability, and verifier-gated deployment. These results suggest that embodied policy improvement can be organized around executable task knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。