让机器人通过联想与验证,从少量经验中持续学习复杂任务。
NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domains
- 用大模型生成假设,符号工具对比验证,不断优化行动逻辑。
- 在多个真实与虚拟场景中,解决复杂任务成功率显著提升。
- 适合研究开放域机器人、持续学习及人机协同系统的学者。
我们探索神经符号方法以泛化可执行知识,使具身智能体在开放域环境中更有效地完成复杂任务。具身智能体面临的核心挑战是跨环境与情境的知识泛化问题,有限经验常使其局限于已有知识。为此,我们提出新型框架NeSyC,一种神经符号持续学习器,模拟假说演绎模型,通过大语言模型(LLMs)与符号工具的结合,从有限经验中持续生成并验证知识。具体而言,我们在NeSyC中设计了一种对比泛化增强机制,迭代使用LLMs生成假设,并通过符号工具进行对比验证,强化合理动作的合理性,同时最小化不合理动作的推断。此外,引入基于记忆的监控机制,高效检测动作错误并触发跨领域知识精炼。在多个具身任务基准测试(包括ALFWorld、VirtualHome、Minecraft、RLBench以及一个真实机器人场景)上的实验表明,NeSyC在多种开放域环境中均能高效解决复杂任务。
原文摘要 · Abstract (English)
We explore neuro-symbolic approaches to generalize actionable knowledge, enabling embodied agents to tackle complex tasks more effectively in open-domain environments. A key challenge for embodied agents is the generalization of knowledge across diverse environments and situations, as limited experiences often confine them to their prior knowledge. To address this issue, we introduce a novel framework, NeSyC, a neuro-symbolic continual learner that emulates the hypothetico-deductive model by continually formulating and validating knowledge from limited experiences through the combined use of Large Language Models (LLMs) and symbolic tools. Specifically, we devise a contrastive generality improvement scheme within NeSyC, which iteratively generates hypotheses using LLMs and conducts contrastive validation via symbolic tools. This scheme reinforces the justification for admissible actions while minimizing the inference of inadmissible ones. Additionally, we incorporate a memory-based monitoring scheme that efficiently detects action errors and triggers the knowledge refinement process across domains. Experiments conducted on diverse embodied task benchmarks-including ALFWorld, VirtualHome, Minecraft, RLBench, and a real-world robotic scenario-demonstrate that NeSyC is highly effective in solving complex embodied tasks across a range of open-domain environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。