让机器人通过观察学会识别物体关键部位,自主规划复杂操作。
Hanging Around: Cognitive Inspired Reasoning for Reactive Robotics
- 结合神经网络与符号推理,用认知理论指导感知与决策
- 无需预设概念,可从挂物现象中学会识别支撑部位
- 适合需要自主学习与动态适应的智能机器人系统
在自然环境中具备情境感知能力的智能体面临空间意识、对象功能识别、动态变化和不可预测性等挑战。核心难点在于识别并持续监控与目标相关的环境元素。本文提出一种基于神经符号架构的反应式机器人系统,融合神经组件(执行环境中的物体识别与图像处理,如光流)与符号化表示及推理。推理系统基于具身认知范式,将图像图式知识嵌入本体结构中,用于生成感知查询、决定行动,并从感知数据中推断实体能力。该系统使智能体在正常运行时聚焦于关键感知,同时能发现交互中涉及的新概念。所发现的概念使机器人可自主获取训练数据,调整子符号感知以识别物体部件,并为复杂任务规划提供支持。我们在模拟环境中验证了该方法:智能体初始无‘把手’概念,但通过观察悬挂物体在钩子上的实例,学会了识别建立支撑关系的关键部位,进而可规划建立或破坏该关系。这证明了其通过系统性观察扩展知识的能力,展现了深度推理结合感知的潜力。
原文摘要 · Abstract (English)
Situationally-aware artificial agents operating with competence in natural environments face several challenges: spatial awareness, object affordance detection, dynamic changes and unpredictability. A critical challenge is the agent's ability to identify and monitor environmental elements pertinent to its objectives. Our research introduces a neurosymbolic modular architecture for reactive robotics. Our system combines a neural component performing object recognition over the environment and image processing techniques such as optical flow, with symbolic representation and reasoning. The reasoning system is grounded in the embodied cognition paradigm, via integrating image schematic knowledge in an ontological structure. The ontology is operatively used to create queries for the perception system, decide on actions, and infer entities' capabilities derived from perceptual data. The combination of reasoning and image processing allows the agent to focus its perception for normal operation as well as discover new concepts for parts of objects involved in particular interactions. The discovered concepts allow the robot to autonomously acquire training data and adjust its subsymbolic perception to recognize the parts, as well as making planning for more complex tasks feasible by focusing search on those relevant object parts. We demonstrate our approach in a simulated world, in which an agent learns to recognize parts of objects involved in support relations. While the agent has no concept of handle initially, by observing examples of supported objects hanging from a hook it learns to recognize the parts involved in establishing support and becomes able to plan the establishment/destruction of the support relation. This underscores the agent's capability to expand its knowledge through observation in a systematic way, and illustrates the potential of combining deep reasoning [...].
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。