arXiv:2508.20899cs.RO2025-08被引 2

用语言模型提升机器人在室内找物的效率和逻辑性。

Language-Enhanced Mobile Manipulation for Efficient Object Search in Indoor Environments

  • 用大模型解析场景语义,分层引导搜索路径。
  • 在模拟环境中定位目标物效率高于传统方法。
  • 适合需要理解语言指令的家居或工业机器人。

让机器人在复杂非结构化环境中高效搜寻并识别物体,对家庭服务与工业自动化至关重要。然而,传统场景表示仅捕捉静态语义,缺乏可解释的上下文推理能力,难以指导完全陌生环境中的物体搜索。为此,我们提出一种语言增强的层次化导航框架,将语义感知与空间推理紧密结合。所提方法Goal-Oriented Dynamically Heuristic-Guided Hierarchical Search(GODHS)利用大语言模型(LLMs)推断场景语义,并通过多层级决策机制引导搜索过程。通过结构化提示与各层级的逻辑约束,确保推理可靠性。针对移动操作的具体挑战,引入基于启发式的运动规划器,结合极角排序与距离优先策略,高效生成探索路径。在Isaac Sim中的全面评估表明,相较于传统非语义搜索策略,GODHS能更高效地定位目标物体。

原文摘要 · Abstract (English)

Enabling robots to efficiently search for and identify objects in complex, unstructured environments is critical for diverse applications ranging from household assistance to industrial automation. However, traditional scene representations typically capture only static semantics and lack interpretable contextual reasoning, limiting their ability to guide object search in completely unfamiliar settings. To address this challenge, we propose a language-enhanced hierarchical navigation framework that tightly integrates semantic perception and spatial reasoning. Our method, Goal-Oriented Dynamically Heuristic-Guided Hierarchical Search (GODHS), leverages large language models (LLMs) to infer scene semantics and guide the search process through a multi-level decision hierarchy. Reliability in reasoning is achieved through the use of structured prompts and logical constraints applied at each stage of the hierarchy. For the specific challenges of mobile manipulation, we introduce a heuristic-based motion planner that combines polar angle sorting with distance prioritization to efficiently generate exploration paths. Comprehensive evaluations in Isaac Sim demonstrate the feasibility of our framework, showing that GODHS can locate target objects with higher search efficiency compared to conventional, non-semantic search strategies. Website and Video are available at: https://drapandiger.github.io/GODHS

机器人导航语言模型物体搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。