用语言提示指导无人机搜索,提升大范围找物效率
LMPath: Language-Mediated Priors and Path Generation for Aerial Exploration

- 用语言模型分析目标语义,结合卫星图像生成搜索优先区域
- 生成路径可使寻物时间减少,或在有限距离内提高发现概率
- 适合需要高效搜寻的无人机任务,如搜救、巡查
传统自主无人机搜索依赖几何覆盖模式,忽略目标的语义信息,导致在大规模环境中耗费大量时间。本文提出LMPath,一种基于语言提示的无人机搜索先验生成管道。给定基本地理边界和目标对象的文本提示,LMPath利用生成式语言模型判断目标可能存在的区域,并通过基础视觉模型对卫星影像进行分割,生成探索先验。该先验可用于生成满足不同目标的无人机路径,例如最小化预期定位时间、在有限航程内最大化发现概率,或缩小最可能包含目标的子区域。我们使用真实无人机在大规模环境中测试了多种路径生成效果,并通过模拟验证,相比传统路径规划方法,LMPath生成的路径显著提升搜索效率。
原文摘要 · Abstract (English)
Traditional autonomous UAV search missions rely on geometric coverage patterns that ignore the semantic context of the target, leading to significant time waste in large-scale environments. In this paper we present LMPath, a pipeline for generating language-mediated exploration priors for Unmanned Aerial Vehicle (UAV) search missions that leverages semantics. Given a basic geofence and an object of interest prompt, LMPath uses generative language models to determine what regions of the environment should contain that object and a foundation vision model ran over satellite imagery to segment sub-regions that form the exploration prior. This prior can then be used to generate UAV paths with various objectives, such as minimizing the expected time to locate the object of interest, maximizing the probability that the object is found given a limited travel distance, or narrowing down the search space to sub-regions that are most likely to contain the object. To demonstrate it's capabilities, we used LMPath to generate various UAV paths and ran them using a real UAV over large-scale environments. We also ran simulations to demonstrate how paths generated using LMPath outperform traditional path planning approaches for search missions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。