用视觉语言模型提升路径规划,让导航更准更快。
MMP-A*: Multimodal Perception Enhanced Incremental Heuristic Search on Path Planning
- 融合视觉语言模型实现空间感知,生成更合理的路径点
- 自适应衰减机制降低内存占用,计算成本大幅下降
- 适合复杂环境下的自动驾驶与机器人导航
自主路径规划需兼顾全局推理与几何精度,尤其在复杂或杂乱环境中。经典A*虽具最优性,但在大规模场景下计算与内存开销过大。现有利用大语言模型进行路径点引导的方法仅依赖文本推理,缺乏空间对齐能力,常在存在死胡同的拓扑复杂环境中产生错误路径点,且无法解析模糊物理边界,导致需频繁修正,反而增加开销。本文提出MMP-A*,一个融合视觉语言模型空间感知能力与新型自适应衰减机制的多模态框架。通过将高层推理锚定于物理几何,生成连贯的路径点引导;自适应衰减机制动态调控不确定路径点在启发式中的影响,保障几何合理性并显著降低内存消耗。在严重杂乱与拓扑复杂的环境下测试表明,MMP-A*可实现近最优轨迹,同时大幅降低运行成本,展现出感知驱动、计算高效的自主导航潜力。
原文摘要 · Abstract (English)
Autonomous path planning requires a synergy between global reasoning and geometric precision, especially in complex or cluttered environments. While classical A* is valued for its optimality, it incurs prohibitive computational and memory costs in large-scale scenarios. Recent attempts to mitigate these limitations by using Large Language Models for waypoint guidance remain insufficient, as they rely only on text-based reasoning without spatial grounding. As a result, such models often produce incorrect waypoints in topologically complex environments with dead ends, and lack the perceptual capacity to interpret ambiguous physical boundaries. These inconsistencies lead to costly corrective expansions and undermine the intended computational efficiency. We introduce MMP-A*, a multimodal framework that integrates the spatial grounding capabilities of vision-language models with a novel adaptive decay mechanism. By anchoring high-level reasoning in physical geometry, the framework produces coherent waypoint guidance that addresses the limitations of text-only planners. The adaptive decay mechanism dynamically regulates the influence of uncertain waypoints within the heuristic, ensuring geometric validity while substantially reducing memory overhead. To evaluate robustness, we test the framework in challenging environments characterized by severe clutter and topological complexity. Experimental results show that MMP-A* achieves near-optimal trajectories with significantly reduced operational costs, demonstrating its potential as a perception-grounded and computationally efficient paradigm for autonomous navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。