arXiv:2504.18057cs.ROcs.AI2025-04被引 3

用大模型动态协作规划,让自动驾驶更聪明且省资源。

Opportunistic Collaborative Planning with Large Vision Model Guided Control and Joint Query-Service Optimization

  • 大模型云端感知决策,本地模型实时控制,形成闭环系统。
  • 实验显示导航时间更短,成功率达92.3%,优于现有方法。
  • 适合需要高效协同的自动驾驶场景,尤其复杂未知环境。

在开放场景中导航自动驾驶车辆面临处理未见物体的挑战。现有方案或依赖小模型泛化能力弱,或使用大模型资源消耗高。尽管两者协作具潜力,但关键难题在于决定何时及如何调用大模型。本文提出机会式协同规划(OCP),通过两项创新实现本地高效模型与云端强大模型的无缝融合。首先,提出大视觉模型引导的模型预测控制(LVM-MPC),利用云端大视觉模型(LVM)进行感知与决策,其输出作为本地模型预测控制(MPC)的全局引导,构成闭环感知-控制系统。其次,提出协作时机优化(CTO),包括物体检测置信度阈值(ODCT)与云端前向仿真(CFS),以判断何时请求云端协助、何时提供服务。大量实验表明,所提OCP在导航时间与成功率上均优于现有方法,成功率提升至92.3%。

原文摘要 · Abstract (English)

Navigating autonomous vehicles in open scenarios is a challenge due to the difficulties in handling unseen objects. Existing solutions either rely on small models that struggle with generalization or large models that are resource-intensive. While collaboration between the two offers a promising solution, the key challenge is deciding when and how to engage the large model. To address this issue, this paper proposes opportunistic collaborative planning (OCP), which seamlessly integrates efficient local models with powerful cloud models through two key innovations. First, we propose large vision model guided model predictive control (LVM-MPC), which leverages the cloud for LVM perception and decision making. The cloud output serves as a global guidance for a local MPC, thereby forming a closed-loop perception-to-control system. Second, to determine the best timing for large model query and service, we propose collaboration timing optimization (CTO), including object detection confidence thresholding (ODCT) and cloud forward simulation (CFS), to decide when to seek cloud assistance and when to offer cloud service. Extensive experiments show that the proposed OCP outperforms existing methods in terms of both navigation time and success rate.

自动驾驶协同规划大模型决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。