arXiv:2503.07485cs.CV2025-03ICRA被引 18

用快慢双系统实现低成本高精度车道拓扑解析

Chameleon: Fast-slow Neuro-symbolic Lane Topology Extraction

  • 快系统直接推理检测结果,慢系统用视觉语言模型处理复杂情况
  • 在OpenLane-V2上优于多个基线检测器,性能稳定提升
  • 适合需要高效推理的自动驾驶场景,代码开源可复现

车道拓扑提取需检测车道及交通元素并确定其关系,是无地图自动驾驶的关键感知任务。该任务依赖复杂推理,如判断是否可左转进入某车道。现有方法存在明显局限:(1) 使用视觉语言基础模型(VLM)进行密集视觉提示虽性能强,但成本高,不适用于机器人应用;(2) 现有神经符号推理方法在3D场景理解中无法融合视觉输入生成程序,难以应对复杂角落案例。为此,我们提出名为Chameleon的快速-慢速神经符号车道拓扑提取算法,交替使用快系统直接对检测实例进行程序化推理,以及慢系统借助具有思维链设计的VLM处理极端情况。该方法结合两者优势,在保持高性能的同时实现低成本。我们在OpenLane-V2数据集上评估,结果显示在多种基线检测器上均有持续改进。代码、数据与模型已公开于https://github.com/XR-Lee/neural-symbolic。

原文摘要 · Abstract (English)

Lane topology extraction involves detecting lanes and traffic elements and determining their relationships, a key perception task for mapless autonomous driving. This task requires complex reasoning, such as determining whether it is possible to turn left into a specific lane. To address this challenge, we introduce neuro-symbolic methods powered by vision-language foundation models (VLMs). Existing approaches have notable limitations: (1) Dense visual prompting with VLMs can achieve strong performance but is costly in terms of both financial resources and carbon footprint, making it impractical for robotics applications. (2) Neuro-symbolic reasoning methods for 3D scene understanding fail to integrate visual inputs when synthesizing programs, making them ineffective in handling complex corner cases. To this end, we propose a fast-slow neuro-symbolic lane topology extraction algorithm, named Chameleon, which alternates between a fast system that directly reasons over detected instances using synthesized programs and a slow system that utilizes a VLM with a chain-of-thought design to handle corner cases. Chameleon leverages the strengths of both approaches, providing an affordable solution while maintaining high performance. We evaluate the method on the OpenLane-V2 dataset, showing consistent improvements across various baseline detectors. Our code, data, and models are publicly available at https://github.com/XR-Lee/neural-symbolic

车道拓扑神经符号视觉语言模型自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。