用功能单元分解复杂交通标志,让AI更懂新组合的路牌。
SignReasoner: Compositional Reasoning for Complex Traffic Sign Understanding via Functional Structure Units
- 将标志拆解为方向、提示、车道等功能单元,学习结构规律。
- 在新数据集上超越现有模型,仅用少量数据即达最优性能。
- 适合自动驾驶系统提升对复杂路牌的理解能力。
准确理解复杂交通标志——包括布局复杂、多语言文字和复合符号的标志——对自动驾驶安全至关重要。当前模型,无论小型专用模型还是大型视觉语言模型(VLMs),均面临严重瓶颈:缺乏组合泛化能力,导致遇到新组合标志时失效。为此,我们提出SignReasoner,一种将通用VLM转化为专业交通标志推理器的新范式。核心创新是功能结构单元(FSU),从常见的实例建模转向灵活的功能分解。通过将复杂标志拆分为最小核心功能块(如方向、提示、车道),模型学习底层结构语法规则,从而实现对未见组合的强大泛化能力。我们定义该分解任务为FSU-Reasoning,并引入两阶段VLM后训练流程以最大化性能:迭代式标注-FSU蒸馏,提升模型在FSU推理与图像描述生成上的准确性;FSU-GRPO,利用树编辑距离(TED)计算FSU差异作为强化学习奖励,增强推理能力。在新提出的FSU-Reasoning基准数据集TrafficSignEval上的实验表明,SignReasoner达到新最优水平,具备显著的数据效率,且无需修改架构,大幅提升了各类VLM在交通标志理解上的表现。
原文摘要 · Abstract (English)
Accurate semantic understanding of complex traffic signs-including those with intricate layouts, multi-lingual text, and composite symbols-is critical for autonomous driving safety. Current models, both specialized small ones and large Vision Language Models (VLMs), suffer from a significant bottleneck: a lack of compositional generalization, leading to failure when encountering novel sign configurations. To overcome this, we propose SignReasoner, a novel paradigm that transforms general VLMs into expert traffic sign reasoners. Our core innovation is Functional Structure Unit (FSU), which shifts from common instance-based modeling to flexible function-based decomposition. By breaking down complex signs into minimal, core functional blocks (e.g., Direction, Notice, Lane), our model learns the underlying structural grammar, enabling robust generalization to unseen compositions. We define this decomposition as the FSU-Reasoning task and introduce a two-stage VLM post-training pipeline to maximize performance: Iterative Caption-FSU Distillation that enhances the model's accuracy in both FSU-reasoning and caption generation; FSU-GRPO that uses Tree Edit Distance (TED) to compute FSU differences as the rewards in GRPO algorithm, boosting reasoning abilities. Experiments on the newly proposed FSU-Reasoning benchmark, TrafficSignEval, show that SignReasoner achieves new SOTA with remarkable data efficiency and no architectural modification, significantly improving the traffic sign understanding in various VLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。