arXiv:2506.17101cs.CV2025-06被引 4

用多数据源知识积累,让自动驾驶系统更高效识别复杂路况。

Multi-label Scene Classification for Autonomous Vehicles: Acquiring and Accumulating Knowledge from Diverse Datasets

  • 从单标签数据中学习基础知识,再通过一致性主动学习扩展为多标签识别
  • 在新数据集上比基线提升56.1%,仅用15%数据达领先效果
  • 可识别训练时未见的属性,适合需要持续学习的自动驾驶场景

驾驶场景本质上异质且动态。多属性场景识别作为高级视觉感知能力,为自动驾驶车辆提供理解、推理和交互复杂交通环境所需的上下文意识。尽管场景识别最适合通过多任务学习建模为多标签分类问题,但仍面临两大挑战:获取平衡且全面标注的数据集困难,以及新增属性时需重新标注全部训练数据。为此,本文提出一种新型深度学习方法,结合知识获取与累积(KAA)和基于一致性的主动学习(CAL)。KAA利用异构单标签数据集进行单任务学习,构建知识基础;CAL则弥合单标签与多标签数据间的差距,使基础模型适应多标签场景分类。在新构建的驾驶场景识别(DSI)数据集上的消融实验表明,该方法相比ImageNet预训练基线提升56.1%。此外,KAA-CAL在BDD100K和HSD数据集上优于现有最优多标签分类方法,仅使用15%数据量,并能识别训练时未出现的属性。DSI数据集及KAA-CAL实现代码已公开于https://github.com/KELISBU/KAA-CAL。

原文摘要 · Abstract (English)

Driving scenes are inherently heterogeneous and dynamic. Multi-attribute scene identification, as a high-level visual perception capability, provides autonomous vehicles (AVs) with essential contextual awareness to understand, reason through, and interact with complex driving environments. Although scene identification is best modeled as a multi-label classification problem via multitask learning, it faces two major challenges: the difficulty of acquiring balanced, comprehensively annotated datasets and the need to re-annotate all training data when new attributes emerge. To address these challenges, this paper introduces a novel deep learning method that integrates Knowledge Acquisition and Accumulation (KAA) with Consistency-based Active Learning (CAL). KAA leverages monotask learning on heterogeneous single-label datasets to build a knowledge foundation, while CAL bridges the gap between single- and multi-label data, adapting the foundation model for multi-label scene classification. An ablation study on the newly developed Driving Scene Identification (DSI) dataset demonstrates a 56.1% improvement over an ImageNet-pretrained baseline. Moreover, KAA-CAL outperforms state-of-the-art multi-label classification methods on the BDD100K and HSD datasets, achieving this with 85% less data and even recognizing attributes unseen during foundation model training. The DSI dataset and KAA-CAL implementation code are publicly available at https://github.com/KELISBU/KAA-CAL .

自动驾驶多标签分类知识积累主动学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。