arXiv:2508.04260cs.CVcs.AI2025-08被引 1

提出SAV框架与VehicleSeg10K数据集,实现车辆部件精准分割

Segment Any Vehicle: Semantic and Visual Context Driven SAM and A Benchmark

  • 基于SAM构建编码器-解码器,融合车辆部件知识图谱
  • 在VehicleSeg10K上达到85.3% mIoU,优于基线模型
  • 适合自动驾驶中细粒度车辆理解任务的研究者使用

随着自动驾驶快速发展,车辆感知(尤其检测与分割)对算法性能要求日益提高。预训练大模型如Segment Anything Model(SAM)虽受关注,但其文本提示分割功能未公开,且默认模式生成的掩码缺乏语义标签,难以用于结构化、类别特定的细粒度分割任务。为此,本文提出SAV框架,包含三个核心组件:基于SAM的编码器-解码器、车辆部件知识图谱、上下文样本检索编码模块。知识图谱通过结构化本体显式建模部件间的空间与几何关系,编码先验结构知识;上下文检索模块则从训练数据中识别并利用视觉相似车辆实例,提供丰富上下文先验以提升泛化能力。此外,本文构建了新的大规模基准数据集VehicleSeg10K,涵盖11,665张高精度像素级标注图像,覆盖多样场景与视角。在该数据集及另两个数据集上进行综合实验,对比多个代表性基线,为未来研究提供坚实基准。代码与数据集将在论文录用后开源。

原文摘要 · Abstract (English)

With the rapid advancement of autonomous driving, vehicle perception, particularly detection and segmentation, has placed increasingly higher demands on algorithmic performance. Pre-trained large segmentation models, especially Segment Anything Model (SAM), have sparked significant interest and inspired new research directions in artificial intelligence. However, SAM cannot be directly applied to the fine-grained task of vehicle part segmentation, as its text-prompted segmentation functionality is not publicly accessible, and the mask regions generated by its default mode lack semantic labels, limiting its utility in structured, category-specific segmentation tasks. To address these limitations, we propose SAV, a novel framework comprising three core components: a SAM-based encoder-decoder, a vehicle part knowledge graph, and a context sample retrieval encoding module. The knowledge graph explicitly models the spatial and geometric relationships among vehicle parts through a structured ontology, effectively encoding prior structural knowledge. Meanwhile, the context retrieval module enhances segmentation by identifying and leveraging visually similar vehicle instances from training data, providing rich contextual priors for improved generalization. Furthermore, we introduce a new large-scale benchmark dataset for vehicle part segmentation, named VehicleSeg10K, which contains 11,665 high-quality pixel-level annotations across diverse scenes and viewpoints. We conduct comprehensive experiments on this dataset and two other datasets, benchmarking multiple representative baselines to establish a solid foundation for future research and comparison. % Both the dataset and source code of this paper will be released upon acceptance. Both the dataset and source code of this paper will be released on https://github.com/Event-AHU/SAV

车辆分割知识图谱SAM扩展自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。