arXiv:2510.10203cs.CV2025-10中稿 · publication at the…被引 2

提出新方法量化自动驾驶数据中仿真与真实图像的风格差异。

A Style-Based Profiling Framework for Quantifying the Synthetic-to-Real Gap in Autonomous Driving Datasets

  • 用格拉姆矩阵提取图像风格特征,结合度量学习优化聚类效果。
  • 引入SEDD指标,可量化仿真与真实数据间的风格差距。
  • 适用于评估和改进合成数据质量,提升自动驾驶模型泛化能力。

确保自动驾驶感知系统的可靠性需大量环境测试,但实际道路测试往往不切实际。因此,合成数据集因其成本低、标签无偏且场景可控,成为有前景的替代方案。然而,合成数据与真实世界数据之间的领域差距仍是影响模型泛化的主要障碍。为此,本文从数据中心视角提出一种风格特征提取与发现框架,用于刻画合成与真实图像数据集背后的风格分布。我们提出风格嵌入分布差异(SEDD)作为新的评估指标。该框架结合基于格拉姆矩阵的风格提取与针对类内紧凑性与类间分离性的度量学习,实现风格嵌入的高效提取。此外,我们在公开数据集上建立基准,对多种数据集及仿真到真实迁移方法进行实验。结果表明,本方法能有效量化仿真与真实数据间的差距。该工作提供了一种基于标准化风格画像的质量控制范式,支持合成数据的系统性诊断与针对性优化,推动数据驱动自动驾驶系统的未来发展。

原文摘要 · Abstract (English)

Ensuring the reliability of autonomous driving perception systems requires extensive environment-based testing, yet real-world execution is often impractical. Synthetic datasets have therefore emerged as a promising alternative, offering advantages such as cost-effectiveness, bias free labeling, and controllable scenarios. However, the domain gap between synthetic and real-world datasets remains a major obstacle to model generalization. To address this challenge from a data-centric perspective, this paper introduces a profile extraction and discovery framework for characterizing the style profiles underlying both synthetic and real image datasets. We propose Style Embedding Distribution Discrepancy (SEDD) as a novel evaluation metric. Our framework combines Gram matrix-based style extraction with metric learning optimized for intra-class compactness and inter-class separation to extract style embeddings. Furthermore, we establish a benchmark using publicly available datasets. Experiments are conducted on a variety of datasets and sim-to-real methods, and the results show that our method is capable of quantifying the synthetic-to-real gap. This work provides a standardized profiling-based quality control paradigm that enables systematic diagnosis and targeted enhancement of synthetic datasets, advancing future development of data-driven autonomous driving systems.

自动驾驶数据合成风格差异质量评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。