arXiv:2606.29286cs.CV2026-06中稿 · publication at the…

解决自动驾驶中合成数据到真实数据的风格迁移难题。

ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving

论文配图:ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving
图 1 · 摘自论文原文
  • 仅用带标注的合成数据和无标注的真实图像进行不对称风格迁移。
  • 在多个基准上显著提升感知任务性能,推理速度提升3.2倍。
  • 适合需要低成本标注的自动驾驶系统真实场景部署。

合成数据缓解了自动驾驶感知中的数据稀缺问题,但合成到真实之间的差距导致模型性能下降,阻碍实际泛化。尽管现有方法利用扩散模型实现逼真风格迁移,却忽略了关键的不对称性:合成数据具有完美的像素级标注,而真实世界参考图像通常缺乏对应标签。因此,依赖对称语义引导的方法面临标注成本高或语义错位的问题。为此,我们首次提出自动驾驶领域的不对称风格迁移(ASTAD)任务,要求仅使用标注的合成内容和未标注的真实参考图像,实现语义一致的风格迁移。我们进一步提出ASTModel,一种无需训练的两阶段框架,在目标域无标注情况下提取粗粒度语义先验,并在去噪过程中动态优化先验、注入类别一致的风格。大量实验表明,ASTModel在下游感知任务中表现更优,结构保真度更高,且推理速度提升3.2倍。该工作使合成到真实适应更符合实际约束,有望加速鲁棒自动驾驶系统的规模化部署。代码已开源。

原文摘要 · Abstract (English)

Synthetic data mitigates the data scarcity problem in autonomous driving perception. However, the synthetic-to-real gap leads to performance degradation, hindering real-world model generalization. Although current methods leverage diffusion models for photorealistic style transfer to bridge this gap, they critically ignore a practical asymmetry: while synthetic data possesses perfect pixel-level annotations, real-world style reference images generally lack corresponding labels. Consequently, existing methods relying on symmetric semantic guidance suffer from either prohibitive annotation costs or severe semantic misalignment. To address this dilemma, we formally propose a novel task: Asymmetric Style Transfer for Autonomous Driving (ASTAD), which requires semantically consistent transfer using only labeled synthetic content and unlabeled real-world references. We further introduce the ASTModel, a training-free two-stage framework designed to bridge this domain gap under asymmetric constraints. ASTModel first extracts a coarse semantic prior from the unlabeled target, followed by dynamic prior refinement and class-consistent style injection during the denoising process. Extensive experiments demonstrate that ASTModel significantly outperforms existing methods in downstream perception utility and structural fidelity, while offering a 3.2$\times$ inference speedup. This work aligns synthetic-to-real adaptation with practical constraints, holding the potential to accelerate the scalable deployment of robust autonomous driving systems. Code: https://github.com/Dingyi-Yao/ASTAD.

风格迁移自动驾驶扩散模型合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。