arXiv:2602.03625cs.CV2026-02中稿 · International Conf…

用进化算法优化合成到真实图像的风格迁移顺序。

Multi-Objective Optimization for Synthetic-to-Real Style Transfer

  • 用多目标遗传算法自动搜索最佳风格迁移组合。
  • 在GTA5→Cityscapes/ACDC上提升分割性能,适应恶劣天气。
  • 提出快速评估方法,无需大量生成图像即可优化。

语义分割模型需要大量像素级标注数据,而真实图像标注成本高昂。计算机图形引擎可生成带真值标注的合成图像,但模型在真实图像上表现不佳,源于真实与合成图像间的域差距。风格迁移方法可通过为合成图像添加真实感风格缓解此问题。然而,有效数据变换及其序列的选择因风格迁移算子的组合爆炸而困难。本文采用多目标遗传算法,优化风格迁移流程以平衡结构保真度与风格相似性。研究在演化过程中使用成对图像指标对单张图像进行快速评估,替代需大量图像生成的标准分布指标。优化后通过分布指标和分割性能评估所得帕累托前沿。实验基于标准合成到真实域适应数据集:从游戏GTA5到真实图像数据集Cityscapes和ACDC,聚焦恶劣条件。结果表明,进化算法可生成适配不同目标的多样化增强管道。本工作贡献在于将风格迁移建模为适合进化优化的序列问题,并研究高效评估指标以实现该空间内可行搜索。源码见:https://github.com/echigot/MOOSS。

原文摘要 · Abstract (English)

Semantic segmentation networks require large amounts of pixel-level annotated data, which are costly to obtain for real-world images. Computer graphics engines can generate synthetic images alongside their ground-truth annotations. However, models trained on such images can perform poorly on real images due to the domain gap between real and synthetic images. Style transfer methods can reduce this difference by applying a realistic style to synthetic images. Choosing effective data transformations and their sequence is difficult due to the large combinatorial search space of style transfer operators. Using multi-objective genetic algorithms, we optimize pipelines to balance structural coherence and style similarity to target domains. We study the use of paired-image metrics on individual image samples during evolution to enable rapid pipeline evaluation, as opposed to standard distributional metrics that require the generation of many images. After optimization, we evaluate the resulting Pareto front using distributional metrics and segmentation performance. We apply this approach to standard datasets in synthetic-to-real domain adaptation: from the video game GTA5 to real image datasets Cityscapes and ACDC, focusing on adverse conditions. Results demonstrate that evolutionary algorithms can propose diverse augmentation pipelines adapted to different objectives. The contribution of this work is the formulation of style transfer as a sequencing problem suitable for evolutionary optimization and the study of efficient metrics that enable feasible search in this space. The source code is available at: https://github.com/echigot/MOOSS.

风格迁移域适应进化算法分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。