arXiv:2509.20878cs.CV2025-09

发现图像质量评估与优化目标存在意外不对称性

The Unanticipated Asymmetry Between Perceptual Optimization and Assessment

  • 对比了保真度与对抗性目标在优化中的作用
  • 对抗训练下评估指标与优化效果明显脱节
  • 判别器结构影响细节重建,卷积型更优

感知优化主要依赖保真度目标,确保语义一致性和整体视觉真实感,而对抗目标则通过增强感知锐度和细粒度细节提供补充优化。尽管二者至关重要,其作为优化目标的有效性与作为图像质量评估(IQA)指标的能力之间的关联仍缺乏系统研究。本文通过系统分析揭示了一种未预料到的不对称性:在图像质量评估中表现优异的保真度指标,并不必然适用于感知优化,且这种偏差在对抗训练下更为显著。此外,虽然判别器在优化中有效抑制伪影,但其学习到的表征在重用于IQA模型初始化时收益有限。进一步发现,判别器设计对优化结果具有决定性影响,局部块级与卷积结构相比普通或Transformer架构能实现更真实的细节重建。这些发现深化了对损失函数设计及其与IQA可迁移性关系的理解,为更严谨的感知优化方法提供了新思路。

原文摘要 · Abstract (English)

Perceptual optimization is primarily driven by the fidelity objective, which enforces both semantic consistency and overall visual realism, while the adversarial objective provides complementary refinement by enhancing perceptual sharpness and fine-grained detail. Despite their central role, the correlation between their effectiveness as optimization objectives and their capability as image quality assessment (IQA) metrics remains underexplored. In this work, we conduct a systematic analysis and reveal an unanticipated asymmetry between perceptual optimization and assessment: fidelity metrics that excel in IQA are not necessarily effective for perceptual optimization, with this misalignment emerging more distinctly under adversarial training. In addition, while discriminators effectively suppress artifacts during optimization, their learned representations offer only limited benefits when reused as backbone initializations for IQA models. Beyond this asymmetry, our findings further demonstrate that discriminator design plays a decisive role in shaping optimization, with patch-level and convolutional architectures providing more faithful detail reconstruction than vanilla or Transformer-based alternatives. These insights advance the understanding of loss function design and its connection to IQA transferability, paving the way for more principled approaches to perceptual optimization.

感知优化图像评估对抗训练判别器设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。