arXiv:2601.00225cs.CV2026-01NeurIPS被引 1

通过重塑合成数据分布,提升图像质量评估模型的泛化能力。

Towards Syn-to-Real IQA: A Novel Perspective on Reshaping Synthetic Data Distributions

  • 分析发现合成数据特征呈离散簇状,影响回归性能。
  • 提出双策略:增强多样性、降低密集区域冗余,改善数据分布。
  • 在三类跨数据集场景中均显著提升模型表现,适合数据增强研究者。

盲图像质量评估(BIQA)虽因深度学习取得显著进展,但大规模标注数据集稀缺仍是挑战。合成数据虽具潜力,但现有方法训练的模型泛化能力有限。本文观察到,合成数据学习的表征呈现离散聚类模式:高质量图像特征聚集于参考图像附近,低质量图像则按失真类型分簇。分析表明,此问题源于合成数据分布,而非模型架构。为此,我们提出新框架SynDR-IQA,通过重塑合成数据分布以提升泛化性。基于样本多样性与冗余对泛化误差的影响理论,该方法采用两种策略:分布感知的多样内容上采样,提升视觉多样性同时保留内容分布;密度感知的冗余簇下采样,通过减少密集区域样本密度实现平衡。在三种跨数据集设置(合成→真实、合成→算法型、合成→合成)中广泛实验验证了方法有效性。代码已开源。

原文摘要 · Abstract (English)

Blind Image Quality Assessment (BIQA) has advanced significantly through deep learning, but the scarcity of large-scale labeled datasets remains a challenge. While synthetic data offers a promising solution, models trained on existing synthetic datasets often show limited generalization ability. In this work, we make a key observation that representations learned from synthetic datasets often exhibit a discrete and clustered pattern that hinders regression performance: features of high-quality images cluster around reference images, while those of low-quality images cluster based on distortion types. Our analysis reveals that this issue stems from the distribution of synthetic data rather than model architecture. Consequently, we introduce a novel framework SynDR-IQA, which reshapes synthetic data distribution to enhance BIQA generalization. Based on theoretical derivations of sample diversity and redundancy's impact on generalization error, SynDR-IQA employs two strategies: distribution-aware diverse content upsampling, which enhances visual diversity while preserving content distribution, and density-aware redundant cluster downsampling, which balances samples by reducing the density of densely clustered areas. Extensive experiments across three cross-dataset settings (synthetic-to-authentic, synthetic-to-algorithmic, and synthetic-to-synthetic) demonstrate the effectiveness of our method. The code is available at https://github.com/Li-aobo/SynDR-IQA.

图像质量评估合成数据数据分布泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。