用低分辨率图作语义锚点,让超分更符合人眼偏好。
RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
- 以LR图为语义参考,评估HR重建的合理性与一致性。
- 在RefSR-18K数据集上训练,提升生成结果的自然度与语义保真度。
- 适合关注视觉真实感和人眼感知对齐的超分研究者。
生成式超分辨率(SR)虽显著提升了视觉真实感,但现有评估与优化框架仍与人类感知脱节。全参考与无参考指标常因像素错位惩罚合理细节,或偏好视觉锐利但不一致的伪影。多数方法依赖真值(GT)监督的分布匹配,未必符合人眼判断。本文提出RefReward-SR,一种基于低分辨率(LR)参考的奖励模型,用于偏好对齐的超分辨率。该模型以LR图像为语义锚点,评估对应高分辨率(HR)重建的语义一致性与合理性,借助多模态大模型(MLLM)的视觉-语言先验进行推理式评估。为此构建首个大规模的LR条件偏好数据集RefSR-18K,包含基于LR-HR一致性与HR自然性的成对排序。使用组相对策略优化(GRPO)微调MLLM,并将GRPO融入SR训练,以RefReward-SR为核心奖励信号实现偏好对齐生成。大量实验表明,本框架显著提升与人类判断的一致性,生成结果在保持语义一致性的同时增强感知合理性和视觉自然性。代码、模型与数据集将在论文录用后公开。
原文摘要 · Abstract (English)
Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to reflect perceptual preference, either penalizing semantically plausible details due to pixel misalignment or favoring visually sharp but inconsistent artifacts. Moreover, most SR methods rely on ground-truth (GT)-dependent distribution matching, which does not necessarily correspond to human judgments. In this work, we propose RefReward-SR, a low-resolution (LR) reference-aware reward model for preference-aligned SR. Instead of relying on GT supervision or NR evaluation, RefReward-SR assesses high-resolution (HR) reconstructions conditioned on their LR inputs, treating the LR image as a semantic anchor. Leveraging the visual-linguistic priors of a Multimodal Large Language Models (MLLM), it evaluates semantic consistency and plausibility in a reasoning-aware manner. To support this paradigm, we construct RefSR-18K, the first large-scale LR-conditioned preference dataset for SR, providing pairwise rankings based on LR-HR consistency and HR naturalness. We fine-tune the MLLM with Group Relative Policy Optimization (GRPO) using LR-conditioned ranking rewards, and further integrate GRPO into SR model training with RefReward-SR as the core reward signal for preference-aligned generation. Extensive experiments show that our framework achieves substantially better alignment with human judgments, producing reconstructions that preserve semantic consistency while enhancing perceptual plausibility and visual naturalness. Code, models, and datasets will be released upon paper acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。