用多目标优化自动平衡图像超分中的清晰度与真实感。
Perceptual-Distortion Balanced Image Super-Resolution is a Multi-Objective Optimization Problem
- 将损失权重调优转化为多目标优化问题,自动搜索最佳配置。
- 在PSNR、SSIM和LPIPS上均优于现有方法,突破感知-失真权衡边界。
- 适合追求高质量图像重建的科研与工程应用,减少人工调参成本。
基于像素的回归损失训练单图像超分辨率(SISR)模型可获得较高的失真指标分数(如PSNR和SSIM),但常导致图像模糊,高频率细节恢复不足。相反,使用GAN或感知损失虽能生成清晰图像并提升感知指标(如LPIPS),却可能引入伪影和错误纹理。平衡这两类损失有助于在失真与感知之间取得折中,但难点在于损失权重的调优。为此,我们提出一种新方法,将多目标优化(MOO)引入SISR训练过程,以平衡感知质量与失真。我们将损失权重与图像质量评估(IQA)指标之间的关系建模为黑箱目标函数,在多目标贝叶斯优化超分辨率(MOBOSR)框架内进行优化。该方法自动化超参数调优,降低整体计算成本,并支持同时使用大量损失函数。大量实验表明,MOBOSR在感知质量和失真方面均超越当前最优方法,显著推进了感知-失真帕累托前沿。本工作为未来几乎所有图像修复任务中感知质量与保真度的平衡指明了新方向。源码与预训练模型已公开:https://github.com/ZhuKeven/MOBOSR。
原文摘要 · Abstract (English)
Training Single-Image Super-Resolution (SISR) models using pixel-based regression losses can achieve high distortion metrics scores (e.g., PSNR and SSIM), but often results in blurry images due to insufficient recovery of high-frequency details. Conversely, using GAN or perceptual losses can produce sharp images with high perceptual metric scores (e.g., LPIPS), but may introduce artifacts and incorrect textures. Balancing these two types of losses can help achieve a trade-off between distortion and perception, but the challenge lies in tuning the loss function weights. To address this issue, we propose a novel method that incorporates Multi-Objective Optimization (MOO) into the training process of SISR models to balance perceptual quality and distortion. We conceptualize the relationship between loss weights and image quality assessment (IQA) metrics as black-box objective functions to be optimized within our Multi-Objective Bayesian Optimization Super-Resolution (MOBOSR) framework. This approach automates the hyperparameter tuning process, reduces overall computational cost, and enables the use of numerous loss functions simultaneously. Extensive experiments demonstrate that MOBOSR outperforms state-of-the-art methods in terms of both perceptual quality and distortion, significantly advancing the perception-distortion Pareto frontier. Our work points towards a new direction for future research on balancing perceptual quality and fidelity in nearly all image restoration tasks. The source code and pretrained models are available at: https://github.com/ZhuKeven/MOBOSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。