arXiv:2412.09465cs.CV2024-12被引 24

一歩で高精細かつリアルな画像復元を可能にし、品質と正確性のバランスを調整できる新手法

OFTSR: One-Step Flow for Image Super-Resolution with Tunable Fidelity-Realism Trade-offs

  • 基于流模型,通过轨迹对齐实现一步超分辨率生成
  • 在FFHQ、DIV2K等数据集上达到当前最优性能
  • 支持灵活调节图像保真度与真实感的权衡,适合实际部署

扩散和基于流的生成模型在图像修复任务中表现出色,感知质量优于传统深度学习方法。然而,这些方法或需大量采样步骤导致计算开销大,或依赖固定权衡的模型蒸馏,缺乏灵活性。本文提出OFTSR,一种新型一步式流模型超分辨率框架,可灵活调节保真度与真实感。首先训练一个条件流模型作为教师模型;随后通过特定约束进行蒸馏,强制学生模型在相同输入下的单步预测位于教师模型的同一采样常微分方程(ODE)轨迹上。该对齐机制确保学生模型从初始状态出发的单步输出,等效于教师模型在更接近中间状态的预测。在FFHQ(256×256)、DIV2K和ImageNet(256×256)等数据集上的实验表明,OFTSR在一步超分辨率任务中达到最先进水平,同时具备灵活调节保真度与真实感的能力。

原文摘要 · Abstract (English)

Recent advances in diffusion and flow-based generative models have demonstrated remarkable success in image restoration tasks, achieving superior perceptual quality compared to traditional deep learning approaches. However, these methods either require numerous sampling steps to generate high-quality images, resulting in significant computational overhead, or rely on common model distillation, which usually imposes a fixed fidelity-realism trade-off and thus lacks flexibility. In this paper, we introduce OFTSR, a novel flow-based framework for one-step image super-resolution that can produce outputs with tunable levels of fidelity and realism. Our approach first trains a conditional flow-based super-resolution model to serve as a teacher model. We then distill this teacher model by applying a specialized constraint. Specifically, we force the predictions from our one-step student model for same input to lie on the same sampling ODE trajectory of the teacher model. This alignment ensures that the student model's single-step predictions from initial states match the teacher's predictions from a closer intermediate state. Through extensive experiments on datasets including FFHQ (256$\times$256), DIV2K, and ImageNet (256$\times$256), we demonstrate that OFTSR achieves state-of-the-art performance for one-step image super-resolution, while having the ability to flexibly tune the fidelity-realism trade-off. Codes: \href{https://github.com/yuanzhi-zhu/OFTSR}{https://github.com/yuanzhi-zhu/OFTSR}.

图像超分辨率流模型一步生成风格控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。