用统一流程实现高效图像修复,兼顾清晰度与真实感。
Flow Straight to Reality: Perceptually Consistent Flow Matching for Efficient Image Restoration

- 直接建模退化到干净图像的连续传输过程
- 少步推断下仍保持高清晰度和视觉真实感
- 适合需要快速修复且对质量要求高的场景
图像修复面临失真与感知真实之间的权衡:最小化像素误差会导致结果过平滑,而优化感知真实感又常引入结构偏差。现有方法通过后验采样或多阶段生成流程尝试平衡,但计算成本高、结构复杂。为此,我们提出PCFlow(Perceptually Consistent Flow Matching),一个统一框架,直接参数化从退化观测到清洁目标的连续流,联合优化失真与感知质量。其潜在一致性流目标实现稳定高效的少步推断;潜空间一致性感知损失(LCPL)直接对引导速度场施加语义约束,引导动态向视觉锐利的数据流形逼近。针对结构与感知一致性间的内在冲突,引入无冲突梯度投影策略,稳定多目标优化。结合轻量级仅卷积主干网络,PCFlow在多种修复任务中表现优异,计算成本仅为传统方法的一小部分。
原文摘要 · Abstract (English)
Image restoration is fundamentally constrained by the tradeoff between distortion and perception: minimizing pixel-wise error yields over-smoothed results, whereas optimizing for perceptual realism often introduces structural deviations. Recent approaches attempt to balance this tradeoff via posterior sampling or multi-stage generative pipelines, yet remain computationally expensive and architecturally complex. To overcome these limitations, we propose PCFlow (Perceptually Consistent Flow Matching), a unified framework that directly parameterizes a continuous transport from degraded observations to clean targets, jointly optimizing distortion and perceptual quality. While its latent consistency flow objective drives stable and efficient few-step inference, a Latent Consistency Perceptual Loss (LCPL) imposes semantic constraints directly on the guiding velocity field, steering the dynamics toward visually sharp data manifolds. Furthermore, recognizing the inherent conflict between structural and perceptual consistencies, we integrate a conflict-free gradient projection strategy to stabilize the multi-objective optimization landscape. Combined with lightweight, convolution-only backbone, PCFlow achieves competitive performance across diverse restoration tasks at a fraction of traditional computational costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。