通过频域引导的专家路由与正交梯度投影,提升真实图像超分的保真与感知质量。
FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution

- 用频域特征动态选择专用专家,实现不同退化类型的精准适配。
- 通过正交约束使保真与感知目标学习互不干扰,提升整体效果。
- 单步推理高效,适用于多种复杂真实退化场景,适合工业部署。
基于扩散先验的方法在真实世界图像超分辨率(ISR)中表现优异,但仍面临两大挑战:平衡像素级保真与语义质量,以及适应多样化的退化类型。现有双分支方法在语义训练时冻结像素模块,但语义分支仍可能在像素子空间内扩展容量,导致感知提升不真实。此外,单一静态适配器难以泛化至异构真实退化。为此,我们提出 FreqOrtho-SR,包含:频域引导的 LoRA 专家混合(FreqMoE),通过非参数化 FFT-based 退化特征提取器编码频域特征,将输入路由至特定专家,实现对退化类型的稳定可解释专业化;正交梯度投影(OGP),将双目标优化重构为子空间约束问题:通过联合专家权重增量的 SVD 提取像素保真子空间,并将语义梯度投影至其零空间,确保两目标正交,实现真正互补学习而无相互干扰。实验表明,FreqOrtho-SR 在多个基准上达到有竞争力的整体性能,且在保真与感知间保持良好权衡,支持高效单步推理。代码已开源:https://github.com/sonhm3029/FreqOrtho-SR。
原文摘要 · Abstract (English)
Diffusion prior-based methods have shown impressive results in real-world image super-resolution (ISR), yet two key challenges persist: balancing pixel-level fidelity with semantic quality, and adapting to diverse degradations. Existing dual-branch approaches freeze the pixel module during semantic training, but the semantic branch can still expand capacity within the pixel subspace, precluding genuine perceptual improvement. Moreover, using a single static adapter cannot generalize across heterogeneous real-world corruptions. To address both issues, we propose FreqOrtho-SR, which comprises: $\textbf{Freq}$uency-guided Mixture of LoRA Experts (FreqMoE), it routes inputs to specialized experts via a non-parametric FFT-based degradation-feature extractor that encodes frequency-domain signatures, enabling stable and interpretable specialization across corruption types; and $\textbf{Ortho}$gonal Gradient Projection (OGP), which reframes the dual-objective optimization as a subspace-constrained problem: by extracting the pixel-fidelity subspace via SVD on combined expert weight deltas and projecting semantic gradients onto its null space, OGP guarantees orthogonality between the two objectives, enabling genuinely complementary learning without mutual interference. Experiments show that FreqOrtho-SR achieves competitive overall performance and a strong fidelity-perception trade-off across multiple benchmarks with efficient single-step inference. The source code of our method can be found at $\href{https://github.com/sonhm3029/FreqOrtho-SR}{\texttt{sonhm3029/FreqOrtho-SR}}$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。