arXiv:2511.16024cs.CV2025-11AAAI被引 2

用稀疏专家路由提升真实图像超分辨率,动态适配不同退化程度。

Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolution

  • 将LoRA的每个秩视为独立专家,实现灵活知识重组。
  • 引入退化度评估模块,动态决定激活哪些专家,提升效率。
  • 适合处理复杂退化场景的图像超分辨率任务,计算开销可控。

基于稀疏门控混合专家(MoE)架构在深度学习模型中的成功应用,如DeepSeek和Grok,促使研究者探索其在多样化领域的适配。在真实世界图像超分辨率(Real-ISR)任务中,现有方法主要依赖预训练扩散模型通过低秩适应(LoRA)模块进行微调以重建高分辨率(HR)图像。然而,这些密集型模型在捕捉复杂真实退化样本的异质特征方面能力有限,且在相同计算预算下难以实现输入间的知识共享。为此,本文提出一种用于单步图像超分辨率的秩混合(Mixture-of-Ranks, MoR)架构。我们设计细粒度专家划分策略,将LoRA中的每个秩视为独立专家,从而实现灵活的知识重组;同时将固定位置的秩作为共享专家,保留通用特征并减少路由冗余。进一步地,我们开发一个基于CLIP嵌入与预定义正负文本对的退化估计模块,计算相对退化分数,动态引导专家激活。为更好适应样本复杂度差异,引入零专家槽位,并提出退化感知负载均衡损失,根据退化严重程度动态调整活跃专家数量,确保计算资源最优分配。大量实验验证了该框架的有效性与先进性能。

原文摘要 · Abstract (English)

The demonstrated success of sparsely-gated Mixture-of-Experts (MoE) architectures, exemplified by models such as DeepSeek and Grok, has motivated researchers to investigate their adaptation to diverse domains. In real-world image super-resolution (Real-ISR), existing approaches mainly rely on fine-tuning pre-trained diffusion models through Low-Rank Adaptation (LoRA) module to reconstruct high-resolution (HR) images. However, these dense Real-ISR models are limited in their ability to adaptively capture the heterogeneous characteristics of complex real-world degraded samples or enable knowledge sharing between inputs under equivalent computational budgets. To address this, we investigate the integration of sparse MoE into Real-ISR and propose a Mixture-of-Ranks (MoR) architecture for single-step image super-resolution. We introduce a fine-grained expert partitioning strategy that treats each rank in LoRA as an independent expert. This design enables flexible knowledge recombination while isolating fixed-position ranks as shared experts to preserve common-sense features and minimize routing redundancy. Furthermore, we develop a degradation estimation module leveraging CLIP embeddings and predefined positive-negative text pairs to compute relative degradation scores, dynamically guiding expert activation. To better accommodate varying sample complexities, we incorporate zero-expert slots and propose a degradation-aware load-balancing loss, which dynamically adjusts the number of active experts based on degradation severity, ensuring optimal computational resource allocation. Comprehensive experiments validate our framework's effectiveness and state-of-the-art performance.

图像超分MoELoRA退化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。