通过解耦特征与可逆融合,实现超高清图像修复的高效高质。
Decouple to Reconstruct: High Quality UHD Restoration via Active Feature Disentanglement and Reversible Fusion
- 提出分层对比解耦学习与正交门控模块,主动分离易恢复背景与难恢复退化信息。
- 在六项超高清修复任务中达到领先效果,仅用100万参数保持高效计算。
- 适合关注超高清图像修复、低资源模型设计的研究者与开发者。
超高清(UHD)图像修复常因分辨率极高而面临计算瓶颈与信息丢失问题。现有基于变分自编码器(VAE)的方法虽将修复过程从像素空间转移至潜在空间以提升效率,但退化成分与背景元素在退化图像中天然耦合,导致压缩时信息损失与补偿时信息增益均不可控,进而引发细节丢失与退化残留。为此,本文提出可控差分解耦VAE,利用分层对比解耦学习与正交门控投影模块,引导模型主动舍弃易于恢复的背景信息,将更难恢复的退化信息编码进潜在空间。同时,设计复杂可逆多尺度融合网络处理背景特征,确保一致性,并采用潜在空间修复网络重构退化特征,从而获得更精确的修复结果。大量实验表明,该方法有效缓解了VAE模型中的信息丢失问题,在保持计算效率的同时显著提升超高清图像修复质量,在六项任务中均达到当前最优性能,仅需100万参数。
原文摘要 · Abstract (English)
Ultra-high-definition (UHD) image restoration often faces computational bottlenecks and information loss due to its extremely high resolution. Existing studies based on Variational Autoencoders (VAE) improve efficiency by transferring the image restoration process from pixel space to latent space. However, degraded components are inherently coupled with background elements in degraded images, both information loss during compression and information gain during compensation remain uncontrollable. These lead to restored images often exhibiting image detail loss and incomplete degradation removal. To address this issue, we propose a Controlled Differential Disentangled VAE, which utilizes Hierarchical Contrastive Disentanglement Learning and an Orthogonal Gated Projection Module to guide the VAE to actively discard easily recoverable background information while encoding more difficult-to-recover degraded information into the latent space. Additionally, we design a Complex Invertible Multiscale Fusion Network to handle background features, ensuring their consistency, and utilize a latent space restoration network to transform the degraded latent features, leading to more accurate restoration results. Extensive experimental results demonstrate that our method effectively alleviates the information loss problem in VAE models while ensuring computational efficiency, significantly improving the quality of UHD image restoration, and achieves state-of-the-art results in six UHD restoration tasks with only 1M parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。