arXiv:2510.07961cs.CV2025-10NeurIPS被引 3

让超高清图像修复更高效且保细节,通过潜空间正则化与可控优化实现。

Latent Harmony: Synergistic Unified UHD Image Restoration via Latent Space Regularization and Controllable Refinement

  • 用潜空间约束和渐进退化扰动增强语义鲁棒性,提升高频重建能力。
  • 结合高频低秩适配,恢复真实细节并合成逼真纹理,性能达顶尖水平。
  • 支持灵活调节保真度与视觉感知的平衡,适合高分辨率图像修复场景。

超高清(UHD)图像修复面临计算效率与高频细节保留之间的权衡。尽管变分自编码器(VAEs)通过潜空间处理提升效率,其高斯约束常导致退化特异性高频信息丢失,影响重建保真度。为此,我们提出Latent Harmony,一个两阶段框架,重新定义VAE以实现UHD修复:第一阶段引入LH-VAE,通过视觉语义约束和渐进退化扰动增强语义鲁棒性,并通过潜等变性强化高频重建;第二阶段联合训练该精炼VAE与修复模型,采用高频低秩适配(HF-LoRA)——编码器LoRA由保真导向的高频对齐损失驱动以恢复真实细节,解码器LoRA由感知导向损失驱动以合成逼真纹理。两个LoRA模块通过交替优化与选择性梯度传播进行训练,以保留预训练潜结构。推理时,可调参数α实现保真度与感知质量的灵活权衡。实验表明,Latent Harmony在UHD及标准分辨率任务上均达到最先进性能,有效平衡效率、感知质量和重建精度。

原文摘要 · Abstract (English)

Ultra-High Definition (UHD) image restoration faces a trade-off between computational efficiency and high-frequency detail retention. While Variational Autoencoders (VAEs) improve efficiency via latent-space processing, their Gaussian constraint often discards degradation-specific high-frequency information, hurting reconstruction fidelity. To overcome this, we propose Latent Harmony, a two-stage framework that redefines VAEs for UHD restoration by jointly regularizing the latent space and enforcing high-frequency-aware reconstruction.In Stage One, we introduce LH-VAE, which enhances semantic robustness through visual semantic constraints and progressive degradation perturbations, while latent equivariance strengthens high-frequency reconstruction.Stage Two jointly trains this refined VAE with a restoration model using High-Frequency Low-Rank Adaptation (HF-LoRA): an encoder LoRA guided by a fidelity-oriented high-frequency alignment loss to recover authentic details, and a decoder LoRA driven by a perception-oriented loss to synthesize realistic textures. Both LoRA modules are trained via alternating optimization with selective gradient propagation to preserve the pretrained latent structure.At inference, a tunable parameter α enables flexible fidelity-perception trade-offs.Experiments show Latent Harmony achieves state-of-the-art performance across UHD and standard-resolution tasks, effectively balancing efficiency, perceptual quality, and reconstruction accuracy.

图像修复潜空间高频重建VAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。