arXiv:2503.08300cs.CV2025-03

用等变卷积提升多帧图像超分辨率对齐精度

Feature Alignment with Equivariant Convolutions for Burst Image Super-Resolution

  • 基于等变卷积实现图像与特征域的统一变换对齐
  • 在多个基准数据集上达到更优的客观指标和视觉效果
  • 适合需要高精度图像对齐的相机系统与视频增强场景

多帧图像处理(BIP)通过捕捉并融合多帧图像生成高质量单图,广泛应用于消费级相机。作为典型的BIP任务,多帧图像超分辨率(BISR)近年来借助深度学习取得显著进展。现有BISR方法通常包含对齐、上采样和融合三个关键阶段,顺序与实现方式各异。其中对齐环节对准确特征匹配与重建至关重要。然而,现有方法多依赖可变形卷积或光流进行对齐,或仅关注局部变换,或缺乏理论基础,限制了性能提升。为此,本文提出一种新型BISR框架,采用基于等变卷积的对齐机制,确保图像域与特征域间变换一致性。该方法可在图像域显式监督下学习对齐变换,并以理论可靠方式应用于特征域,有效提升对齐精度。此外,设计了先进的深度架构用于上采样与融合,获得最终结果。大量实验表明,本方法在多个BISR基准测试中均取得更优的定量指标与视觉质量。

原文摘要 · Abstract (English)

Burst image processing (BIP), which captures and integrates multiple frames into a single high-quality image, is widely used in consumer cameras. As a typical BIP task, Burst Image Super-Resolution (BISR) has achieved notable progress through deep learning in recent years. Existing BISR methods typically involve three key stages: alignment, upsampling, and fusion, often in varying orders and implementations. Among these stages, alignment is particularly critical for ensuring accurate feature matching and further reconstruction. However, existing methods often rely on techniques such as deformable convolutions and optical flow to realize alignment, which either focus only on local transformations or lack theoretical grounding, thereby limiting their performance. To alleviate these issues, we propose a novel framework for BISR, featuring an equivariant convolution-based alignment, ensuring consistent transformations between the image and feature domains. This enables the alignment transformation to be learned via explicit supervision in the image domain and easily applied in the feature domain in a theoretically sound way, effectively improving alignment accuracy. Additionally, we design an effective reconstruction module with advanced deep architectures for upsampling and fusion to obtain the final BISR result. Extensive experiments on BISR benchmarks show the superior performance of our approach in both quantitative metrics and visual quality.

图像超分多帧处理等变卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。