首个可处理任意输入帧数的多曝光融合模型,无需重训练即可适应不同拍摄条件。
There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion

- 用递归状态空间模块逐帧融合,自适应对齐并建模全局特征。
- 在三个数据集上优于现有方法,实现更优对比度与亮度控制。
- 适合需要灵活部署的相机系统或移动端多曝光应用。
多曝光融合(MEF)使传统相机的动态范围接近人眼视觉,生成内容丰富的图像。由于场景亮度变化大,曝光策略常需不同数量的帧来准确捕捉全辐射范围。然而,传统MEF方法通常针对固定输入帧数设计,导致部署系统需为不同帧数维护多个独立模型,降低效率。为此,我们提出FreeMEF,首个无需重训练或架构修改即可灵活处理任意输入帧数的MEF Transformer。方法包含两个关键模块:首先,引入递归状态空间模块(RSSM),通过自适应对齐和状态空间循环建模,实现任意序列特征的渐进式融合,并为后续重建提供全局信息引导;其次,设计全局特征引导块(GFGB),结合极值感知混合注意力(EAHA)与仿射注入前馈网络(AFFN),有效缓解相似性悖论,同时优化对比度与亮度调节。在三个基准数据集上的大量实验表明,该方法在定量和定性评估中均优于现有最优方法。
原文摘要 · Abstract (English)
Multi-exposure fusion (MEF) brings the dynamic range of conventional cameras closer to that of human vision, producing images with rich scene content. Given the large variability in scene luminance, exposure strategies often require different numbers of frames to capture the full radiance range faithfully. However, conventional MEF techniques are typically designed for a fixed number of inputs, forcing deployment systems to maintain separate models for different frame-count requirements, which undermines deployment efficiency. To address this limitation, we propose FreeMEF, the first flexible-frame transformer for MEF that seamlessly accommodates varying numbers of input exposures without retraining or architectural changes. The proposed approach consists of two key modules. First, we introduce a recurrent state space module (RSSM) that sequentially fuses features from arbitrary sequences via adaptive alignment and state-space recurrent modeling, thereby providing global information guidance for the subsequent restoration. Second, we devise a global feature guided block (GFGB) incorporating an extremity-aware hybrid attention (EAHA) and an affine-injection feed-forward network (AFFN), which effectively resolves the similarity paradox while simultaneously optimizing contrast and brightness regulation. Extensive experiments on three benchmark datasets demonstrate the effectiveness of our method, which performs favorably against state-of-the-art methods both quantitatively and qualitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。