arXiv:2604.20128cs.CV2026-04

用流匹配实现马赛克与全色图像融合,提升高分辨率超光谱成像质量。

Semi-Supervised Flow Matching for Mosaiced and Panchromatic Fusion Imaging

论文配图:Semi-Supervised Flow Matching for Mosaiced and Panchromatic Fusion Imaging
图 1 · 摘自论文原文
  • 采用两阶段半监督流匹配框架,先预训练无监督先验网络生成初始高分辨率图像。
  • 引入随机投票机制迭代优化初始估计,实现鲁棒的光谱空间一致性重建。
  • 适用于多种图像融合任务,可拓展至无监督或盲图像修复场景。

将低分辨率(LR)马赛克超光谱图像(HSI)与高分辨率(HR)全色(PAN)图像融合,为单次采集实现视频速率的高分辨率超光谱成像提供了可行路径,但其严重病态特性仍是重大挑战。本文提出一种新型半监督流匹配框架用于马赛克与全色图像融合。不同于以往受特定协议或手工假设限制的扩散方法,本方法无缝整合无监督方案与流匹配,形成通用且高效的生成框架。具体而言,采用两阶段训练流程:首先预训练无监督先验网络生成初始伪高分辨率超光谱图像;在此基础上,训练条件流匹配模型生成目标高分辨率图像,并引入随机投票机制迭代优化初始估计,实现鲁棒有效的融合。推理时采用无冲突梯度引导策略,确保光谱与空间一致性重建。多个基准数据集上的实验表明,本方法在定量与定性性能上显著优于代表性基线。此外,该方法具有灵活性,可扩展至其他图像融合任务,并可集成无监督或盲图像恢复算法。

原文摘要 · Abstract (English)

Fusing a low resolution (LR) mosaiced hyperspectral image (HSI) with a high resolution (HR) panchromatic (PAN) image offers a promising avenue for video-rate HR-HSI imaging via single-shot acquisition, yet its severely ill-posed nature remains a significant challenge. In this work, we propose a novel semi-supervised flow matching framework for mosaiced and PAN image fusion. Unlike previous diffusion-based approaches constrained by specific protocols or handcrafted assumptions, our method seamlessly integrates an unsupervised scheme with flow matching, resulting in a generalizable and efficient generative framework. Specifically, our method follows a two-stage training pipeline. First, we pretrain an unsupervised prior network to produce an initial pseudo HR-HSI. Building on this, we then train a conditional flow matching model to generate the target HR-HSI, introducing a random voting mechanism that iteratively refines the initial HR-HSI estimate, enabling robust and effective fusion. During inference, we employ a conflict-free gradient guidance strategy that ensures spectrally and spatially consistent HR-HSI reconstruction. Experiments on multiple benchmark datasets demonstrate that our method achieves superior quantitative and qualitative performance by a significant margin compared to representative baselines. Beyond mosaiced and PAN fusion, our approach provides a flexible generative framework that can be readily extended to other image fusion tasks and integrated with unsupervised or blind image restoration algorithms.

图像融合流匹配超光谱成像半监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。