arXiv:2504.08937cs.GRcs.CV2025-04

用细粒度先验引导少样本图像融合,提升模型泛化能力

Rethinking Few-Shot Image Fusion: Granular Ball Priors Enable General-Purpose Deep Fusion

  • 引入不完整先验概念,动态估计手工先验置信度
  • 基于粒计算设计GBPC算法,实现跨模态差异感知与自适应推理
  • 仅需10对图像训练,轻量网络仍达优异融合效果

在图像融合任务中,缺乏真实融合图像作为监督信号带来了巨大挑战。现有深度学习方法通常通过设计手工先验或依赖大规模数据集来学习模型参数。不同于以往方法,本文提出不完整先验的概念,从算法层面形式化描述手工先验并估计其置信度。基于此,我们通过样本级自适应损失函数将不完整先验与神经网络耦合,使网络能在接近真实融合过程的条件下学习并重推融合规则。为生成不完整先验,我们提出基于粒计算的颗粒球像素计算(GBPC)算法,将融合图像像素建模为信息单元,在细粒度上估计像素权重,同时在粗粒度上统计评估先验可靠性,从而感知跨模态差异并执行自适应推理。实验表明,即使在少样本条件下,仅使用十对图像提取的图像块进行训练,轻量级神经网络仍能学习到有效的融合规则。在多个融合任务和数据集上的广泛实验进一步证明,该方法在视觉质量和模型紧凑性方面均表现优异。

原文摘要 · Abstract (English)

In image fusion tasks, the absence of real fused images as supervision signals poses significant challenges for supervised learning. Existing deep learning methods typically address this issue either by designing handcrafted priors or by relying on large-scale datasets to learn model parameters. Different from previous approaches, this paper introduces the concept of incomplete priors, which formally describe handcrafted priors at the algorithmic level and estimate their confidence. Based on this idea, we couple incomplete priors with the neural network through a sample-level adaptive loss function, enabling the network to learn and re-infer fusion rules under conditions that approximate the real fusion process.To generate incomplete priors, we propose a Granular Ball Pixel Computation (GBPC) algorithm based on the principles of granular computing. The algorithm models fused-image pixels as information units, estimating pixel weights at a fine-grained level while statistically evaluating prior reliability at a coarse-grained level. This design enables the algorithm to perceive cross-modal discrepancies and perform adaptive inference.Experimental results demonstrate that even under few-shot conditions, a lightweight neural network can still learn effective fusion rules by training only on image patches extracted from ten image pairs. Extensive experiments across multiple fusion tasks and datasets further show that the proposed method achieves superior performance in both visual quality and model compactness. The code is available at: https://github.com/DMinjie/GBFF

图像融合少样本学习粒计算先验建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。