arXiv:2603.14412cs.CV2026-03被引 1

无需训练即可任意缩放融合遥感图像,效果超越现有方法。

G-ZAP: A Generalizable Zero-Shot Framework for Arbitrary-Scale Pansharpening

  • 用隐式神经表示融合网络实现跨尺度、跨场景泛化
  • 在多个真实数据集上达到顶尖视觉与量化指标
  • 支持权重复用,适合实际部署的高效处理

全色锐化旨在融合高分辨率全色(PAN)图像与低分辨率多光谱(LRMS)图像,生成高分辨率多光谱(HRMS)图像。近期深度模型虽表现优异,但通常依赖大规模预训练,且对未见的真实图像对泛化能力差。已有零样本方法提升真实场景泛化性,但需逐图优化,难以复用权重;且多数方法仅适用于固定缩放比。为此,本文提出 G-ZAP,一种可泛化的零样本任意缩放全色锐化框架,支持跨分辨率、跨场景、跨传感器的通用性。G-ZAP 采用基于特征的隐式神经表示(INR)融合网络作为主干,并引入多尺度半监督训练策略以增强鲁棒泛化能力。在多个真实世界数据集上的大量实验表明,G-ZAP 在 PAN 缩放融合任务中,于视觉质量与定量指标上均达到当前最优表现。值得注意的是,该方法可在不同图像对间复用权重,性能媲美每对图像单独微调,展现出高效的现实部署潜力。

原文摘要 · Abstract (English)

Pansharpening aims to fuse a high-resolution panchromatic (PAN) image and a low-resolution multispectral (LRMS) image to produce a high-resolution multispectral (HRMS) image. Recent deep models have achieved strong performance, yet they typically rely on large-scale pretraining and often generalize poorly to unseen real-world image pairs. Prior zero-shot approaches improve real-scene generalization but require per-image optimization, hindering weight reuse, and the above methods are usually limited to a fixed scale. To address this issue, we propose G-ZAP, a generalizable zero-shot framework for arbitrary-scale pansharpening, designed to handle cross-resolution, cross-scene, and cross-sensor generalization. G-ZAP adopts a feature-based implicit neural representation (INR) fusion network as the backbone and introduces a multi-scale, semi-supervised training scheme to enable robust generalization. Extensive experiments on multiple real-world datasets show that G-ZAP achieves state-of-the-art results under PAN-scale fusion in both visual quality and quantitative metrics. Notably, G-ZAP supports weight reuse across image pairs while maintaining competitiveness with per-pair retraining, demonstrating strong potential for efficient real-world deployment.

遥感图像图像融合零样本学习泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。