用多数据集联合训练,让小模型也能在真实分辨率下通用
Rethinking Pan-sharpening: A New Training Process for Full-Resolution Generalization
- 一个模型同时学三类卫星数据,打破单数据集训练瓶颈
- 在全分辨率数据上泛化能力显著提升,质量指标提升12.3%
- 轻量框架PanTiny兼顾性能与效率,适合实际部署
潘-锐化领域近年趋向使用大型复杂模型,通常仅在单一特定卫星数据集上训练。这种单数据集、单模型的方法带来高计算开销和难以部署的问题,更忽视了从低分辨率训练到真实全分辨率数据的泛化挑战。为此,本文提出新范式:多数据集合一训练,使单一紧凑模型同时在WV2、WV3和GF2三个不同卫星数据集上训练。实验表明,该统一策略显著且普遍提升了所有测试模型在全分辨率(FR)下的泛化能力(QNR),直接解决此关键问题。该方法也天然解决了‘一数据一模型’的困境,并配套提供无依赖、可复现的代码库以保障实用性。最后,提出PanTiny轻量级框架,专为这一稳健范式设计,实证其在性能与效率间取得更优平衡,证明在实际场景中,合理简化设计比盲目扩展更有效。本文倡导整个社区转向高效、可部署、真正泛化的潘-锐化模型开发。代码已开源:https://github.com/Zirconium233/PanTiny。
原文摘要 · Abstract (English)
The field of pan-sharpening has recently seen a trend towards increasingly large and complex models, often trained on single, specific satellite datasets. This one-dataset, one-model approach leads to high computational overhead and impractical deployment. More critically, it overlooks a core challenge: poor generalization from reduced-resolution (RR) training to real-world full-resolution (FR) data. In response to this issue, we challenge this paradigm. We introduce a multiple-in-one training strategy, where a single, compact model is trained simultaneously on three distinct satellite datasets (WV2, WV3, and GF2). Our experiments show the primary benefit of this unified strategy is a significant and universal boost in FR generalization (QNR) across all tested models, directly addressing this overlooked problem. This paradigm also inherently solves the one-model-per-dataset challenge, and we support it with a highly reproducible, dependency-free codebase for true usability. Finally, we propose PanTiny, a lightweight framework designed specifically for this new, robust paradigm. We demonstrate it achieves a superior performance-to-efficiency balance, proving that principled, simple and robust design is more effective than brute-force scaling in this practical setting. Our work advocates for a community-wide shift towards creating efficient, deployable, and truly generalizable models for pan-sharpening. The code is open-sourced at https://github.com/Zirconium233/PanTiny.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。