用对抗学习模拟红外图像退化,仅用50张清晰图就实现高质量恢复。
DEAL: Data-Efficient Adversarial Learning for High-Quality Infrared Imaging

- 将退化因素建模为对抗攻击,动态生成多样退化数据增强训练
- 在仅50张清晰图像下仍优于现有方法,视觉质量与处理效率双提升
- 融合脉冲神经网络与尺度变换,模型小且能捕捉强信号特征
热成像常因硬件限制和不可预测环境因素导致动态复杂退化。高质量红外数据稀缺,加之退化复杂多变,现有方法难以有效还原细节。本文提出将热退化模拟融入训练过程,通过最小-最大优化建模退化因素为对热图像的对抗攻击,动态最大化目标函数,从而覆盖广泛退化分布。该方法支持有限数据训练,显著提升模型性能。此外,设计双交互网络,结合脉冲神经网络与尺度变换,有效捕捉具有高尖峰强度的退化特征,保持模型参数紧凑的同时实现高效特征表达。大量实验表明,本方法在多种单一及复合退化场景下均获得优异视觉质量,且在仅使用五十张清晰图像训练时,处理效率与准确率均优于现有技术。源代码将于 https://github.com/LiuZhu-CV/DEAL 公开。
原文摘要 · Abstract (English)
Thermal imaging is often compromised by dynamic, complex degradations caused by hardware limitations and unpredictable environmental factors. The scarcity of high-quality infrared data, coupled with the challenges of dynamic, intricate degradations, makes it difficult to recover details using existing methods. In this paper, we introduce thermal degradation simulation integrated into the training process via a mini-max optimization, by modeling these degraded factors as adversarial attacks on thermal images. The simulation is dynamic to maximize objective functions, thus capturing a broad spectrum of degraded data distributions. This approach enables training with limited data, thereby improving model performance.Additionally, we introduce a dual-interaction network that combines the benefits of spiking neural networks with scale transformation to capture degraded features with sharp spike signal intensities. This architecture ensures compact model parameters while preserving efficient feature representation. Extensive experiments demonstrate that our method not only achieves superior visual quality under diverse single and composited degradation, but also delivers a significant reduction in processing when trained on only fifty clear images, outperforming existing techniques in efficiency and accuracy. The source code will be available at https://github.com/LiuZhu-CV/DEAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。