arXiv:2509.02424cs.CV2025-09

用强化学习优化蒸馏与自学习,提升红外可见光融合效果。

Faster and Better: Reinforced Collaborative Distillation and Self-Learning for Infrared-Visible Image Fusion

  • 通过强化学习动态调整训练策略,引导学生模型学习难样本。
  • 在多个数据集上显著优于现有方法,性能提升明显。
  • 适合追求轻量化高精度图像融合的科研与工程人员。

红外与可见光图像融合通过结合多模态互补信息,显著提升场景感知能力。尽管近期取得进展,但实现高质量且轻量化的图像融合仍是挑战。为此,我们提出一种基于强化学习的协同蒸馏与自学习框架。该方法不仅使学生模型从教师模型中吸收融合知识,还允许其在更具挑战性的样本上进行自学习。具体地,强化学习代理根据学生表现与师生差距,探索并生成更优训练策略,动态调节教师指导强度以优化知识迁移。实验表明,该方法显著提升学生模型性能,在多个数据集上优于现有技术。

原文摘要 · Abstract (English)

Infrared and visible image fusion plays a critical role in enhancing scene perception by combining complementary information from different modalities. Despite recent advances, achieving high-quality image fusion with lightweight models remains a significant challenge. To bridge this gap, we propose a novel collaborative distillation and self-learning framework for image fusion driven by reinforcement learning. Unlike conventional distillation, this approach not only enables the student model to absorb image fusion knowledge from the teacher model, but more importantly, allows the student to perform self-learning on more challenging samples to enhance its capabilities. Particularly, in our framework, a reinforcement learning agent explores and identifies a more suitable training strategy for the student. The agent takes both the student's performance and the teacher-student gap as inputs, which leads to the generation of challenging samples to facilitate the student's self-learning. Simultaneously, it dynamically adjusts the teacher's guidance strength based on the student's state to optimize the knowledge transfer. Experimental results demonstrate that our method can significantly improve student performance and achieve better fusion results compared to existing techniques.

图像融合强化学习轻量化蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。