让热成像修复模型能持续学习新退化类型,且不越用越臃肿。
Expandable, Compressible, Mineable: Open-World Thermal Image Restoration

- 采用可扩展、可压缩、可挖掘的闭环机制,持续适应新退化。
- 在多种单一与复合退化上表现更优,参数更少、计算量更低。
- 适合长期部署于真实开放环境的热成像系统,如安防监控。
在开放世界中,热红外(TIR)图像退化持续出现并演化,而现有全功能修复方法多基于封闭集假设,难以持续适应新退化。为此,我们提出ECMRNet——一种从持续学习视角出发的可扩展、可压缩、可挖掘的热成像修复网络。概念上,ECMRNet将持续退化学习统一为“扩展-压缩-挖掘”闭环过程,实现对新退化的可控演化与持续适应。结构上,通过将中间表示分解为组隔离子空间,冻结历史组并同构扩展新组,实现严格参数隔离与快速适应。为抑制随任务累积的模型膨胀,提出结构熵剪枝,通过二维结构熵最小化识别并移除冗余通道组,实现信息贡献驱动的自适应压缩。此外,设计子退化知识挖掘模块,动态检索并重组历史表征中的可迁移成分,提升复合退化下的修复性能。实验表明,ECMRNet在多样单一与复合退化下均取得更优综合表现,同时参数更少、计算成本更低。代码已开源:https://github.com/Kust-lp/ECMRNet。
原文摘要 · Abstract (English)
In open-world settings, thermal infrared (TIR) image degradations continuously emerge and evolve, while most existing all-in-one restoration methods are built on a closed-set assumption and struggle to continually adapt to novel degradations. To address this, we propose ECMRNet, an Expandable, Compressible, and Mineable Restoration Network for open-world TIR restoration from a continual learning perspective. Conceptually, ECMRNet unifies continual degradation learning as an "expand-compress-mine" closed-loop process, enabling sustained adaptation to new degradations with controllable evolution. Structurally, ECMRNet decomposes intermediate representations into group-isolated subspaces, and achieves strict parameter isolation and fast adaptation to new degradations by freezing historical groups and isomorphically expanding new ones. To curb model growth as tasks accumulate, we present Structural Entropy Pruning, which identifies and removes redundant channel groups via two-dimensional structural entropy minimization, achieving information contribution-driven adaptive compression. Moreover, we design a Sub-degradation Knowledge Mining Module that dynamically retrieves and recombines transferable components from historical representations to improve restoration under compound degradations. Experimental results demonstrate that ECMRNet achieves superior overall performance across diverse single and compound degradations while using fewer parameters and lower computational cost. The source code is available at https://github.com/Kust-lp/ECMRNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。