提出通用热成像框架,消除夜间成像中因材质不均导致的鬼影失真。
Universal computational thermal imaging overcoming the ghosting effect

- 基于无参数纹理恢复,从多光谱光子流中重建细节。
- 首次实现幽灵人脸的高保真表达还原,突破传统限制。
- 适用于复杂场景,适合自动驾驶与安防监测等应用。
热成像对夜间视觉至关重要,但受鬼影效应制约——在复杂光子流中丢失细节纹理。传统方法依赖数据后处理,而近期热辅助探测与测距(HADAR)技术为高光谱计算热成像带来新机遇,可实现接近日间可视效果的夜视。然而,现有HADAR仅适用于均匀材料场景,难以应对真实世界普遍存在的材质非均匀性。本文提出通用计算热成像框架TAG(thermal anti-ghosting),通过多光谱光子流进行无参数纹理恢复,首次在实验中实现此前无法捕捉的幽灵人脸细节重现。结果表明,TAG在各类场景下均优于当前最优HADAR,并揭示材质非均匀性对HADAR性能的影响边界。我们系统测试了昼夜面部纹理与表情恢复,首次实现热成像3D拓扑对齐与情绪识别。本工作为高保真计算夜视建立通用基础,潜在应用于自主导航、侦察、医疗与野生动物监测。
原文摘要 · Abstract (English)
Thermal imaging is crucial for night vision but fundamentally hampered by the ghosting effect, a loss of detailed texture in cluttered photon streams. While conventional ghosting mitigation has relied on data post-processing, the recent breakthrough in heat-assisted detection and ranging (HADAR) opens a promising frontier for hyperspectral computational thermal imaging that produces night vision with day-like visibility. However, universal anti-ghosting imaging remains elusive, as state-of-the-art HADAR applies only to limited scenes with uniform materials, whereas material non-uniformity is ubiquitous in the real world. Here, we propose a universal computational thermal imaging framework, TAG (thermal anti-ghosting), to address material non-uniformity and overcome ghosting for high-fidelity night vision. TAG takes hyperspectral photon streams for nonparametric texture recovery, enabling our experimental demonstration of unprecedented expression recovery in thus-far-elusive ghostly human faces -- the archetypal, long-recognized ghosting phenomenon. Strikingly, TAG not only universally outperforms HADAR across various scenes, but also reveals the influence of material non-uniformity, shedding light on HADAR's effectiveness boundary. We extensively test facial texture and expression recovery across day and night, and demonstrate, for the first time, thermal 3D topological alignment and mood detection. This work establishes a universal foundation for high-fidelity computational night vision, with potential applications in autonomous navigation, reconnaissance, healthcare, and wildlife monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。