arXiv:2603.13437cs.CVeess.SP2026-03

用视觉语言模型自动解析热成像图,生成可复现的文物真伪与损伤报告

Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection

论文配图:Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection
图 1 · 摘自论文原文
  • 融合多种热成像技术,自动提取文物内部异常区域
  • 在两件马赛克作品上实现稳定检测与结构化报告生成
  • 输出包含位置、热行为和不确定性说明的可信解释,适合文物保护团队使用

真实性评估与保存状态判断是文物保护决策的核心,但热成像结果的解读仍高度依赖专家经验,难以跨机构比较且难系统整合。脉冲主动红外热成像(AIRT)对材料异质性、空洞及修复痕迹敏感,但因误判、实验室间差异及缺乏标准化可解释报告框架而应用受限。尽管多模态热成像处理已成熟,其与结构化自然语言解释的结合尚未在文化遗产领域探索。本文提出一种全自动热成像-视觉语言模型(VLM)框架,结合主成分热成像(PCT)、热信号重建(TSR)和脉冲相位热成像(PPT),将多源异常掩码融合为共识分割,突出多重热指标支持区域并减少边界伪影。融合证据输入VLM,生成结构化报告,描述异常位置、热行为及可能物理解释,并明确标注不确定性和诊断局限。在两件马赛克作品上验证,实现一致的异常检测与稳定结构化解读,表明方法具有可复现性与跨样本泛化能力。

原文摘要 · Abstract (English)

Authenticity and condition assessment are central to conservation decision-making, yet interpretation and reporting of thermographic output remain largely bespoke and expert-dependent, complicating comparison across collections and limiting systematic integration into conservation documentation. Pulsed Active Infrared Thermography (AIRT) is sensitive to subsurface features such as material heterogeneity, voids, and past interventions; however, its broader adoption is constrained by artifact misinterpretation, inter-laboratory variability, and the absence of standardized, explainable reporting frameworks. Although multi-modal thermographic processing techniques are established, their integration with structured natural-language interpretation has not been explored in cultural heritage. A fully automated thermography-vision-language model (VLM) framework is presented. It combines multi-modal AIRT analysis with modality-aware textual reporting, without human intervention during inference. Thermal sequences are processed using Principal Component Thermography (PCT), Thermographic Signal Reconstruction (TSR), and Pulsed Phase Thermography (PPT), and the resulting anomaly masks are fused into a consensus segmentation that emphasizes regions supported by multiple thermal indicators while mitigating boundary artifacts. The fused evidence is provided to a VLM, which generates structured reports describing the location of the anomaly, thermal behavior, and plausible physical interpretations while explicitly acknowledging the uncertainty and diagnostic limitations. Evaluation on two marquetries demonstrates consistent anomaly detection and stable structured interpretations, indicating reproducibility and generalizability across samples.

文物鉴定热成像分析视觉语言模型自动化报告

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。