arXiv:2409.09483eess.IV2024-09

用一张RGB图和少量数据,让旧画作的扫描分辨率翻倍

Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

论文配图:Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data
图 1 · 摘自论文原文
  • 基于对抗性神经网络,利用RGB图像建模跨模态关系
  • 仅需单张高分辨率RGB图与低分辨率数据即可训练
  • 无需成对高清样本,适合珍贵艺术品的快速分析

高质量元素分布图可精确分析古大师绘画的材料组成与保存状况。这些图通常通过宏量X射线荧光(MA-XRF)扫描获取,该技术非破坏性地采集光谱信息。然而,MA-XRF常受限于扫描时间与分辨率之间的权衡:更高分辨率需更长扫描时间,对大型艺术品分析不切实际。超分辨率MA-XRF提供替代方案,在减少扫描时间的同时提升图像质量。本文提出一种专为古大师绘画设计的超分辨率方法,采用受学习迭代软阈值算法启发的新型对抗神经网络架构,专为无监督模式设计,高效利用有限数据。该方法仅需一张高分辨率RGB图像配合低分辨率MA-XRF数据即可训练,避免对大规模数据集或预训练模型的依赖。数值结果表明,本方法在古大师绘画的MA-XRF超分辨率任务中优于现有最先进方法。

原文摘要 · Abstract (English)

High-quality element distribution maps enable precise analysis of the material composition and condition of Old Master paintings. These maps are typically produced from data acquired through Macro X-ray fluorescence (MA-XRF) scanning, a non-invasive technique that collects spectral information. However, MA-XRF is often limited by a trade-off between acquisition time and resolution. Achieving higher resolution requires longer scanning times, which can be impractical for detailed analysis of large artworks. Super-resolution MA-XRF provides an alternative solution by enhancing the quality of MA-XRF scans while reducing the need for extended scanning sessions. This paper introduces a tailored super-resolution approach to improve MA-XRF analysis of Old Master paintings. Our method proposes a novel adversarial neural network architecture for MA-XRF, inspired by the Learned Iterative Shrinkage-Thresholding Algorithm. It is specifically designed to work in an unsupervised manner, making efficient use of the limited available data. This design avoids the need for extensive datasets or pre-trained networks, allowing it to be trained using just a single high-resolution RGB image alongside low-resolution MA-XRF data. Numerical results demonstrate that our method outperforms existing state-of-the-art super-resolution techniques for MA-XRF scans of Old Master paintings.

超分辨率艺术分析对抗网络跨模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。