arXiv:2607.06424cs.CV2026-07

XRFormer通过多尺度分词提升XRF光谱建模,实现高效精准的颜料识别与解混。

XRFormer: Multiscale Tokenization for XRF Representation Learning

论文配图:XRFormer: Multiscale Tokenization for XRF Representation Learning
图 1 · 摘自论文原文
  • 设计多尺度卷积分词器,融合局部特征与多分辨率先验
  • 在128个令牌下实现3.37M参数的颜料解混,性能超越现有模型
  • 自监督预训练结合物理约束,适合小样本材料分析场景

X射线荧光(XRF)光谱是文化遗产材料分析的关键手段。然而,基于学习的方法仍面临挑战:XRF光谱为复杂的一维信号,包含尖锐元素峰、宽结构及背景变化,现有模型未充分建模这些特性。本文提出XRFormer,一种专为XRF光谱设计的Transformer架构,通过多尺度卷积分词器在全局自注意力前注入局部性与多分辨率归纳偏置。该分词器逐步降低光谱分辨率并提升嵌入维度,生成的标记序列由标准Transformer编码器处理。进一步研究了基于掩码光谱建模(MSM)和物理启发的峰存在预测(PPP)的自监督预训练。在Pigments Checker STANDARD v.5数据集上,XRFormer在颜料识别任务中持续优于ViT、SpectralFormer(含与不含CAF)及1D-CNN基线;在颜料解混任务中,以128个令牌和1.5M参数实现鲁棒丰度估计,显著优于使用512个令牌和3.37M参数的SpectralFormer。MSM在两项任务中均带来稳定增益,而调整峰显著性后,PPP进一步提升识别与解混性能。结果表明,多尺度、模态感知的分词是数据有限条件下高效的Transformer XRF建模基础。代码已开源于https://github.com/sofiane1010/XRFormer。

原文摘要 · Abstract (English)

X-ray fluorescence (XRF) spectroscopy is a key modality for material analysis in cultural heritage. However, automated learning from XRF spectra remains challenging: XRF spectra are complex one-dimensional signals composed of sharp elemental peaks, broader structures, and background variations that are not taken into account by existing learning-based models. This paper introduces XRFormer, a transformer architecture tailored to XRF spectra through a multiscale convolutional tokenizer that injects locality and multi-resolution inductive biases before global self-attention. The tokenizer progressively reduces spectral resolution while increasing embedding dimensionality, and the resulting token sequence is processed by a standard transformer encoder. We further investigate self-supervised pretraining for XRF representation learning using Masked Spectral modeling (MSM) and a physics-informed Peak Presence Prediction (PPP) objective. Experiments on the Pigments Checker STANDARD v.5 dataset for pigment identification and unmixing show that XRFormer consistently outperforms ViT, SpectralFormer (with and without CAF), and a 1D-CNN baseline for pigment identification. For pigment unmixing, XRFormer achieves robust abundance estimation while maintaining significantly higher parameter efficiency than SpectralFormer, operating at a lower token resolution (128 vs. 512 tokens) and with less than half the number of parameters (1.5M vs. 3.37M). MSM yields consistent gains across both tasks, while PPP further enhances performance for both identification and unmixing when tuned with an appropriate peak prominence. These results highlight multiscale, modality-aware tokenization as an effective and parameter efficient foundation for transformer-based XRF modeling under data-limited conditions. A GitHub repository is provided at https://github.com/sofiane1010/XRFormer.

XRF光谱多尺度建模自监督学习材料分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。