arXiv:2604.07037hep-excs.CV2026-04被引 1

用自监督预训练让中微子探测器更高效,少标注也能学好特征。

Towards foundation-style models for energy-frontier heterogeneous neutrino detectors via self-supervised pre-training

论文配图:Towards foundation-style models for energy-frontier heterogeneous neutrino detectors via self-supervised pre-training
图 1 · 摘自论文原文
  • 构建稀疏ViT模型,通过掩码重建和关系建模预训练多源探测数据。
  • 仅用1000个标注事件,性能已达随机初始化模型十倍数据量水平。
  • 适用于高能物理复杂场景,尤其适合标注稀缺的中微子分析任务。

加速器基中微子物理正进入能量前沿,相互作用可达太电子伏特量级,产生极其密集且重叠的探测信号。传统重建方法在此情形下变得不切实际,尤其在标注数据稀缺且下游目标多样时。本文提出一种稀疏视觉变压器框架,从异构探测器数据中学习可复用表征。自监督预训练结合掩码自动编码器重建与关系级体素目标(用于层次、鬼影及粒子识别),所得共享编码器在分类与回归任务上联合微调。在LHC FASERCal概念模拟事件上评估,预训练显著提升中微子味与粲夸克识别、动量回归及顶点重建性能,引入关系目标后在拓扑最复杂的通道中进一步增益。可解释性分析显示,预训练使潜在空间更具结构;探测子系统消融实验揭示了异构输入的物理合理分工。数据效率研究发现,仅需约10^3个标注事件,预训练编码器的味分类性能即达到随机初始化模型使用十倍数据量的水平。所学表征还可有效迁移至涵盖不同探测技术与能量尺度的公开基准,性能匹配或超越现有基线。结果表明,对多模态探测数据进行自监督预训练是实现中微子与粒子探测分析可复用表征的可扩展路径。

原文摘要 · Abstract (English)

Accelerator-based neutrino physics is entering an energy-frontier regime in which interactions reach the TeV scale and produce exceptionally dense, overlapping detector signatures. In this regime, event interpretation becomes impractical for conventional reconstruction approaches, particularly when labelled data are scarce and the analysis spans diverse downstream objectives. We present a sparse ViT framework for learning reusable representations from heterogeneous detector data. Self-supervised pre-training combines masked autoencoder reconstruction with relational voxel-level objectives for hierarchy, ghost and particle identification, and the resulting shared encoder is then jointly fine-tuned across classification and regression tasks. Evaluated on simulated events from the proposed FASERCal concept at the LHC, we find that pre-training consistently improves neutrino flavour and charm-quark identification, momentum regression, and vertex reconstruction over training from scratch, with the addition of relational objectives yielding further gains in the most topologically complex channels. Interpretability analyses further show that pre-training yields a more structured latent space, while detector-subsystem ablations recover physically plausible channel-dependent roles for the heterogeneous inputs. A data-efficiency study shows that, with roughly $10^3$ labelled events, the pre-trained encoder already matches the flavour-classification performance of a randomly initialised model trained on an order of magnitude more data. The learned representations also transfer effectively to publicly available benchmarks spanning different detector technologies and energy scales, matching or exceeding published baselines. These results support self-supervised pre-training on multimodal detector data as a scalable route towards reusable representations for neutrino and particle-detector analysis.

中微子物理自监督学习探测器分析稀疏模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。