arXiv:2604.12364hep-excs.LG2026-04被引 3

粒子物理基础模型可跨能区、跨探测器迁移,提升中微子实验分析效率。

Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions

  • 用高能对撞数据预训练的模型迁移至低能中微子实验
  • 在能谱回归与末态分类任务上均优于从零训练模型
  • 对粒子物理跨领域推理有重要意义,适合相关算法研究者

未来粒子物理中的AI研究可能以基础模型为起点,以加速训练并提升灵敏度。为迈向通用粒子物理基础模型,我们考察OmniLearned和ParticleViT这两个在多样高-$Q^2$模拟及真实$pp$和$ep$碰撞数据上预训练的模型,是否能将知识迁移至几GeV量级的固定靶中微子实验。我们处理MINERvA中微子-核散射事件,评估其在两类任务上的表现:可用能量回归,以及带电荷流π末态($ℂC1π^{\pm}$, $ℂCNπ^{\pm}$, $ℂC1π^{0}$)的二分类。在相同计算预算下,预训练的OmniLearned和ParticleViT模型均优于从零训练的同类模型,其中OmniLearned在回归任务中增益最大,ParticleViT在分类任务中表现更优。若使用无关文本预训练(如BERT)初始化同一架构,则仅在分类任务中略有计算效率优势,回归任务无任何提升。结果表明,粒子层面的基础模型具备可跨大能标差异、探测器技术及基本物理过程泛化的归纳偏置,指向粒子物理中的探测器无关推理。

原文摘要 · Abstract (English)

Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step toward a general-purpose foundation model for particle physics, we investigate whether the OmniLearned and ParticleViT foundation models pretrained on diverse high-$Q^2$ simulated and real $pp$ and $ep$ collisions retain useful knowledge to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pretrained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ($\mathrm{CC1π^{\pm}}$, $\mathrm{CCNπ^{\pm}}$, and $\mathrm{CC1π^{0}}$). Pretrained OmniLearned and ParticleViT models outperform similarly sized models trained from scratch at the same compute budget, with the largest gains for OmniLearned on regression and for ParticleViT on classification. When the same transformer architecture is instead initialized from unrelated text pretraining (BERT), this advantage appears only marginally for classification in terms of compute efficiency and not in any way for regression. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward detector-agnostic inference in particle physics.

基础模型粒子物理跨域迁移中微子

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。