基于1.2亿事件训练的图神经网络模型,提升高能物理事件分类性能。
Pretrained Event Classification Model for High Energy Physics Analysis
- 用图神经网络在1.2亿模拟事件上预训练,学习通用特征表示
- 微调后在少样本场景下准确率和效率显著提升,跨框架泛化能力强
- 揭示微调时编码器保留通用性,中间层重构消息传递路径以优化性能
我们提出一种高能物理事件分类的基础模型,采用图神经网络架构,在1.2亿个质子-质子对撞模拟事件上训练,覆盖12种不同物理过程。模型通过具有挑战性的多类与多标签分类任务进行预训练,以学习碰撞数据的通用且稳健的表示。在七个事件分类任务中评估性能,涵盖预训练未见的新物理过程以及ATLAS开放数据,验证其在不同模拟框架(从Delphes快速模拟到完整ATLAS探测器模拟)下的泛化能力。微调预训练模型显著提升分类表现,尤其在数据有限场景下,实现准确率与计算效率双重增益。为探究性能提升机制,采用基于中心核对齐的表示相似性评估框架。结果显示,微调后模型的编码器阶段表示与基线保持高度相似,而中间图处理层则发生显著分化,表明微调保留通用编码器,同时重构消息传递路径以达成更优任务表现。
原文摘要 · Abstract (English)
We introduce a foundation model for event classification in high-energy physics, built on a Graph Neural Network architecture and trained on 120 million simulated proton-proton collision events spanning 12 distinct physics processes. The model is pretrained to learn a general and robust representation of collision data using challenging multiclass and multilabel classification tasks. Its performance is evaluated across seven event classification tasks, which include new physics processes not encountered during pretraining as well as ATLAS Open Data to demonstrate generalizability across different simulation frameworks, from Delphes fast simulation to full ATLAS detector simulation. Fine-tuning the pretrained model significantly improves classification performance, particularly in scenarios with limited training data, demonstrating gains in both accuracy and computational efficiency. To investigate the underlying mechanisms behind these performance improvements, we employ a representational similarity evaluation framework based on Centered Kernel Alignment. This analysis reveals that encoder-stage representations of the fine-tuned model remain similar to those of the baseline, while intermediate graph processing layers diverge substantially, indicating that fine-tuning preserves general-purpose encoders while developing fundamentally different message-passing pathways to arrive at superior task performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。