基于BERT思想的粒子物理发现模型，提升顶夸克重建精度10%-20%。
Bumblebee: Foundation Model for Particle Physics Discovery
- 用4-矢量嵌入替代位置编码，实现序列无关性建模
- 顶夸克重建分辨率提升10%-20%，对顶夸克态分类准确率0.877
- 适用于新粒子发现等多样任务，适合粒子物理研究者
Bumblebee 是一种受 BERT 启发的粒子物理发现基础模型。通过移除位置编码并直接嵌入粒子4-矢量，该模型在保持生成与重构层面信息的同时，确保序列顺序不变性。在掩码任务上预训练后，其在双轻子顶夸克重建中将分辨率提升10%-20%，并在下游任务中表现优异：顶夸克态识别的AUROC达0.877，初态分类的AUROC为0.625。Bumblebee 的灵活性使其适用于多种粒子物理应用，尤其适合新粒子的探索。
原文摘要 · Abstract (English)
Bumblebee is a foundation model for particle physics discovery, inspired by BERT. By removing positional encodings and embedding particle 4-vectors, Bumblebee captures both generator- and reconstruction-level information while ensuring sequence-order invariance. Pre-trained on a masked task, it improves dileptonic top quark reconstruction resolution by 10-20% and excels in downstream tasks, including toponium discrimination (AUROC 0.877) and initial state classification (AUROC 0.625). The flexibility of Bumblebee makes it suitable for a wide range of particle physics applications, especially the discovery of new particles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。