用少量新数据微调旧模型,快速适配新探测器粒子重建。
Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliders
- 先在一种探测器上预训练,再用少量新数据微调,实现跨探测器迁移。
- 仅需10万条新数据,性能就接近从头训练百万数据的水平。
- 适合需要快速迭代探测器设计的高能物理研究者。
本文展示了机器学习算法在高能对撞机粒子流重建中的迁移学习能力。研究采用跨探测器微调策略:首先在紧凑线性对撞机(CLICdet)的全仿真数据集上预训练模型,随后在用于正负电子模式未来环形对撞机(CLD)的模拟数据上进行微调。结果表明,仅需原训练量的十分之一样本,即可达到与从头训练相当的性能,涵盖粒子级和事件级指标,包括喷注和缺失横向动量分辨率。微调模型在10万条CLD事件后,事件级性能已可媲美传统规则驱动的粒子流方法;而从头训练则至少需100万条数据才能达到相似效果。据我们所知,这是首个基于全仿真数据的粒子流重建跨探测器迁移学习研究。该成果为构建可跨探测器微调的大型基础模型提供了关键支持,有助于加速新型探测器开发周期,推动机器学习在探测器设计与优化中的快速应用。
原文摘要 · Abstract (English)
We demonstrate transfer learning capabilities in a machine-learned algorithm trained for particle-flow reconstruction in high energy particle colliders. This paper presents a cross-detector fine-tuning study, where we initially pretrain the model on a large full simulation dataset from one detector design, and subsequently fine-tune the model on a sample with a different collider and detector design. Specifically, we use the Compact Linear Collider detector (CLICdet) model for the initial training set and demonstrate successful knowledge transfer to the CLIC-like detector (CLD) proposed for the Future Circular Collider in electron-positron mode. We show that with an order of magnitude less samples from the second dataset, we can achieve the same performance as a costly training from scratch, across particle-level and event-level performance metrics, including jet and missing transverse momentum resolution. Furthermore, we find that the fine-tuned model achieves comparable performance to the traditional rule-based particle-flow approach on event-level metrics after training on 100,000 CLD events, whereas a model trained from scratch requires at least 1 million CLD events to achieve similar reconstruction performance. To our knowledge, this represents the first full-simulation cross-detector transfer learning study for particle-flow reconstruction. These findings offer valuable insights towards building large foundation models that can be fine-tuned across different detector designs and geometries, helping to accelerate the development cycle for new detectors and opening the door to rapid detector design and optimization using machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。