arXiv:2601.17215cs.LGhep-ex2026-01被引 15

JetFormer统一了高精度与低延迟的喷注识别,适合从离线分析到FPGA触发全场景部署。

JetFormer: A Scalable and Efficient Transformer for Jet Tagging from Offline Analysis to FPGA Triggers

  • 基于编码器仅结构处理可变长度粒子特征,无需显式对间交互
  • 在JetClass上精度接近ParT但计算量少37.4%,在HLS4ML上准确率提升3-4%
  • 支持硬件优化压缩,可部署于亚微秒级响应的FPGA触发系统

我们提出JetFormer,一种适用于大型强子对撞机(LHC)喷注识别的通用且可扩展的编码器仅Transformer架构。与以往针对特定部署场景设计的方法不同,JetFormer可在高精度离线分析到超低延迟在线触发的全链条中有效运行。该模型处理可变长度的粒子特征集合,无需显式对间交互,性能仍达到或优于现有最优方法。在大规模JetClass数据集上,大尺寸JetFormer精度与交互丰富的ParT模型相差仅0.7%,但计算量减少37.4%;在基准HLS4ML 150P数据集上,其准确率比MLP、Deep Sets和交互网络高出3-4%。为实现硬件部署,我们引入基于多目标超参数搜索的硬件感知优化流程,生成如JetFormer-tiny等紧凑版本,适用于要求亚微秒级延迟的FPGA触发系统。通过结构化剪枝与量化,证明其可大幅压缩而保持极小精度损失。通过在一个框架内统一高性能建模与可部署性,JetFormer为LHC中基于Transformer的喷注识别提供了实用路径。代码已开源:https://github.com/walkieq/JetFormer。

原文摘要 · Abstract (English)

We present JetFormer, a versatile and scalable encoder-only Transformer architecture for particle jet tagging at the Large Hadron Collider (LHC). Unlike prior approaches that are often tailored to specific deployment regimes, JetFormer is designed to operate effectively across the full spectrum of jet tagging scenarios, from high-accuracy offline analysis to ultra-low-latency online triggering. The model processes variable-length sets of particle features without relying on input of explicit pairwise interactions, yet achieves competitive or superior performance compared to state-of-the-art methods. On the large-scale JetClass dataset, a large-scale JetFormer matches the accuracy of the interaction-rich ParT model (within 0.7%) while using 37.4% fewer FLOPs, demonstrating its computational efficiency and strong generalization. On benchmark HLS4ML 150P datasets, JetFormer consistently outperforms existing models such as MLPs, Deep Sets, and Interaction Networks by 3-4% in accuracy. To bridge the gap to hardware deployment, we further introduce a hardware-aware optimization pipeline based on multi-objective hyperparameter search, yielding compact variants like JetFormer-tiny suitable for FPGA-based trigger systems with sub-microsecond latency requirements. Through structured pruning and quantization, we show that JetFormer can be aggressively compressed with minimal accuracy loss. By unifying high-performance modeling and deployability within a single architectural framework, JetFormer provides a practical pathway for deploying Transformer-based jet taggers in both offline and online environments at the LHC. Code is available at https://github.com/walkieq/JetFormer.

喷注识别TransformerFPGA部署高能物理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。