arXiv:2501.05515cs.LGcond-mat.mtrl-sci2025-01被引 7

自动设计高效物理计算模型,兼顾精度与速度

Neural Architecture Codesign for Fast Physics Applications

  • 两阶段搜索:先全局找架构,再局部优化压缩
  • 在材料与高能物理任务中实现更高精度和更低延迟
  • 适合无机器学习背景的物理研究者快速部署

我们提出一种流水线方法,用于加速物理应用中的神经架构协同设计,降低对机器学习专业知识的需求。该方法采用两阶段策略:第一阶段进行全局搜索,考虑硬件约束探索广泛架构;第二阶段对最优候选模型进行局部微调与压缩。通过量化感知训练和神经网络剪枝等技术,进一步提升推理速度。最终利用hls4ml将最优模型转化为FPGA可用的高层次综合代码。所提出的分层搜索空间具备更强灵活性,可轻松拓展至其他任务与领域。我们在材料科学的Bragg峰定位与高能物理的喷注分类两个案例中验证了有效性,相较基线模型实现了更高的准确率、更短延迟或更低资源占用。

原文摘要 · Abstract (English)

We develop a pipeline to streamline neural architecture codesign for physics applications to reduce the need for ML expertise when designing models for novel tasks. Our method employs neural architecture search and network compression in a two-stage approach to discover hardware efficient models. This approach consists of a global search stage that explores a wide range of architectures while considering hardware constraints, followed by a local search stage that fine-tunes and compresses the most promising candidates. We exceed performance on various tasks and show further speedup through model compression techniques such as quantization-aware-training and neural network pruning. We synthesize the optimal models to high level synthesis code for FPGA deployment with the hls4ml library. Additionally, our hierarchical search space provides greater flexibility in optimization, which can easily extend to other tasks and domains. We demonstrate this with two case studies: Bragg peak finding in materials science and jet classification in high energy physics, achieving models with improved accuracy, smaller latencies, or reduced resource utilization relative to the baseline models.

神经架构搜索物理模拟FPGA部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。