arXiv:2512.07785physics.data-ancs.AI2025-12被引 22

用大模型代理自动完成高能物理数据分析,实现代码自动生成与迭代修正。

Automating High Energy Physics Data Analysis with LLM-Powered Agents

  • 构建大模型代理+工作流管理器的混合系统,自主生成并修正分析代码。
  • 在ATLAS开放数据上完成希格斯玻色子二光子衰变测量,成功率达90%以上。
  • 首次建立可复现的高能物理自动化分析框架,适合科研人员和算法评估者参考。

我们展示了一项原理验证研究,利用大语言模型(LLM)代理自动化高能物理(HEP)典型分析任务。以希格斯玻色子二光子衰变截面测量为例,基于ATLAS开放数据,设计了一个结合LLM驱动的监督-编码代理与Snakemake工作流管理器的混合系统。在此架构中,工作流管理器确保分析步骤的可复现性和确定性,而代理则根据用户指令自主生成、执行并迭代修正分析代码。我们定义了成功率、错误分布、每项任务成本及平均API调用次数等量化评估指标,用于衡量多阶段工作流中的代理性能。为评估不同架构的差异,我们对主流LLM进行了基准测试,涵盖Gemini和GPT-5系列、Claude家族以及领先开源模型。尽管工作流管理器保证了所有分析步骤的确定性执行,最终输出仍存在随机性波动。即使将温度设为零,其他采样参数(如top-p、top-k)仍保持默认值,且部分推理导向模型会内部调整这些设置,导致模型无法产生完全确定的结果。本研究建立了首个基于LLM代理的高能物理自动化数据分析框架,支持在真实科学计算环境中系统评估模型能力、稳定性和局限性。本研究使用的基准代码已公开于https://huggingface.co/HWresearch/LLM4HEP。该工作已被NeurIPS 2025机器学习与物理科学研讨会(ML4PS)接受为海报展示,初稿提交时间为2025年8月30日。

原文摘要 · Abstract (English)

We present a proof-of-principle study demonstrating the use of large language model (LLM) agents to automate a representative high energy physics (HEP) analysis. Using the Higgs boson diphoton cross-section measurement as a case study with ATLAS Open Data, we design a hybrid system that combines an LLM-based supervisor-coder agent with the Snakemake workflow manager. In this architecture, the workflow manager enforces reproducibility and determinism, while the agent autonomously generates, executes, and iteratively corrects analysis code in response to user instructions. We define quantitative evaluation metrics including success rate, error distribution, costs per specific task, and average number of API calls, to assess agent performance across multi-stage workflows. To characterize variability across architectures, we benchmark a representative selection of state-of-the-art LLMs spanning the Gemini and GPT-5 series, the Claude family, and leading open-weight models. While the workflow manager ensures deterministic execution of all analysis steps, the final outputs still show stochastic variation. Although we set the temperature to zero, other sampling parameters (e.g., top-p, top-k) remained at their defaults, and some reasoning-oriented models internally adjust these settings. Consequently, the models do not produce fully deterministic results. This study establishes the first LLM-agent-driven automated data-analysis framework in HEP, enabling systematic benchmarking of model capabilities, stability, and limitations in real-world scientific computing environments. The baseline code used in this work is available at https://huggingface.co/HWresearch/LLM4HEP. This work was accepted as a poster at the Machine Learning and the Physical Sciences (ML4PS) workshop at NeurIPS 2025. The initial submission was made on August 30, 2025.

大模型代理高能物理自动化分析科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。