arXiv:2506.13171cs.SEcs.AI2025-06被引 4

用智能体比直接提问更高效地查询汽车软件模型。

Querying Large Automotive Software Models: Agentic vs. Direct LLM Approaches

  • 用智能体+文件工具分步处理模型,避免一次性加载全部内容。
  • 智能体方法在小模型上准确率接近直接提示,但节省90%以上令牌消耗。
  • 适合对隐私和合规要求高的汽车软件开发场景。

大型语言模型(LLMs)为通过自然语言与复杂软件模型交互提供了新可能,尤其适用于难以整体理解的大规模软件模型。本文对比了两种方法:直接提示(将整个模型放入上下文)与基于智能体的方法(结合LLM代理与通用文件访问工具)。实验使用面向汽车与嵌入式领域定时分析和优化的Ecore元模型进行评估。结果表明,尽管智能体方法的准确率与直接提示相当,但在令牌使用上显著更高效。这一效率优势使其特别适合汽车工业中因模型过大而无法采用直接提示的场景,使智能体成为唯一可行方案。值得注意的是,评估基于小型LLM完成,具备本地运行潜力,契合行业对隐私、知识产权保护及合规性的严苛要求。未来工作将拓展至多种格式的软件模型,探索更复杂的代理架构,并将智能体流程延伸至模型修改任务。

原文摘要 · Abstract (English)

Large language models (LLMs) offer new opportunities for interacting with complex software artifacts, such as software models, through natural language. They present especially promising benefits for large software models that are difficult to grasp in their entirety, making traditional interaction and analysis approaches challenging. This paper investigates two approaches for leveraging LLMs to answer questions over software models: direct prompting, where the whole software model is provided in the context, and an agentic approach combining LLM-based agents with general-purpose file access tools. We evaluate these approaches using an Ecore metamodel designed for timing analysis and software optimization in automotive and embedded domains. Our findings show that while the agentic approach achieves accuracy comparable to direct prompting, it is significantly more efficient in terms of token usage. This efficiency makes the agentic approach particularly suitable for the automotive industry, where the large size of software models makes direct prompting infeasible, establishing LLM agents as not just a practical alternative but the only viable solution. Notably, the evaluation was conducted using small LLMs, which are more feasible to be executed locally - an essential advantage for meeting strict requirements around privacy, intellectual property protection, and regulatory compliance. Future work will investigate software models in diverse formats, explore more complex agent architectures, and extend agentic workflows to support not only querying but also modification of software models.

智能体汽车软件大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。