arXiv:2602.05883cs.AI2026-02中稿 · Artificial Intelli…被引 3

指导如何在建模与仿真中正确使用大语言模型,避免常见陷阱。

A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challenges

  • 强调基于原理的设计选择,而非盲目调参或加数据。
  • 指出温度设为0仍不保证确定性,微调前需评估模型已有知识。
  • 适合建模者、仿真研究人员及想高效使用LLM的实践者。

大语言模型(LLMs)已广泛应用于建模与仿真(M&S)工作流程,但看似简单的操作可能引入隐蔽问题、增加复杂性甚至导致性能下降。例如,盲目增加数据可能导致模型崩溃或破坏现有约束;未评估模型已有知识即进行微调可能浪费资源;将温度设为0不足以确保输出确定性;过多输入仿真数据反而无效,因LLMs无法处理全部信息。本文旨在为M&S场景下的LLM使用提供全面实用指南,涵盖非确定性、知识增强(如RAG和LoRA)、M&S数据分解及超参数设置等常见困惑点,强调基于原则的设计、诊断策略与实证评估,帮助建模者明确何时、如何、是否应依赖LLM。

原文摘要 · Abstract (English)

Large language models (LLMs) have rapidly become familiar tools to researchers and practitioners. Concepts such as prompting, temperature, or few-shot examples are now widely recognized, and LLMs are increasingly used in Modeling & Simulation (M&S) workflows. However, practices that appear straightforward may introduce subtle issues, unnecessary complexity, or may even lead to inferior results. Adding more data can backfire (e.g., deteriorating performance through model collapse or inadvertently wiping out existing guardrails), spending time on fine-tuning a model can be unnecessary without a prior assessment of what it already knows, setting the temperature to 0 is not sufficient to make LLMs deterministic, providing a large volume of M&S data as input can be excessive (LLMs cannot attend to everything) but naive simplifications can lose information. We aim to provide comprehensive and practical guidance on how to use LLMs, with an emphasis on M&S applications. We discuss common sources of confusion, including non-determinism, knowledge augmentation (including RAG and LoRA), decomposition of M&S data, and hyper-parameter settings. We emphasize principled design choices, diagnostic strategies, and empirical evaluation, with the goal of helping modelers make informed decisions about when, how, and whether to rely on LLMs.

大模型建模仿真提示工程RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。