arXiv:2602.01709cs.CL2026-02被引 2

让AI在执行前先模拟试错,避免真实环境中的高风险失误。

ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulation

  • 通过仿真模拟在真实执行前测试动作,分离探索与行动
  • 迭代仿真使智能体在多轮任务中可靠性显著提升
  • 针对性生成失败案例,提升对高危动作的识别能力

当前测试时缩放(TTS)技术通过增加推理阶段计算量来提升大语言模型性能,但在智能体场景下仍不足——因动作会直接影响外部环境,且后果可能不可逆、代价高昂。本文提出ARTIS:基于迭代仿真的智能体风险感知测试时缩放框架,通过在真实执行前进行仿真交互来解耦探索与承诺。该设计使推理计算得以扩展,提升动作层面的可靠性与鲁棒性,同时规避环境风险。实验表明,简单基于LLM的仿真器难以捕捉罕见但高影响的故障模式,严重限制其在智能体决策中的有效性。为此,我们引入风险感知工具仿真器,通过针对性数据生成和再平衡训练,强化对引发失败动作的仿真精度。在多轮与多步智能体基准测试中,迭代仿真显著提升了智能体可靠性,且风险感知仿真对跨模型、跨任务稳定实现性能增益至关重要。

原文摘要 · Abstract (English)

Current test-time scaling (TTS) techniques enhance large language model (LLM) performance by allocating additional computation at inference time, yet they remain insufficient for agentic settings, where actions directly interact with external environments and their effects can be irreversible and costly. We propose ARTIS, Agentic Risk-Aware Test-Time Scaling via Iterative Simulation, a framework that decouples exploration from commitment by enabling test-time exploration through simulated interactions prior to real-world execution. This design allows extending inference-time computation to improve action-level reliability and robustness without incurring environmental risk. We further show that naive LLM-based simulators struggle to capture rare but high-impact failure modes, substantially limiting their effectiveness for agentic decision making. To address this limitation, we introduce a risk-aware tool simulator that emphasizes fidelity on failure-inducing actions via targeted data generation and rebalanced training. Experiments on multi-turn and multi-step agentic benchmarks demonstrate that iterative simulation substantially improves agent reliability, and that risk-aware simulation is essential for consistently realizing these gains across models and tasks.

智能体测试时缩放风险感知仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。