arXiv:2604.00356cs.AIcs.CL2026-04被引 2

用轻量信号筛选智能体交互轨迹,提升事后优化效率。

Signals: Trajectory Sampling and Triage for Agentic Interactions

  • 通过计算无需调用模型的实时信号,对交互轨迹分类
  • 在τ-bench上实现82%信息量率,效率提升1.52倍
  • 适合部署后优化、偏好数据构建等场景

基于大语言模型的智能体应用依赖多步交互循环,包括规划、执行和环境反馈。尽管这类系统已大规模部署,但部署后的改进仍具挑战性:轨迹数据量大且非确定性强,人工或辅助大模型逐条审查成本过高。本文提出一种轻量级、基于信号的智能体交互轨迹筛选框架。该方法从实时交互中计算低成本、普适性信号,并作为结构化属性附加于轨迹,用于识别可能具有信息量的交互,且不干扰在线行为。信号被组织为粗粒度分类体系,涵盖交互(错位、停滞、脱节、满意)、执行(失败、循环)和环境(耗尽)三类,均可无需模型调用计算。在广泛使用的τ-bench基准上进行控制标注研究,结果表明信号采样相较启发式过滤(74%)和随机采样(54%)达到82%的信息量率,每条有信息轨迹的效率提升1.52倍。该优势在不同奖励层级与任务领域间均稳定存在,证明信号带来真实轨迹层面的信息增益,而非仅放大明显失败案例。结果表明,轻量信号可作为智能体系统的实用采样基础设施,为偏好数据构建与部署后优化提供可行路径。

原文摘要 · Abstract (English)

Agentic applications based on large language models increasingly rely on multi-step interaction loops involving planning, action execution, and environment feedback. While such systems are now deployed at scale, improving them post-deployment remains challenging. Agent trajectories are voluminous and non-deterministic, and reviewing each one, whether through human review or auxiliary LLMs, is slow and cost-prohibitive. We propose a lightweight, signal-based framework for triaging agentic interaction trajectories. Our approach computes cheap, broadly applicable signals from live interactions and attaches them as structured attributes for trajectory triage, identifying interactions likely to be informative without affecting online agent behavior. We organize signals into a coarse-grained taxonomy spanning interaction (misalignment, stagnation, disengagement, satisfaction), execution (failure, loop), and environment (exhaustion), designed for computation without model calls. In a controlled annotation study on $τ$-bench, a widely used benchmark for tool-augmented agent evaluation, we show that signal-based sampling achieves an 82\% informativeness rate compared to 74\% for heuristic filtering and 54\% for random sampling, with a 1.52x efficiency gain per informative trajectory. The advantage is robust across reward strata and task domains, confirming that signals provide genuine per-trajectory informativeness gains rather than merely oversampling obvious failures. These results show that lightweight signals can serve as practical sampling infrastructure for agentic systems, and suggest a path toward preference data construction and post-deployment optimization.

智能体系统轨迹筛选后部署优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。