arXiv:2608.17718cs.AI2026-08

提出轨迹前缀的本体信任机制,实时监控长时序智能体是否偏离用户授权目标。

Beyond Suspicious Steps: Ontological Trust in Long-Horizon Agents

论文配图:Beyond Suspicious Steps: Ontological Trust in Long-Horizon Agents
图 1 · 摘自论文原文
  • 定义本体信任,分解为角色、目标、证据三维度在线监测轨迹偏移
  • 在多个基准上对漂移检测达93%以上F1值,良性任务覆盖超95.8%
  • 输出可回放可审计的信任轨迹,适合高风险长时序决策系统使用

长时序智能体在多步骤、多工具和多观测环境下运行,其监督重点不仅是单步动作的局部合规性,更在于整个轨迹前缀是否仍符合用户授权的任务。漂移可能悄然累积:尽管每一步调用工具的理由看似合理,但前缀整体却逐渐偏离原定目标,转向更广义角色、相邻目标或用户未提供的证据。现有监控机制多仅检查局部合规、给出最终判断或评分通用风险,无法直接评估前缀层面的关联性。本文提出本体信任(ontological trust),一种任务条件下的轨迹前缀属性,并实现为RGE——一个在线监控器,将信任分解为角色(Role)、目标(Goal)和证据(Evidence)。RGE仅用大模型生成结构化任务与步骤表示,信任状态更新、投影及干预决策均为确定性计算,因此输出的是可回放、可审计的信任轨迹,而非单一终局判决。我们构建了来自OSWorld、FinanceBench和EICU-AC的跨领域轨迹语料库,涵盖正常执行、前缀配对漂移和伪一致性失败。在该语料上,RGE在前缀漂移检测中优于适配的规则、判别与防护型基线;采用两个较大估计器模型时,所有基准漂移检测F1均超93%,良性任务覆盖率保持在95.8%以上。伪一致性检测更具挑战,其效果取决于任务完成是否外部可见,这一结构性限制通过实证分析得以揭示。

原文摘要 · Abstract (English)

Long-horizon agents increasingly operate across many steps, tools, and observa- tions. In this setting, the relevant oversight question is not only whether each action is locally valid, but whether the evolving trajectory still corresponds to the task the user authorized. Drift can accumulate quietly: an agent may call the right tool with plausible arguments at every step, while its prefix moves toward a broader role, an adjacent objective, or evidence the user never supplied. Existing monitors mostly check local compliance, deliver final-trace verdicts, or score generic risk; they do not directly estimate this prefix-level relation. We introduce ontological trust, a task-conditioned property of trajectory prefixes, and instantiate it as RGE, an online monitor that decomposes trust along Role, Goal, and Evidence. RGE uses LLMs only to derive structured task and step representations; trust-state updates, projec- tions, and intervention decisions are deterministic, so the output is a replayable and auditable trust trajectory rather than a single end-to-end judge verdict. We construct a cross-domain trajectory corpus from OSWorld, FinanceBench, and EICU-AC, covering benign executions, prefix-paired drift, and pseudo-consistency failures. On this corpus, RGE outperforms adapted rule-, judge-, and shield-style baselines on prefix-paired drift detection. With the two larger estimator models, it exceeds 93% Drift F1 on every benchmark while keeping benign coverage at or above 95.8%. Pseudo-consistency is harder: detection depends on whether task completion is externally visible, a structural limit we characterize empirically.

信任监控长时序代理轨迹检测LLM安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。