arXiv:2602.10133cs.SEcs.AI2026-02被引 15

为大模型智能体设计动态可观测框架,解决安全审计难题

AgentTrace: A Structured Logging Framework for Agent System Observability

  • 运行时注入轻量探针,捕获操作、认知与上下文三类结构化日志
  • 支持持续追踪智能体推理过程,实现风险分析与信任校准
  • 适合高安全要求场景下的智能体部署与实时监控

尽管由大语言模型驱动的自主智能体能力日益增强,其在高风险领域的应用仍受限。主要障碍在于安全:大语言模型智能体固有的非确定性行为,使得传统静态审计方法难以适用。现有安全手段如代理层输入过滤和模型透明化,无法充分揭示智能体的推理过程、状态变化或环境交互。本文提出AgentTrace,一种动态可观测性与遥测框架,通过极低开销的运行时注入,捕获操作、认知与上下文三个层面的丰富结构化日志。不同于传统日志系统,AgentTrace强调持续可回溯的追踪能力,不仅用于调试或基准测试,更作为智能体安全、问责与实时监控的基础层。研究显示,AgentTrace能提升智能体部署可靠性,实现细粒度风险分析,并支持可信度校准,有效缓解长期制约大模型智能体在敏感环境中应用的核心问题。

原文摘要 · Abstract (English)

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies static auditing approaches that have historically underpinned software assurance. Existing security methods, such as proxy-level input filtering and model glassboxing, fail to provide sufficient transparency or traceability into agent reasoning, state changes, or environmental interactions. In this work, we introduce AgentTrace, a dynamic observability and telemetry framework designed to fill this gap. AgentTrace instruments agents at runtime with minimal overhead, capturing a rich stream of structured logs across three surfaces: operational, cognitive, and contextual. Unlike traditional logging systems, AgentTrace emphasizes continuous, introspectable trace capture, designed not just for debugging or benchmarking, but as a foundational layer for agent security, accountability, and real-time monitoring. Our research highlights how AgentTrace can enable more reliable agent deployment, fine-grained risk analysis, and informed trust calibration, thereby addressing critical concerns that have so far limited the use of LLM agents in sensitive environments.

智能体可观测性安全审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。