通过分析模型内部推理过程,提升对大模型欺骗行为的检测能力。
DeceptGuard :A Constitutional Oversight Framework For Detecting Deception in LLM Agents
- 对比三种监控方式,引入内部推理与隐藏状态信号增强检测
- 在9200条真实轨迹上实现0.934的检测性能,显著优于传统方法
- 适合关注AI安全与可解释性的研究人员和开发者
可靠检测大语言模型代理中的欺骗行为,是其在高风险智能体场景中安全部署的前提。现有研究仅依赖观察外部工具调用和输出的黑盒监控,忽略了丰富的内部推理信号。本文提出DECEPTGUARD框架,系统比较三种监控模式:仅限动作与输出的黑盒监控、加入链式思考(CoT)推理轨迹的感知监控,以及读取冻结编码器隐藏状态表示的激活探测监控。我们构建了DECEPTSYNTH合成流水线,生成涵盖12类欺骗形式(包括言语、行为与结构欺骗)的4800条合成轨迹,并在包含9200个未见样本的DeceptArena基准上评估。所有测试中,基于CoT和激活探测的监控均显著优于黑盒方法(平均pAUROC提升+0.097),尤其在隐蔽、长周期且行为痕迹少的欺骗任务中表现突出。我们实证发现透明性与可检测性存在权衡:随着代理抑制明显行为信号,链式思考成为主要检测面,但其可靠性因训练后忠实度下降而减弱。为此提出HYBRID-CONSTITUTIONAL集成策略,实现0.934的测试集pAUROC,大幅超越现有最佳水平。
原文摘要 · Abstract (English)
Reliable detection of deceptive behavior in Large Language Model (LLM) agents is an essential prerequisite for safe deployment in high-stakes agentic contexts. Prior work on scheming detection has focused exclusively on black-box monitors that observe only externally visible tool calls and outputs, discarding potentially rich internal reasoning signals. We introduce DECEPTGUARD, a unified framework that systematically compares three monitoring regimes: black-box monitors (actions and outputs only), CoT-aware monitors (additionally observing the agent's chain-of-thought reasoning trace), and activation-probe monitors (additionally reading hidden-state representations from a frozen open-weights encoder). We introduce DECEPTSYNTH, a scalable synthetic pipeline for generating deception-positive and deception-negative agent trajectories across a novel 12-category taxonomy spanning verbal, behavioral, and structural deception. Our monitors are optimized on 4,800 synthetic trajectories and evaluated on 9,200 held-out samples from DeceptArena, a benchmark of realistic sandboxed agent environments with execution-verified labels. Across all evaluation settings, CoT-aware and activation-probe monitors substantially outperform their black-box counterparts (mean pAUROC improvement of +0.097), with the largest gains on subtle, long-horizon deception that leaves minimal behavioral footprints. We empirically characterize a transparency-detectability trade-off: as agents learn to suppress overt behavioral signals, chain-of-thought becomes the primary detection surface but is itself increasingly unreliable due to post-training faithfulness degradation. We propose HYBRID-CONSTITUTIONAL ensembles as a robust defense-in-depth approach, achieving a pAUROC of 0.934 on the held-out test set, representing a substantial advance over the prior state of the art.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。