提出可调控的主动干预框架,让智能体知何时说、何时沉默。
PRISM: Festina Lente Proactivity -- Risk-Sensitive, Uncertainty-Aware Deliberation for Proactive Agents
- 用决策理论设计开关机制,按风险成本判断是否介入
- 仅在关键不确定场景启用深度推理,节省计算资源22.78%
- 适合需要高精度与可控性的实际部署场景
主动智能体不仅要决定说什么,还需判断何时介入。现有系统多依赖脆弱启发式或盲目长推理,难以平衡收益与负担。本文提出PRISM框架,将问题建模为代价敏感的选择性干预,结合决策论门控与双过程推理架构。推理时,仅当用户接受概率超过由误失帮助与误报成本决定的阈值时才介入。受拉丁谚语'Festina Lente'(欲速则不达)启发,系统通过校准接受率的代价阈值进行门控,仅在决策边界附近启用资源密集型的慢模式并执行反事实检查,集中计算于模糊且高风险情境。训练采用门控对齐、模式锁定的蒸馏:教师运行完整PRISM流程,对未标注交互轨迹提供密集可执行监督;学生则学习解耦干预门控的响应策略,实现可调且可审计的控制。在ProactiveBench基准上,PRISM将误报率降低22.78%,F1提升20.14%。结果表明,基于原则的决策门控、选择性慢推理与对齐蒸馏相结合,可生成精确、高效且可控的主动智能体。为促进复现,代码、模型与资源已公开于https://prism-festinalente.github.io/,所有实验均使用开源ProactiveBench基准。
原文摘要 · Abstract (English)
Proactive agents must decide not only what to say but also whether and when to intervene. Many current systems rely on brittle heuristics or indiscriminate long reasoning, which offers little control over the benefit-burden tradeoff. We formulate the problem as cost-sensitive selective intervention and present PRISM, a novel framework that couples a decision-theoretic gate with a dual-process reasoning architecture. At inference time, the agent intervenes only when a calibrated probability of user acceptance exceeds a threshold derived from asymmetric costs of missed help and false alarms. Inspired by festina lente (Latin: "make haste slowly"), we gate by an acceptance-calibrated, cost-derived threshold and invoke a resource-intensive Slow mode with counterfactual checks only near the decision boundary, concentrating computation on ambiguous and high-stakes cases. Training uses gate-aligned, schema-locked distillation: a teacher running the full PRISM pipeline provides dense, executable supervision on unlabeled interaction traces, while the student learns a response policy that is explicitly decoupled from the intervention gate to enable tunable and auditable control. On ProactiveBench, PRISM reduces false alarms by 22.78% and improves F1 by 20.14% over strong baselines. These results show that principled decision-theoretic gating, paired with selective slow reasoning and aligned distillation, yields proactive agents that are precise, computationally efficient, and controllable. To facilitate reproducibility, we release our code, models, and resources at https://prism-festinalente.github.io/; all experiments use the open-source ProactiveBench benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。