让大模型系统把决策显式分离,更可靠可控。
Decision-Centric Design for LLM Systems
- 将决策信号与执行策略解耦,形成独立可查的决策层
- 实验显示无效动作减少,任务成功率提升,失败原因可定位
- 适合需要高可靠性、可调试的工业级大模型应用
大模型系统不仅需生成输出,还需做出是否回答、澄清、检索、调用工具、修复或升级等控制决策。当前多数架构中这些决策隐含在生成过程中,导致评估与执行纠缠,故障难以排查、约束或修复。本文提出一种决策中心框架,将决策相关信号与映射至行动的策略分离,使控制成为系统中显式且可检查的层级。该分离支持将失败归因于信号估计、决策策略或执行环节,并允许模块化优化各组件。该框架统一了路由、自适应推理等单步场景,自然扩展至序列决策场景(动作改变可用信息)。在三个受控实验中,该框架显著减少无效操作,提升任务成功率,并揭示可解释的失败模式。更广泛地,它为构建更可靠、可控、可诊断的大模型系统提供了通用架构原则。
原文摘要 · Abstract (English)
LLM systems must make control decisions in addition to generating outputs: whether to answer, clarify, retrieve, call tools, repair, or escalate. In many current architectures, these decisions remain implicit within generation, entangling assessment and action in a single model call and making failures hard to inspect, constrain, or repair. We propose a decision-centric framework that separates decision-relevant signals from the policy that maps them to actions, turning control into an explicit and inspectable layer of the system. This separation supports attribution of failures to signal estimation, decision policy, or execution, and enables modular improvement of each component. It unifies familiar single-step settings such as routing and adaptive inference, and extends naturally to sequential settings in which actions alter the information available before acting. Across three controlled experiments, the framework reduces futile actions, improves task success, and reveals interpretable failure modes. More broadly, it offers a general architectural principle for building more reliable, controllable, and diagnosable LLM systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。