arXiv:2601.08280cs.AI2026-01

发现大模型决策中只有少数动作关键,用贪心法高效找出来。

Greedy Is Enough: Sparse Action Discovery in Agentic LLMs

  • 用贪心算法从海量动作中筛选出真正有效的少数关键动作。
  • 只需少量样本即可准确识别关键动作,且误差可控。
  • 适合研究智能体决策优化或想精简复杂系统的人看。

现代智能体系统面临极大规模的动作空间,如拥有数千个可用API的工具增强型语言模型。尽管如此,实证表明在特定部署中仅有少数动作对性能有显著影响。我们基于上下文线性奖励模型,假设动作相关性具有结构化稀疏性:仅少数动作在潜在状态中具有非零效应。将动作发现建模为块稀疏恢复问题,分析一种受正交匹配追踪启发的贪心算法。在标准的无相干性、信号强度和动作覆盖性假设下,证明该贪心过程以高概率精确恢复相关动作集,所需样本数在稀疏度和潜在维度上多项式增长,仅在总动作数上对数增长。进一步提供参数估计误差保证,并证明重构后的决策规则对新潜在状态近似最优。补充的信息论下界表明,稀疏性和充分覆盖是可处理性的必要条件。综合结果揭示稀疏动作发现是大规模决策的核心原则,并为智能体系统中的动作剪枝提供了理论基础。

原文摘要 · Abstract (English)

Modern agentic systems operate in environments with extremely large action spaces, such as tool-augmented language models with thousands of available APIs or retrieval operations. Despite this scale, empirical evidence suggests that only a small subset of actions meaningfully influences performance in a given deployment. Motivated by this observation, we study a contextual linear reward model in which action relevance is governed by a structured sparsity assumption: only a small number of actions have nonzero effects across latent states. We formulate action discovery as a block-sparse recovery problem and analyze a greedy algorithm inspired by Orthogonal Matching Pursuit. Under standard assumptions on incoherence, signal strength, and action coverage, we prove that the greedy procedure exactly recovers the relevant action set with high probability, using a number of samples that scales polynomially in the sparsity level and latent dimension, and only logarithmically in the total number of actions. We further provide estimation error guarantees for refitted parameters and show that the resulting decision rule is near-optimal for new latent states. Complementing these results, we establish information-theoretic lower bounds demonstrating that sparsity and sufficient coverage are necessary for tractability. Together, our results identify sparse action discovery as a fundamental principle underlying large-action decision-making and provide a theoretical foundation for action pruning in agentic systems.

智能体决策稀疏性动作发现理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。