LLM Agent的可用性瓶颈在于能否带来足够回报,而非能否完成任务。
Position: The Real Barrier to LLM Agent Usability is Agentic ROI
- 用'代理投资回报率'重新定义评估标准,关注实际价值。
- 发现日常应用中代理的实用价值远低于高回报领域。
- 提出先扩增再精简的开发路径,提升真实场景可用性。
大型语言模型(LLM)代理代表了人机交互的一次重要转变,从被动的提示-响应系统演进为具备推理、规划和目标导向行动能力的自主代理。尽管LLM代理在技术上能执行广泛任务,但并非所有能力都转化为实际可用性。本文认为,当前的核心问题不再是任务是否可自动化,而是能否带来足够的代理投资回报率(Agentic ROI)。Agentic ROI将评估视角从性能指标转向整体效用驱动,指导代理在何时、何地以及对谁部署更合适。尽管在编码和科研等高回报任务中已有广泛应用,我们识别出在大众市场日常应用中存在显著的可用性差距。为此,我们提出一种‘之’字形发展路径:先规模化以提升信息获取与时间节省,再反向缩小以降低成本。本文还构建了贯穿该路径的战略路线图,旨在使LLM代理在真实世界应用中真正实现可用、可及与可扩展。
原文摘要 · Abstract (English)
Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are technically capable of performing a broad range of tasks, not all of these capabilities translate into meaningful usability. This position paper argues that the central question for LLM agent usability is no longer whether a task can be automated, but whether it delivers sufficient Agentic Return on Investment (Agentic ROI). Agentic ROI reframes evaluation from raw performance to a holistic, utility-driven perspective, guiding when, where, and for whom LLM agents should be deployed. Despite widespread application in high-ROI tasks like coding and scientific research, we identify a critical usability gap in mass-market, everyday applications. To address this, we propose a zigzag developmental trajectory: first scaling up to improve information gain and time savings, then scaling down to reduce cost. We present a strategic roadmap across these phases to make LLM agents truly usable, accessible, and scalable in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。