arXiv:2601.22571cs.AI2026-01中稿 · ICLR

让AI生成图像时更靠谱:自动评估工具性能,避免失败

PerfGuard: A Performance-Aware Agent for Visual Content Generation

  • 用多维度评分代替模糊描述,精准判断工具好坏
  • 实测显示工具选择准确率提升23%,执行成功率更高
  • 适合需要稳定输出的AI作图任务,如设计、影视创作

大型语言模型驱动的智能体已能通过推理与工具调用实现自动化任务处理。然而现有框架常假设工具调用必然成功,仅依赖文本描述,无法区分工具的实际性能边界,也无法适应工具迭代更新。这一差距在视觉内容生成(AIGC)领域尤为突出,细微的工具性能差异会显著影响输出结果。为此,我们提出PerfGuard,一种面向视觉内容生成的性能感知智能体框架,系统建模工具性能边界,并将其融入任务规划与调度。该框架包含三个核心机制:(1) 性能感知选择建模(PASM),以细粒度性能评估为基础,构建多维评分系统替代通用描述;(2) 自适应偏好更新(APU),通过对比理论排名与实际执行排名动态优化工具选择;(3) 能力对齐规划优化(CAPO),引导规划器生成与性能感知策略一致的子任务。实验表明,PerfGuard在工具选择准确率、执行可靠性及用户意图对齐方面均优于现有方法,验证了其在复杂AIGC任务中的鲁棒性与实用性。项目代码已开源:https://github.com/FelixChan9527/PerfGuard。

原文摘要 · Abstract (English)

The advancement of Large Language Model (LLM)-powered agents has enabled automated task processing through reasoning and tool invocation capabilities. However, existing frameworks often operate under the idealized assumption that tool executions are invariably successful, relying solely on textual descriptions that fail to distinguish precise performance boundaries and cannot adapt to iterative tool updates. This gap introduces uncertainty in planning and execution, particularly in domains like visual content generation (AIGC), where nuanced tool performance significantly impacts outcomes. To address this, we propose PerfGuard, a performance-aware agent framework for visual content generation that systematically models tool performance boundaries and integrates them into task planning and scheduling. Our framework introduces three core mechanisms: (1) Performance-Aware Selection Modeling (PASM), which replaces generic tool descriptions with a multi-dimensional scoring system based on fine-grained performance evaluations; (2) Adaptive Preference Update (APU), which dynamically optimizes tool selection by comparing theoretical rankings with actual execution rankings; and (3) Capability-Aligned Planning Optimization (CAPO), which guides the planner to generate subtasks aligned with performance-aware strategies. Experimental comparisons against state-of-the-art methods demonstrate PerfGuard's advantages in tool selection accuracy, execution reliability, and alignment with user intent, validating its robustness and practical utility for complex AIGC tasks. The project code is available at https://github.com/FelixChan9527/PerfGuard.

AIGC智能体性能评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。