arXiv:2609.05992cs.AIcs.LG2026-09

用帕累托保留策略优化智能体多目标表现,不预设权重也能兼顾效率与安全。

MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search

论文配图:MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search
图 1 · 摘自论文原文
  • 基于非支配解集的进化搜索,避免单一评分合并多目标。
  • 在旅行规划和AgentDojo任务中提升任务完成率与交互质量。
  • 无需参数更新,适合想平衡多个性能指标的研究者使用。

随着大模型智能体的发展,其评估日趋多维:高效能不仅要求高任务完成率,还需兼顾交互质量、安全性与效率。现有方法常将异构指标简化为固定标量分数,依赖归一化与偏好权重,易丢失有价值的权衡方案。本文提出多目标智能体演化(MOAE),将上下文迭代优化建模为对完整智能体轨迹的帕累托保留进化搜索。在有限轨迹预算下,MOAE维护非支配候选集,利用各目标诊断引导后代生成,并仅在部署时采用约束感知选择。该设计将搜索过程中的候选保留与最终决策偏好分离。方法无需参数更新,可任意替换目标为可观测属性,本文实例化为任务表现、轨迹质量与安全。在TravelPlanner与AgentDojo上的实验表明,MOAE在匹配轨迹预算下持续提升任务完成率与轨迹质量,同时保持强安全性。行为分析显示,帕累托保留扩大了可达成的目标区域,提升了联合改进频率。结果验证了帕累托保留的上下文演化在不预设标量化的情况下优化多属性智能体的潜力。

原文摘要 · Abstract (English)

As LLM-based agents continue to advance, their evaluation has become increasingly multifaceted: a capable agent must not only achieve high task completion accuracy but also perform well in interaction quality, safety, and efficiency, raising a central question: can these objectives be optimized simultaneously? Existing methods have considered multiple objectives, but many collapse heterogeneous measurements into a fixed scalar score. Such scalarization depends on metric normalization and preference weights and may discard candidates that represent useful deployment trade-offs. We introduce Multi-Objective Agent Evolution (MOAE), which organizes iterative in-context refinement as a Pareto-preserving evolutionary search over complete agent rollouts. Given a limited rollout budget, MOAE maintains an empirical archive of non-dominated candidates, uses objective-specific diagnostics to guide offspring generation, and applies constraint-aware selection only at deployment. This separates candidate preservation during search from the preference used to return a final solution. The procedure requires no parameter updates and allows each objective to be replaced by any measurable property, which we instantiate as task performance, trajectory quality, and safety. Experiments on TravelPlanner and AgentDojo show that MOAE consistently improves task performance and trajectory quality while maintaining strong safety under matched rollout budgets. Search-behavior analysis further shows that Pareto preservation expands the attainable objective region and increases the frequency of joint improvement. These results demonstrate the potential of Pareto-preserving in-context evolution for optimizing multiple agent properties without committing to a fixed scalarization during search.

智能体演化多目标优化帕累托前沿大模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。