arXiv:2601.18226cs.AI2026-01被引 3

让智能体在无监督下持续自我进化,自动学习新工具应对未知任务。

Yunjue Agent Tech Report: A Fully Reproducible, Zero-Start In-Situ Self-Evolving Agent System for Open-Ended Tasks

  • 通过实时任务反馈动态生成和优化工具,实现无监督自演化。
  • 零起点设置下五项基准测试性能显著超越现有系统。
  • 支持知识迁移,适合长期自主运行的智能系统研究者。

传统智能体系统在任务分布持续变化、缺乏外部监督的开放环境中表现不佳,因其依赖静态工具集或离线训练,能力边界僵化且不可知。为此,我们提出在位自演化范式,将连续任务交互视为经验流,无需真实标签即可将短期执行反馈提炼为长期可复用的能力。在此框架下,我们识别出工具演化是能力扩展的关键路径,提供可验证的二值反馈信号。基于此,我们构建了Yunjue Agent系统,通过迭代合成、优化与复用工具来应对新挑战。为提升演化效率,进一步引入并行批量演化策略。在五个不同基准上的零起点实测表明,该系统性能显著优于专有基线;附加的暖启动评估也证实积累的通用知识可无缝迁移到新领域。最后,我们提出一种新型演化收敛监测指标,功能类似传统优化中的训练损失。代码、系统轨迹及演化工具已开源,以推动韧性自演化智能的研究。

原文摘要 · Abstract (English)

Conventional agent systems often struggle in open-ended environments where task distributions continuously drift and external supervision is scarce. Their reliance on static toolsets or offline training lags behind these dynamics, leaving the system's capability boundaries rigid and unknown. To address this, we propose the In-Situ Self-Evolving paradigm. This approach treats sequential task interactions as a continuous stream of experience, enabling the system to distill short-term execution feedback into long-term, reusable capabilities without access to ground-truth labels. Within this framework, we identify tool evolution as the critical pathway for capability expansion, which provides verifiable, binary feedback signals. Within this framework, we develop Yunjue Agent, a system that iteratively synthesizes, optimizes, and reuses tools to navigate emerging challenges. To optimize evolutionary efficiency, we further introduce a Parallel Batch Evolution strategy. Empirical evaluations across five diverse benchmarks under a zero-start setting demonstrate significant performance gains over proprietary baselines. Additionally, complementary warm-start evaluations confirm that the accumulated general knowledge can be seamlessly transferred to novel domains. Finally, we propose a novel metric to monitor evolution convergence, serving as a function analogous to training loss in conventional optimization. We open-source our codebase, system traces, and evolved tools to facilitate future research in resilient, self-evolving intelligence.

智能体自演化零样本工具学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。