arXiv:2606.30911cs.AIcs.LG2026-06中稿 · the 5th Workshop o…被引 1

构建分层技能库,让机器学习工程代理复用经验,大幅减少重复试错。

Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering

  • 分三级组织跨竞赛知识:全局、领域、比赛专属,匹配对应智能体层级
  • 相同技能库存下,分层加载实现100%奖牌率,平铺加载仅62.5%
  • 适合追求高效迁移学习的AI工程团队,尤其在资源受限场景

机器学习工程代理因每次竞赛都从零开始而浪费算力。本文提出HASTE,一种分层多智能体系统,将跨竞赛知识分为全局、领域和比赛专属三个层级,每层对应特定智能体。协调器通过大模型驱动的抽象实现层级间知识传递。控制性消融实验显示:固定159项技能,在8个竞赛中,分层加载达成100%奖牌率,平铺加载仅62.5%,与不加载技能持平,且输出令牌量翻倍。在包含22个Kaggle竞赛的MLE-Bench Lite基准上,使用Claude Sonnet 4.6,每竞赛耗时12小时,单种子结果达到77.3%奖牌率;多种子复现是后续重点。冷启动时无积累技能;暖启动可重用前期经验,仅用全局与领域级技能实现跨竞赛迁移。暖启动迭代次数减少52%,智能体保留提议变更的比例从低库存时的42%提升至50+技能时的85%。结果表明,更优的知识组织可部分替代模型强度与算力投入。

原文摘要 · Abstract (English)

ML engineering agents waste compute rediscovering known techniques because every competition is a cold start. We present HASTE, a hierarchical multi-agent system that organizes cross-competition knowledge into three scope tiers (global, domain, and competition-specific), each coupled to a matching agent level. An orchestrator coordinates domain specialists and promotes learning between tiers via LLM-driven abstraction. A controlled ablation provides evidence for scoped loading: holding a 159-skill inventory constant across 8 competitions, tiered loading achieves a 100% medal rate while flat loading reaches only 62.5%, the same medal rate as loading no skills, and consumes 2x the output tokens. On the full MLE-Bench Lite benchmark (22 Kaggle competitions), HASTE reaches a medal rate of 77.3% using Claude Sonnet 4.6 at 12h per competition; this is a single-seed campaign result, and multi-seed replication is the priority follow-up. In a cold-start run, the system begins with no accumulated skills. In warm-start runs, it reloads skills learned from earlier competitions, using only global and domain-level skills for transfer across competitions. Warm starts use 52% fewer refinement iterations, and the fraction of proposed changes kept by the agent rises from 42% at low inventory to 85% once 50+ skills are available. These results suggest that better knowledge organization can partly substitute for model strength and compute budget in ML-engineering agents.

机器学习工程知识迁移智能体系统效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。