arXiv:2504.02280cs.NEcs.CV2025-04被引 9

用大模型引导进化,自动优化目标检测模型性能。

LLM-Guided Evolution: An Autonomous Model Optimization for Object Detection

  • 让大模型直接修改代码,智能驱动模型演化。
  • 在KITTI数据集上将准确率从92.5%提升至94.5%。
  • 适合想自动化改进检测模型的研究者和工程师。

在机器学习中,神经架构搜索(NAS)需要领域知识和大量试错才能获得良好性能。传统进化算法依赖固定规则和预定义模块。本文提出的大型语言模型引导进化(LLM-GE)框架通过引入大模型,直接修改图像分类算法的源代码,并智能指导突变与交叉操作。关键创新在于“思维演化”(EoT)机制,建立反馈循环,使大模型能基于前序操作表现迭代优化决策。本研究将LLM-GE拓展至目标检测任务,改进YOLO模型架构以提升在KITTI数据集上的性能。方法智能调整YOLO的设计与参数,实现检测精度与速度的平衡。实验表明,LLM-GE生成的变体显著提升性能,如平均精度均值(mAP)从92.5%增至94.5%。结果验证了该框架在真实场景中的灵活性与有效性,为融合大模型推理与进化策略的自动化机器学习提供了新范式。

原文摘要 · Abstract (English)

In machine learning, Neural Architecture Search (NAS) requires domain knowledge of model design and a large amount of trial-and-error to achieve promising performance. Meanwhile, evolutionary algorithms have traditionally relied on fixed rules and pre-defined building blocks. The Large Language Model (LLM)-Guided Evolution (GE) framework transformed this approach by incorporating LLMs to directly modify model source code for image classification algorithms on CIFAR data and intelligently guide mutations and crossovers. A key element of LLM-GE is the "Evolution of Thought" (EoT) technique, which establishes feedback loops, allowing LLMs to refine their decisions iteratively based on how previous operations performed. In this study, we perform NAS for object detection by improving LLM-GE to modify the architecture of You Only Look Once (YOLO) models to enhance performance on the KITTI dataset. Our approach intelligently adjusts the design and settings of YOLO to find the optimal algorithms against objective such as detection accuracy and speed. We show that LLM-GE produced variants with significant performance improvements, such as an increase in Mean Average Precision from 92.5% to 94.5%. This result highlights the flexibility and effectiveness of LLM-GE on real-world challenges, offering a novel paradigm for automated machine learning that combines LLM-driven reasoning with evolutionary strategies.

自动化模型优化大模型目标检测进化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。