arXiv:2504.06006cs.LGcs.AI2025-04ICCV被引 28

用LLM替代传统调参工具,更快更省资源地优化视觉模型超参数。

Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?

  • 用LoRA微调Code Llama生成超参数建议,避免大量试错。
  • 在分类、检测、分割任务上表现优于或媲美Optuna,RMSE更低。
  • 适合需要低延迟和高感知质量的图像处理应用,结果开源可复现。

神经网络在计算机视觉中的性能高度依赖于超参数的最优选择,尤其当架构日益复杂时。本文探索使用大语言模型(LLMs)进行超参数优化,通过LoRA微调参数高效的Code Llama版本,生成准确且计算高效的新超参数推荐方案。与依赖资源密集型试错的传统方法(如Optuna)不同,该方法在多种视觉架构上实现了竞争性或更优的均方根误差(RMSE),同时显著降低计算开销。评估覆盖图像分类、检测、分割等核心任务,这些是图像增强、修复与风格迁移等流水线的关键组成部分。结果表明,基于LLM的优化不仅媲美树状结构贝叶斯估计器(TPE)等经典贝叶斯方法,还加速了对感知质量与低延迟有要求的实际应用的调参过程。所有生成配置均已公开于LEMUR神经网络数据集(https://github.com/ABrain-One/nn-dataset),为超参数优化研究提供开源基准,并助力提升图像处理系统的训练效率。

原文摘要 · Abstract (English)

Optimal hyperparameter selection is critical for maximizing the performance of neural networks in computer vision, particularly as architectures become more complex. This work explores the use of large language models (LLMs) for hyperparameter optimization by fine-tuning a parameter-efficient version of Code Llama using LoRA. The resulting model produces accurate and computationally efficient hyperparameter recommendations across a wide range of vision architectures. Unlike traditional methods such as Optuna, which rely on resource-intensive trial-and-error procedures, our approach achieves competitive or superior Root Mean Square Error (RMSE) while substantially reducing computational overhead. Importantly, the models evaluated span image-centric tasks such as classification, detection, and segmentation, fundamental components in many image manipulation pipelines including enhancement, restoration, and style transfer. Our results demonstrate that LLM-based optimization not only rivals established Bayesian methods like Tree-structured Parzen Estimators (TPE), but also accelerates tuning for real-world applications requiring perceptual quality and low-latency processing. All generated configurations are publicly available in the LEMUR Neural Network Dataset (https://github.com/ABrain-One/nn-dataset), which serves as an open source benchmark for hyperparameter optimization research and provides a practical resource to improve training efficiency in image manipulation systems.

超参数优化LLM应用图像处理代码生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。