arXiv:2510.17845cs.CVcs.AI2025-10NeurIPS被引 46

多智能体动态优化训练,提升图像分类准确率与稳定性。

MAT-Agent: Adaptive Multi-Agent Training Optimization

  • 用多个自主智能体实时调节数据增强、学习率等超参。
  • 在Pascal VOC等数据集上mAP最高达97.4,优于基线方法。
  • 适合需要自适应训练的复杂视觉模型研究与应用。

多标签图像分类需适应动态变化的视觉-语义环境,但传统方法依赖静态配置,在动态场景中表现不佳。本文提出MAT-Agent,一种新型多智能体框架,将训练过程重构为协作式实时优化。通过部署自主智能体动态调整数据增强、优化器、学习率和损失函数,利用非平稳多臂赌博机算法平衡探索与利用,以综合奖励(兼顾准确率、稀有类别性能与训练稳定性)引导策略。结合双速率指数移动平均平滑与混合精度训练,提升鲁棒性与效率。在Pascal VOC、COCO和VG-256上的实验表明:MAT-Agent在Pascal VOC上实现mAP 97.4(对比PAT-T的96.2)、OF1 92.3、CF1 91.4;COCO上达到mAP 92.8(对比HSQ-CvN的92.0)、OF1 88.2、CF1 87.1;VG-256上mAP 60.9、OF1 70.8、CF1 61.1。收敛更快,跨域泛化能力强,为复杂视觉模型的自适应优化提供可扩展、智能化方案。

原文摘要 · Abstract (English)

Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configurations that falter in dynamic settings. We propose MAT-Agent, a novel multi-agent framework that reimagines training as a collaborative, real-time optimization process. By deploying autonomous agents to dynamically tune data augmentation, optimizers, learning rates, and loss functions, MAT-Agent leverages non-stationary multi-armed bandit algorithms to balance exploration and exploitation, guided by a composite reward harmonizing accuracy, rare-class performance, and training stability. Enhanced with dual-rate exponential moving average smoothing and mixed-precision training, it ensures robustness and efficiency. Extensive experiments across Pascal VOC, COCO, and VG-256 demonstrate MAT-Agent's superiority: it achieves an mAP of 97.4 (vs. 96.2 for PAT-T), OF1 of 92.3, and CF1 of 91.4 on Pascal VOC; an mAP of 92.8 (vs. 92.0 for HSQ-CvN), OF1 of 88.2, and CF1 of 87.1 on COCO; and an mAP of 60.9, OF1 of 70.8, and CF1 of 61.1 on VG-256. With accelerated convergence and robust cross-domain generalization, MAT-Agent offers a scalable, intelligent solution for optimizing complex visual models, paving the way for adaptive deep learning advancements.

多智能体自适应训练图像分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。