多智能体动态优化训练,提升图像分类准确率与稳定性。
MAT-Agent: Adaptive Multi-Agent Training Optimization
- 用多个自主智能体实时调节数据增强、学习率等超参。
- 在Pascal VOC等数据集上mAP最高达97.4,优于基线方法。
- 适合需要自适应训练的复杂视觉模型研究与应用。
多标签图像分类需适应动态变化的视觉-语义环境,但传统方法依赖静态配置,在动态场景中表现不佳。本文提出MAT-Agent,一种新型多智能体框架,将训练过程重构为协作式实时优化。通过部署自主智能体动态调整数据增强、优化器、学习率和损失函数,利用非平稳多臂赌博机算法平衡探索与利用,以综合奖励(兼顾准确率、稀有类别性能与训练稳定性)引导策略。结合双速率指数移动平均平滑与混合精度训练,提升鲁棒性与效率。在Pascal VOC、COCO和VG-256上的实验表明:MAT-Agent在Pascal VOC上实现mAP 97.4(对比PAT-T的96.2)、OF1 92.3、CF1 91.4;COCO上达到mAP 92.8(对比HSQ-CvN的92.0)、OF1 88.2、CF1 87.1;VG-256上mAP 60.9、OF1 70.8、CF1 61.1。收敛更快,跨域泛化能力强,为复杂视觉模型的自适应优化提供可扩展、智能化方案。
原文摘要 · Abstract (English)
Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configurations that falter in dynamic settings. We propose MAT-Agent, a novel multi-agent framework that reimagines training as a collaborative, real-time optimization process. By deploying autonomous agents to dynamically tune data augmentation, optimizers, learning rates, and loss functions, MAT-Agent leverages non-stationary multi-armed bandit algorithms to balance exploration and exploitation, guided by a composite reward harmonizing accuracy, rare-class performance, and training stability. Enhanced with dual-rate exponential moving average smoothing and mixed-precision training, it ensures robustness and efficiency. Extensive experiments across Pascal VOC, COCO, and VG-256 demonstrate MAT-Agent's superiority: it achieves an mAP of 97.4 (vs. 96.2 for PAT-T), OF1 of 92.3, and CF1 of 91.4 on Pascal VOC; an mAP of 92.8 (vs. 92.0 for HSQ-CvN), OF1 of 88.2, and CF1 of 87.1 on COCO; and an mAP of 60.9, OF1 of 70.8, and CF1 of 61.1 on VG-256. With accelerated convergence and robust cross-domain generalization, MAT-Agent offers a scalable, intelligent solution for optimizing complex visual models, paving the way for adaptive deep learning advancements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。