用代谢型多智能体优化联合选择特征与调参,兼顾精度与模型简洁性。
MMAO-Cls: Metabolic Multi-Agent Optimization for Joint Feature Selection and Classifier Tuning
- 各智能体协同编码特征掩码与分类器超参,通过能量与生命周期模拟搜索过程。
- 在7个基准数据集上测试,平均测试准确率达0.8882,特征使用率仅48.81%。
- 适合需要高效特征筛选与模型压缩的科研或工程场景,尤其关注可解释性。
本文研究代谢型多智能体优化器(MMAO)能否作为分类模型选择的可靠外层优化器。提出MMAO-Cls,一种混合空间实现:每个智能体联合编码二值特征掩码与分类器超参数,同时将私有能量、公共预算、角色漂移和生命周期更替映射为包装器学习中的精度-复杂度权衡。通过从特征信息先验推导特征预算自适应,并以子集紧凑性与训练-验证过拟合差距正则化验证奖励,增强实现性能。在七个标准表格基准上进行三轮种子实验,对比随机搜索、GA-lite、PSO-lite及无共享内生消融方法。综合验证目标中,MMAO-Cls排名第二(0.9433),仅次于GA-lite(0.9446)。在保留测试性能上,其均值达0.8882,优于随机搜索(0.8808)和GA-lite(0.8857),接近PSO-lite(0.8874)与无共享消融(0.8900),且是所有方法中特征子集最紧凑的(特征比例0.4881)。成对检验显示差异尚未显著。结论保守:MMAO-Cls明确支持分类应用与紧凑混合空间搜索,但未能孤立出集体共享的决定性优势。
原文摘要 · Abstract (English)
This paper studies whether the Metabolic Multi-Agent Optimizer (MMAO) can act as a credible outer-loop optimizer for classification model selection. We propose MMAO-Cls, a mixed-space realization in which each agent jointly encodes a binary feature mask and classifier hyperparameters, while private energy, communal budget, role drift, and lifecycle turnover are mapped to the accuracy-complexity tradeoff of wrapper learning. The implementation is strengthened by deriving feature-budget adaptation from feature-information priors and by regularizing validation reward with both subset compactness and train-validation overfitting gap. We evaluate MMAO-Cls on seven standard tabular benchmarks with three seeds each and compare it against RandomSearch, GA-lite, PSO-lite, and an endogenous no-sharing ablation. On the aggregate validation objective, MMAO-Cls ranks second ($0.9433$) behind GA-lite ($0.9446$). On held-out test performance, it reaches mean score $0.8882$, improving over RandomSearch ($0.8808$) and GA-lite ($0.8857$), remaining close to PSO-lite ($0.8874$) and the no-sharing ablation ($0.8900$), while using the most compact mean held-out feature subset among all compared methods (feature ratio $0.4881$). Pairwise tests show that these margins are not yet statistically significant. The resulting claim is therefore conservative: MMAO-Cls supports classification applicability and compact mixed-space search more clearly than it isolates communal sharing as a decisive standalone advantage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。