arXiv:2508.14946cs.LG2025-08被引 1

提出分层混合架构搜索,用自适应突变提升文本分类模型搜索效率。

HHNAS-AM: Hierarchical Hybrid Neural Architecture Search using Adaptive Mutation Policies

  • 设计分层模板缩小搜索空间,结合领域线索组织结构。
  • 基于Q-learning动态调整突变策略,测试准确率提升8%。
  • 适合需要高效自动化模型设计的自然语言处理研究者。

神经架构搜索(NAS)因能发现优于人工设计的模型而备受关注。在文本分类等任务中,现有NAS方法缺乏分层混合结构,且无架构约束,导致搜索空间过大且冗余,强化学习模型难以有效探索。平坦的搜索空间也难以高效遍历。为此,我们提出HHNAS-AM(分层混合神经架构搜索,采用自适应突变策略),通过引入若干基于领域线索的架构模板,系统性组织搜索空间。该方法利用Q-learning根据历史性能反馈动态调整突变策略,实现更高效的搜索。模型为全概率化设计,增强探索能力。在db_id预测任务上,多次实验均发现高性能架构;在Spider数据集上,测试准确率相比基线提升8%。

原文摘要 · Abstract (English)

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other language-related tasks. The NAS model used in text classification does not have a Hybrid hierarchical structure, and there is no restriction on the architecture structure, due to which the search space becomes very large and mostly redundant, so the existing RL models are not able to navigate the search space effectively. Also, doing a flat architecture search leads to an unorganised search space, which is difficult to traverse. For this purpose, we propose HHNAS-AM (Hierarchical Hybrid Neural Architecture Search with Adaptive Mutation Policies), a novel approach that efficiently explores diverse architectural configurations. We introduce a few architectural templates to search on which organise the search spaces, where search spaces are designed on the basis of domain-specific cues. Our method employs mutation strategies that dynamically adapt based on performance feedback from previous iterations using Q-learning, enabling a more effective and accelerated traversal of the search space. The proposed model is fully probabilistic, enabling effective exploration of the search space. We evaluate our approach on the database id (db_id) prediction task, where it consistently discovers high-performing architectures across multiple experiments. On the Spider dataset, our method achieves an 8% improvement in test accuracy over existing baselines.

神经架构搜索文本分类自适应搜索Q-learning

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。