arXiv:2510.05888cs.CV2025-10中稿 · IEEE Transactions …

用自动架构搜索融合图像与生物信息,提升大规模昆虫分类准确率。

BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data

  • 通过神经架构搜索自动优化图像特征提取网络结构。
  • 在百万级数据集上达96.81%准确率,显著优于现有方法。
  • 适合生态监测与智能农业领域,支持可持续农作决策。

昆虫分类对农业管理和生态研究至关重要,直接影响作物健康与产量。然而,由于昆虫特征复杂、类别不平衡及数据规模庞大,该任务仍具挑战性。为此,我们提出BioAutoML-NAS,首个基于多模态数据(图像与元数据)的生物自动化机器学习模型,采用神经架构搜索(NAS)自动学习每个细胞中各连接的最佳操作。多个细胞堆叠形成完整网络,分别提取精细图像特征;多模态融合模块将图像嵌入与元数据结合,使模型同时利用视觉与生物学信息进行分类。采用交替双层优化策略联合更新网络权重与架构参数,并通过零操作移除低效连接,生成稀疏、高效且高性能的架构。在BIOSCAN-5M数据集上的大量评估显示,BioAutoML-NAS达到96.81%准确率、97.46%精确率、96.81%召回率和97.05% F1分数,相较最先进的迁移学习、Transformer、AutoML与NAS方法分别提升约16%、10%和8%。在Insects-1M数据集上验证,获得93.25%准确率、93.71%精确率、92.74%召回率和93.22% F1分数。结果表明,BioAutoML-NAS可实现高精度、高置信度的昆虫分类,助力现代可持续农业。

原文摘要 · Abstract (English)

Insect classification is important for agricultural management and ecological research, as it directly affects crop health and production. However, this task remains challenging due to the complex characteristics of insects, class imbalance, and large-scale datasets. To address these issues, we propose BioAutoML-NAS, the first BioAutoML model using multimodal data, including images, and metadata, which applies neural architecture search (NAS) for images to automatically learn the best operations for each connection within each cell. Multiple cells are stacked to form the full network, each extracting detailed image feature representations. A multimodal fusion module combines image embeddings with metadata, allowing the model to use both visual and categorical biological information to classify insects. An alternating bi-level optimization training strategy jointly updates network weights and architecture parameters, while zero operations remove less important connections, producing sparse, efficient, and high-performing architectures. Extensive evaluation on the BIOSCAN-5M dataset demonstrates that BioAutoML-NAS achieves 96.81% accuracy, 97.46% precision, 96.81% recall, and a 97.05% F1 score, outperforming state-of-the-art transfer learning, transformer, AutoML, and NAS methods by approximately 16%, 10%, and 8% respectively. Further validation on the Insects-1M dataset obtains 93.25% accuracy, 93.71% precision, 92.74% recall, and a 93.22% F1 score. These results demonstrate that BioAutoML-NAS provides accurate, confident insect classification that supports modern sustainable farming.

昆虫分类多模态NASAutoML

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。