用假设驱动方法自动发现视觉识别模型,从18.91%准确率提升至94.11%
Agentic Discovery with Active Hypothesis Exploration for Visual Recognition

- 以大模型生成新假设,通过演化分支迭代优化网络结构
- 在CIFAR-10上从18.91%准确率提升至94.11%,并泛化到其他数据集
- 可解释性强,适合追求可复现与理解的模型设计研究者
我们提出HypoExplore,一个基于假设驱动的智能体框架,将视觉识别的神经架构搜索转化为科学探究过程。给定高层研究方向后,框架通过演化分支不断生成、实现、评估和改进架构。新假设由大语言模型生成,基于平衡利用已验证原则与解决不确定性的双重策略。框架维护轨迹树记录所有架构的演化路径,以及假设记忆库跟踪实验获得的信心评分。每次实验后,多个反馈智能体从不同角度分析结果,并合并为假设信心更新。在CIFAR-10上测试发现轻量级视觉架构,最优模型从18.91%基线准确率提升至94.11%,且可泛化至CIFAR-100和Tiny-ImageNet。进一步在MedMNIST上独立运行,达到当前最优性能。结果表明,随着证据积累,假设信心评分逐渐具备预测力,且学习到的设计原则可在不同演化谱系间迁移,说明HypoExplore不仅能发现更优架构,还能促进对设计空间的深层理解。
原文摘要 · Abstract (English)
We introduce HypoExplore, an agentic framework that formulates neural architecture discovery for visual recognition as a hypothesis-driven scientific inquiry. Given a human-specified high-level research direction, HypoExplore ideates, implements, evaluates, and improves neural architectures through evolutionary branching. New hypotheses are created using a large language model by selecting a parent hypothesis to build upon, guided by a dual strategy that balances exploiting validated principles with resolving uncertain ones. Our proposed framework maintains a Trajectory Tree that records the lineage of all proposed architectures, and a Hypothesis Memory Bank that actively tracks confidence scores acquired through experimental evidence. After each experiment, multiple feedback agents analyze the results from different perspectives and consolidate their findings into hypothesis confidence updates. Our framework is tested on discovering lightweight vision architectures on CIFAR-10, with the best achieving 94.11% accuracy evolved from a root node baseline that starts at 18.91%, and generalizes to CIFAR-100 and Tiny-ImageNet. We further demonstrate applicability to a specialized domain by conducting independent architecture discovery runs on MedMNIST, which yield a state-of-the-art performance. We show that hypothesis confidence scores grow increasingly predictive as evidence accumulates, and that the learned principles transfer across independent evolutionary lineages, suggesting that HypoExplore not only discovers stronger architectures, but can help build a genuine understanding of the design space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。