融合CNN、MLP-Mixer与ViT,用集成学习提升图像分类精度。
Exploring Synergistic Ensemble Learning: Uniting CNNs, MLP-Mixers, and Vision Transformers to Enhance Image Classification
- 保持各架构独立性,通过集成方法组合不同模型。
- 在ImageNet上超越此前最优单模型,且延迟更低。
- 为探索多架构协同提供系统性框架,适合模型融合研究者。
近年来,卷积神经网络(CNN)、MLP-Mixer和视觉变换器(Vision Transformer)成为图像分类的主流神经网络架构。已有研究指出各类架构的独特优势,且有证据表明融合不同架构的模块可提升性能。本文在前人基础上,深入探索不同架构间的互补性。不同于凭经验拼接模块的试错方式,我们保留各架构完整性,采用集成技术进行组合,以更系统地揭示其内在互补性并实现隐式隔离。该方法有助于理解各架构的独立优势。此外,我们验证了基础集成方法的有效性:由异构架构组成的集成模型性能优于同质架构集成。这一简单框架为融合互补架构提供了坚实起点,推动对不同架构及其集成在图像分类中独特优势与协同效应的进一步研究。本工作直接成果是构建了一个分类网络集成,在ImageNet上超越此前最优单模型,创下新纪录,同时整体延迟更低。
原文摘要 · Abstract (English)
In recent years, Convolutional Neural Networks (CNNs), MLP-mixers, and Vision Transformers have risen to prominence as leading neural architectures in image classification. Prior research has underscored the distinct advantages of each architecture, and there is growing evidence that combining modules from different architectures can boost performance. In this study, we build upon and improve previous work exploring the complementarity between different architectures. Instead of heuristically merging modules from various architectures through trial and error, we preserve the integrity of each architecture and combine them using ensemble techniques. By maintaining the distinctiveness of each architecture, we aim to explore their inherent complementarity more deeply and with implicit isolation. This approach provides a more systematic understanding of their individual strengths. In addition to uncovering insights into architectural complementarity, we showcase the effectiveness of even basic ensemble methods that combine models from diverse architectures. These methods outperform ensembles comprised of similar architectures. Our straightforward ensemble framework serves as a foundational strategy for blending complementary architectures, offering a solid starting point for further investigations into the unique strengths and synergies among different architectures and their ensembles in image classification. A direct outcome of this work is the creation of an ensemble of classification networks that surpasses the accuracy of the previous state-of-the-art single classification network on ImageNet, setting a new benchmark, all while requiring less overall latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。