多尺度胶囊网络提升视觉识别,通过动态路由融合不同层级特征
MSPCaps: A Multi-Scale Patchify Capsule Network with Cross-Agreement Routing for Visual Recognition
- 用多尺度残差主干提取不同层级特征,保留细节与上下文
- 统一分块生成胶囊,支持多样化感受野学习
- 跨尺度一致路由筛选高共识胶囊,提升分类精度与鲁棒性
胶囊网络(CapsNet)在视觉识别中展现出捕捉空间关系与部分-整体层次结构的潜力,可学习等变特征表示。然而,现有方法多依赖单一高层特征图,忽略了多尺度特征间的互补信息。传统特征融合策略(如加法和拼接)难以调和多尺度差异,导致分类性能不佳。为此,本文提出多尺度分块胶囊网络(MSPCaps),集成多尺度特征学习与高效胶囊路由。该模型包含三个核心组件:多尺度残差主干(MSRB)、分块胶囊层(PatchifyCaps)和跨一致路由(CAR)模块。首先,MSRB从输入图像中提取多样化的多尺度特征表示,同时保留细粒度细节与全局上下文。其次,PatchifyCaps使用统一分块大小将多尺度特征划分为初级胶囊,使模型具备从多样化感受野中学习的能力。最后,CAR模块通过识别具有最大一致性的跨尺度预测对,自适应地路由多尺度胶囊。与简单拼接多个自路由模块不同,CAR仅让最一致的胶囊参与最终投票。MSPCaps表现出显著的可扩展性与优越鲁棒性,在多种配置下均超越多个基线方法,参数量从高效的344.3K(Tiny模型)到强大的10.9M(Large模型),彰显其在特征表示学习中的潜力。
原文摘要 · Abstract (English)
Capsule Network (CapsNet) has demonstrated significant potential in visual recognition by capturing spatial relationships and part-whole hierarchies for learning equivariant feature representations. However, existing CapsNet and variants often rely on a single high-level feature map, overlooking the rich complementary information from multi-scale features. Furthermore, conventional feature fusion strategies (e.g., addition and concatenation) struggle to reconcile multi-scale feature discrepancies, leading to suboptimal classification performance. To address these limitations, we propose the Multi-Scale Patchify Capsule Network (MSPCaps), a novel architecture that integrates multi-scale feature learning and efficient capsule routing. Specifically, MSPCaps consists of three key components: a Multi-Scale ResNet Backbone (MSRB), a Patchify Capsule Layer (PatchifyCaps), and Cross-Agreement Routing (CAR) blocks. First, the MSRB extracts diverse multi-scale feature representations from input images, preserving both fine-grained details and global contextual information. Second, the PatchifyCaps partitions these multi-scale features into primary capsules using a uniform patch size, equipping the model with the ability to learn from diverse receptive fields. Finally, the CAR block adaptively routes the multi-scale capsules by identifying cross-scale prediction pairs with maximum agreement. Unlike the simple concatenation of multiple self-routing blocks, CAR ensures that only the most coherent capsules contribute to the final voting. Our proposed MSPCaps achieves remarkable scalability and superior robustness, consistently surpassing multiple baseline methods in terms of classification accuracy, with configurations ranging from a highly efficient Tiny model (344.3K parameters) to a powerful Large model (10.9M parameters), highlighting its potential in advancing feature representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。