arXiv:2511.07329cs.LGcs.CV2025-11被引 11

用分形设计自动生成高效卷积网络,5轮训练达80.18%准确率

Preparation of Fractal-Inspired Computational Architectures for Advanced Large Language Model Analysis

  • 基于递归分形模板生成多路径卷积结构,避免昂贵的NAS搜索
  • 在CIFAR-10上生成超1200架构,峰值准确率达80.18%,平均60-70%
  • 资源高效且可解释,适合自动化模型探索与轻量级架构设计

本文提出FractalNet框架,基于分形设计原则,通过递归模板模式自动生成并评估卷积神经网络(CNN)架构。该框架不依赖计算开销大的神经架构搜索(NAS),而是通过系统性调整分形深度、列宽和层配置等参数,在结构化空间中探索网络设计。框架包含三部分:生成器通过控制卷积、归一化、激活和丢弃层的排列生成候选架构;分形模板模块强制执行递归多路径结构;运行模块管理模型训练、评估与日志记录。在CIFAR-10图像分类基准上,使用PyTorch进行训练,结合自动混合精度(AMP)与梯度检查点降低开销,共生成并评估超过1200种不同架构。实验结果表明,分形结构具有稳定的训练动态,达到平均60-70%验证准确率,峰值准确率为80.18%,仅需五轮训练即达成。这些发现说明,递归分形结构能有效平衡网络深度与宽度,支持大规模自动化架构探索。该框架提供了一种资源高效且可解释的系统性神经架构实验方法。

原文摘要 · Abstract (English)

This paper proposes FractalNet, a framework based on fractal design principles that automatically generates and evaluates convolutional neural network (CNN) architectures using recursive template patterns. Rather than relying on computationally expensive Neural Architecture Search (NAS) methods, the framework explores a structured architecture space defined by recursive fractal templates that systematically vary key parameters such as fractal depth, column width, and layer configurations. The framework consists of three core components: a generator that produces candidate architectures via controlled permutations of convolutional, normalization, activation, and dropout layers; a fractal template module that enforces recursive multi-path structural patterns; and a runner module that manages model training, evaluation, and logging. Using this system, over 1,200 distinct CNN architectures were automatically generated and evaluated on the CIFAR-10 image classification benchmark. Training was performed in PyTorch using stochastic gradient descent with Automatic Mixed Precision (AMP) and gradient checkpointing to reduce computational overhead. Experimental results demonstrate that fractal-based architectures exhibit stable training dynamics and achieve competitive performance, with an average validation accuracy of 60-70% and a peak accuracy of 80.18% after only five training epochs. These findings suggest that recursive fractal structures provide an effective means of balancing network depth and width while supporting large-scale automated architecture exploration. The proposed framework offers a resource-efficient and interpretable approach to systematic neural architecture experimentation.

分形网络架构生成CNN优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。