通过动态开关机制实现神经元分段专精,提升模型可解释性与扩展性。
Switch-Based Multi-Part Neural Network
- 引入动态开关机制,按输入特征选择性激活神经元,实现任务专业化。
- 在非重叠数据子集上模拟局部训练,支持分布式环境高效部署。
- 适用于边缘计算与隐私保护场景,兼顾性能与模型透明度。
本文提出一种去中心化、模块化的神经网络框架,以提升人工智能系统的可扩展性、可解释性和性能。核心是动态开关机制,根据输入特征选择性激活和训练单个神经元,使神经元专注于数据域的不同部分。该方法使神经元能够从互不重叠的数据子集中学习,模仿生物大脑的功能,促进任务专业化并增强神经网络行为的可解释性。同时,论文探讨了联邦学习与去中心化训练在真实世界AI部署中的应用,尤其在边缘计算和分布式环境中。通过在非重叠数据子集上模拟局部训练,验证了模块化网络的高效训练与评估能力。所提框架还解决了可扩展性问题,使AI系统能处理大规模数据与分布式计算,同时保持模型透明性与可解释性。最后,讨论了该方法在构建可扩展、隐私保护且高效的AI系统方面的潜力,适用于多种应用场景。
原文摘要 · Abstract (English)
This paper introduces decentralized and modular neural network framework designed to enhance the scalability, interpretability, and performance of artificial intelligence (AI) systems. At the heart of this framework is a dynamic switch mechanism that governs the selective activation and training of individual neurons based on input characteristics, allowing neurons to specialize in distinct segments of the data domain. This approach enables neurons to learn from disjoint subsets of data, mimicking biological brain function by promoting task specialization and improving the interpretability of neural network behavior. Furthermore, the paper explores the application of federated learning and decentralized training for real-world AI deployments, particularly in edge computing and distributed environments. By simulating localized training on non-overlapping data subsets, we demonstrate how modular networks can be efficiently trained and evaluated. The proposed framework also addresses scalability, enabling AI systems to handle large datasets and distributed processing while preserving model transparency and interpretability. Finally, we discuss the potential of this approach in advancing the design of scalable, privacy-preserving, and efficient AI systems for diverse applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。