将AI计算搬到网络设备上,让网络更智能高效
INSIGHT: A Survey of In-Network Systems for Intelligent, High-Efficiency AI and Topology Optimization

- 利用交换机等网络设备的计算能力执行AI任务
- 支持分布式学习和联邦学习,提升隐私与扩展性
- 适合研究网络智能化与边缘AI的开发者
在网络中执行计算是一种应对人工智能工作负载对网络基础设施日益增长需求的变革性方法。通过利用交换机、路由器和网络接口卡(NIC)等网络设备的处理能力,该范式可在网络内部直接完成AI计算,显著降低延迟、提高吞吐量并优化资源利用率。本文全面分析了面向AI的网络内计算优化,探讨了可编程网络架构(如软件定义网络SDN和可编程数据平面PDPs)的发展及其与AI的融合。研究了将AI模型映射到资源受限网络设备的方法,通过高效算法设计与模型压缩技术解决内存和算力不足的问题。同时分析了分布式学习中的网络内聚合进展,以及联邦学习在增强隐私与可扩展性方面的潜力。文中还介绍了Planter和Quark等开发框架,并讨论了智能网络监控、入侵检测、流量管理及边缘AI等关键应用。最后提出未来研究方向,包括运行时可编程性、标准化基准和新型应用范式,以推动这一快速发展的领域。本综述强调了网络内AI在构建智能、高效、响应迅速的下一代网络中的巨大潜力。
原文摘要 · Abstract (English)
In-network computation represents a transformative approach to addressing the escalating demands of Artificial Intelligence (AI) workloads on network infrastructure. By leveraging the processing capabilities of network devices such as switches, routers, and Network Interface Cards (NICs), this paradigm enables AI computations to be performed directly within the network fabric, significantly reducing latency, enhancing throughput, and optimizing resource utilization. This paper provides a comprehensive analysis of optimizing in-network computation for AI, exploring the evolution of programmable network architectures, such as Software-Defined Networking (SDN) and Programmable Data Planes (PDPs), and their convergence with AI. It examines methodologies for mapping AI models onto resource-constrained network devices, addressing challenges like limited memory and computational capabilities through efficient algorithm design and model compression techniques. The paper also highlights advancements in distributed learning, particularly in-network aggregation, and the potential of federated learning to enhance privacy and scalability. Frameworks like Planter and Quark are discussed for simplifying development, alongside key applications such as intelligent network monitoring, intrusion detection, traffic management, and Edge AI. Future research directions, including runtime programmability, standardized benchmarks, and new applications paradigms, are proposed to advance this rapidly evolving field. This survey underscores the potential of in-network AI to create intelligent, efficient, and responsive networks capable of meeting the demands of next-generation AI applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。