arXiv:2411.00453cs.LGcs.NI2024-11被引 33

用扩散模型直接优化物联网网络问题,能生成高质量解并逼近最优。

Diffusion Models as Network Optimizers: Explorations and Analysis

论文配图:Diffusion Models as Network Optimizers: Explorations and Analysis
图 1 · 摘自论文原文
  • 将扩散模型作为优化器,学习输入对应的高质量解分布
  • 在3个复杂网络优化任务中,生成解收敛至最优且抗预测误差
  • 首次理论证明生成模型优于判别模型,适合复杂优化场景

网络优化是物联网网络中的核心挑战,常因复杂特性难以求解。近年来,生成扩散模型(GDMs)展现出直接解决此类问题的潜力,但该领域仍处初期,缺乏理论研究与实证支持。本文首先探索生成模型的内在特性,随后提供简洁的理论证明与直观演示,阐明生成模型在网路优化中优于判别模型的优势。基于此,我们构建以扩散模型为优化器的方法,旨在学习给定输入下的高质量解分布,并在推理时采样以逼近或实现最优解。具体采用去噪扩散概率模型(DDPM),结合无分类器引导机制,根据输入参数动态调节条件引导。我们在三个具有挑战性的网络优化问题上进行大量实验,通过分析不同模型配置与扩散模型作为优化器的原理,验证了其克服预测误差的能力,并证明生成解可收敛至最优解。代码与数据已公开于 https://github.com/qiyu3816/DiffSG。

原文摘要 · Abstract (English)

Network optimization is a fundamental challenge in the Internet of Things (IoT) network, often characterized by complex features that make it difficult to solve these problems. Recently, generative diffusion models (GDMs) have emerged as a promising new approach to network optimization, with the potential to directly address these optimization problems. However, the application of GDMs in this field is still in its early stages, and there is a noticeable lack of theoretical research and empirical findings. In this study, we first explore the intrinsic characteristics of generative models. Next, we provide a concise theoretical proof and intuitive demonstration of the advantages of generative models over discriminative models in network optimization. Based on this exploration, we implement GDMs as optimizers aimed at learning high-quality solution distributions for given inputs, sampling from these distributions during inference to approximate or achieve optimal solutions. Specifically, we utilize denoising diffusion probabilistic models (DDPMs) and employ a classifier-free guidance mechanism to manage conditional guidance based on input parameters. We conduct extensive experiments across three challenging network optimization problems. By investigating various model configurations and the principles of GDMs as optimizers, we demonstrate the ability to overcome prediction errors and validate the convergence of generated solutions to optimal solutions. We provide code and data at https://github.com/qiyu3816/DiffSG.

扩散模型网络优化生成模型物联网

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。