arXiv:2501.11557cs.LG2025-01ICML被引 7

用约束强化学习优化边缘计算资源分配,兼顾安全与能效。

Secure Resource Allocation via Constrained Deep Reinforcement Learning

  • 引入动作约束的强化学习框架,动态协调资源与安全
  • 系统成本降低40%,能效提升41.5%优于现有方法
  • 适合研究边缘计算与安全资源管理的开发者

物联网设备激增与6G技术发展带来了大量计算密集型任务,远超用户设备处理能力。在无服务器多云边缘计算环境中,高效且安全的资源分配对支撑这些需求至关重要。然而,现有方案常面临多云架构复杂、安全集成难、传统深度强化学习在系统约束下效果不佳等问题。为此,我们提出SARMTO框架,融合动作约束的深度强化学习模型。通过马尔可夫决策过程建模、自适应安全机制与先进优化技术,动态平衡资源分配、任务卸载、安全与性能。大规模仿真显示,在不同任务负载、数据规模和边缘计算容量条件下,SARMTO持续优于五种基线方法,系统成本最高降低40%,能效较先进方法提升41.5%。该成果凸显其在复杂分布式计算环境中的变革潜力,为更高效、安全的物联网与边缘计算应用开辟新路径。

原文摘要 · Abstract (English)

The proliferation of Internet of Things (IoT) devices and the advent of 6G technologies have introduced computationally intensive tasks that often surpass the processing capabilities of user devices. Efficient and secure resource allocation in serverless multi-cloud edge computing environments is essential for supporting these demands and advancing distributed computing. However, existing solutions frequently struggle with the complexity of multi-cloud infrastructures, robust security integration, and effective application of traditional deep reinforcement learning (DRL) techniques under system constraints. To address these challenges, we present SARMTO, a novel framework that integrates an action-constrained DRL model. SARMTO dynamically balances resource allocation, task offloading, security, and performance by utilizing a Markov decision process formulation, an adaptive security mechanism, and sophisticated optimization techniques. Extensive simulations across varying scenarios, including different task loads, data sizes, and MEC capacities, show that SARMTO consistently outperforms five baseline approaches, achieving up to a 40% reduction in system costs and a 41.5% improvement in energy efficiency over state-of-the-art methods. These enhancements highlight SARMTO's potential to revolutionize resource management in intricate distributed computing environments, opening the door to more efficient and secure IoT and edge computing applications.

边缘计算强化学习资源分配安全优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。