用神经科学的主动推断机制,让边缘设备自适应优化实时数据处理。
Adaptive Stream Processing on Edge Devices through Active Inference
- 基于主动推断的机器学习框架,通过预测与反馈动态调整边缘计算资源配置。
- 仅需三十次迭代即可收敛,实现三个自动驾驶服务的SLO达标率提升。
- 决策过程可解释性强,便于故障排查,适合对可靠性要求高的边缘系统。
物联网持续生成海量实时数据,亟需新型架构与逻辑方案进行处理。将数据处理推向计算边缘可降低延迟并增强隐私保护,但需在异构设备上保障应用方和管理者设定的服务等级目标(SLOs)。现有基于机器学习的管理方案难以长期精准预测与控制,且故障定位困难。为此,本文提出一种基于主动推断(Active Inference, AIF)的新型机器学习范式——该概念源自神经科学,描述大脑如何不断预测并评估感官信息以减少长期意外。我们在一个异构真实流处理场景中实现并验证了该方法:一个基于AIF的智能体在多个设备上连续优化三个自动驾驶服务的三项SLO。该智能体利用因果知识逐步理解自身行为与目标达成之间的关系,并选择最优配置。实验表明,该智能体最多经三十次迭代即收敛至最优解,能在短时间内提供准确结果。此外,得益于AIF及其因果结构,本方法实现了决策过程的完全透明,显著简化结果解读与故障排查。
原文摘要 · Abstract (English)
The current scenario of IoT is witnessing a constant increase on the volume of data, which is generated in constant stream, calling for novel architectural and logical solutions for processing it. Moving the data handling towards the edge of the computing spectrum guarantees better distribution of load and, in principle, lower latency and better privacy. However, managing such a structure is complex, especially when requirements, also referred to Service Level Objectives (SLOs), specified by applications' owners and infrastructure managers need to be ensured. Despite the rich number of proposals of Machine Learning (ML) based management solutions, researchers and practitioners yet struggle to guarantee long-term prediction and control, and accurate troubleshooting. Therefore, we present a novel ML paradigm based on Active Inference (AIF) -- a concept from neuroscience that describes how the brain constantly predicts and evaluates sensory information to decrease long-term surprise. We implement it and evaluate it in a heterogeneous real stream processing use case, where an AIF-based agent continuously optimizes the fulfillment of three SLOs for three autonomous driving services running on multiple devices. The agent used causal knowledge to gradually develop an understanding of how its actions are related to requirements fulfillment, and which configurations to favor. Through this approach, our agent requires up to thirty iterations to converge to the optimal solution, showing the capability of offering accurate results in a short amount of time. Furthermore, thanks to AIF and its causal structures, our method guarantees full transparency on the decision making, making the interpretation of the results and the troubleshooting effortless.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。