用图神经网络优化无人机视觉传输,降低延迟并减少误检。
Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System

- 用图卷积网络捕捉像素相关性,选择关键区域传输。
- 相比其他方法,帧传输延迟降低32%,误检率下降18%。
- 适合实时无人机监控与低延迟视觉系统研究者。
搭载视觉系统的无人机广泛应用于禁飞区监控等场景,视频流需传至地面服务器供操作员协助。当前多数传输技术仍存在显著延迟。本文提出一种图卷积神经网络辅助的深度强化学习(GCN-Assisted A2C)模型,旨在识别可疑目标的像素相关区域。通过结合拉格朗日对偶形式与梯度下降,避免延迟优化中收敛失败及惩罚约束的过调或欠调问题。系统仅将帧中的子区域像素组发送至服务器,而非整帧传输。该框架利用GCN挖掘像素特征组的隐含表示,并监督A2C模型选择最优子组以提升传输效率,从而指导无人机动作训练。实验表明,相较于其他DRL及先进模型,所提方法在降低视频帧传输延迟的同时,还将误检率降低了18%。
原文摘要 · Abstract (English)
UAV on-board vision systems are widely used for different activities, including monitoring in no-fly zones. In this case, the vision-equipped UAV streams a video to a ground server where an operator assists its activities. The latency of video transmission has a profound impact on the effectiveness of the operator assistance. However, most techniques available for video transmission still incur significant latency costs. In this paper, we propose a graph convolutional neural network-assisted (GCN-Assisted A2C) deep reinforcement learning (DRL) system model to find the optimal pixel-correlated area of a suspicious object. We combine the Lagrangian dual form with gradient descent to prevent lack of convergence and over- and under-penalization constraint violation during latency optimization. The proposed system model sends a sub-group pixel-correlated area of the frame from the UAV to the server rather than the transmission of the whole video frame. The proposed framework utilizes the GCN model to explore hidden representations of feature-correlated groups of pixels. Moreover, the GCN supervises the A2C model, which selects a subgroup to enhance transmission latency, thus supervising the training of UAV actions in A2C. Experimental results show that GCN-assisted A2C reduces video frame transmission latency together with false detection rate in UAV vision systems over other DRL and state-of-the-art models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。