用语义编码降低车端远程操作数据量,50%带宽节省下仍保持低延迟
SEG-JPEG: Simple Visual Semantic Communications for Remote Operation of Automated Vehicles over Unreliable Wireless Networks
- 将道路用户分割信息转为低分辨率灰度图上的彩色标记
- 相比传统方法减少50%数据量,网络低于500 kbit/s时延迟仍<200 ms
- 适合在不稳定的4G/5G公网环境下部署远程驾驶系统
远程操作被视为推动自动驾驶车辆快速落地的关键。当前通过流媒体控制联网车辆需依赖高带宽、可靠的网络连接,而实际远程操作常受限于公共网络基础设施。本文研究如何利用计算机视觉辅助的语义通信技术,规避传统图像压缩带来的数据丢失与损坏问题。通过将检测到的道路使用者分割结果编码为低分辨率灰度图像中的彩色高亮,可使所需数据率比传统方法降低50%,同时保持视觉清晰度。该方案在4G移动网络波动区域的自动驾驶末端配送车辆上验证,即使网络速率低于500 kbit/s,也能实现低于200毫秒的端到端延迟,并清晰标识关键道路使用者,显著提升远程操作员的情境感知能力。结果表明,在通常受限的公共4G/5G网络条件下,大规模远程操控自动驾驶车辆部署成为可能,有望加速全国范围自动驾驶车辆的推广。
原文摘要 · Abstract (English)
Remote Operation is touted as being key to the rapid deployment of automated vehicles. Streaming imagery to control connected vehicles remotely currently requires a reliable, high throughput network connection, which can be limited in real-world remote operation deployments relying on public network infrastructure. This paper investigates how the application of computer vision assisted semantic communication can be used to circumvent data loss and corruption associated with traditional image compression techniques. By encoding the segmentations of detected road users into colour coded highlights within low resolution greyscale imagery, the required data rate can be reduced by 50% compared with conventional techniques, while maintaining visual clarity. This enables a median glass-to-glass latency of below 200 ms even when the network data rate is below 500 kbit/s, while clearly outlining salient road users to enhance situational awareness of the remote operator. The approach is demonstrated in an area of variable 4G mobile connectivity using an automated last-mile delivery vehicle. Results indicate that large-scale deployment of remotely operated automated vehicles could be possible even on the often constrained public 4G/5G mobile network, providing the potential to expedite the nationwide roll-out of automated vehicles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。