利用位置信息提升图像传输效率,减少数据量并增强抗干扰能力。
Position-Aided Semantic Communication for Efficient Image Transmission: Design, Implementation, and Experimental Results
- 结合定位信息与地图数据,用大模型生成目标图像。
- 实测传输效率提升显著,动态场景下仍保持稳定性能。
- 适合自动驾驶、智能交通等实时图像传输场景。
语义通信结合知识库可大幅降低传输开销并提高抗错能力。然而,现有方法多依赖端到端训练构建知识库,未能充分挖掘通信设备中的丰富信息。受感知与通信融合趋势启发,本文提出位置辅助语义通信(PASC)框架,将定位信息融入语义传输过程,专为基于位置的图像通信(如户外摄像头实时上传)设计。通过设备位置获取对应地图,再由先进基础模型驱动的视图生成器合成接近目标图像的内容。PASC进一步利用基础模型融合合成图像与真实图像的差异,提升语义重建效果。该框架具备高度灵活性,可通过新型基于基础模型的参数优化策略适应动态内容和波动信道。同时,针对实时部署挑战,构建了硬件测试平台进行验证。仿真与实际测试均表明,PASC不仅显著提升传输效率,且在多样变化的传输环境中表现稳健。
原文摘要 · Abstract (English)
Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing to fully capitalize on the rich information available at communication devices. Motivated by the growing convergence of sensing and communication, we introduce a novel Position-Aided Semantic Communication (PASC) framework, which integrates localization into semantic transmission. This framework is particularly designed for position-based image communication, such as real-time uploading of outdoor camera-view images. By utilizing the position, the framework retrieves corresponding maps, and then an advanced foundation model (FM)-driven view generator is employed to synthesize images closely resembling the target images. The PASC framework further leverages the FM to fuse the synthesized image with deviations from the real one, enhancing semantic reconstruction. Notably, the framework is highly flexible, capable of adapting to dynamic content and fluctuating channel conditions through a novel FM-based parameter optimization strategy. Additionally, the challenges of real-time deployment are addressed, with the development of a hardware testbed to validate the framework. Simulations and real-world tests demonstrate that the proposed PASC approach not only significantly boosts transmission efficiency, but also remains robust in diverse and evolving transmission scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。