用因果不变性提取通用语义知识,提升通信接收端的重建效果。
Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach
- 基于生成对抗网络,通过因果不变学习分离因果与非因果表征。
- 在不同设备上保持一致性能,分类任务准确率高,PSNR优于现有方法。
- 适合跨域用户、需低通信开销的语义通信系统,尤其关注鲁棒性。
本文设计了一种低复杂度、泛化性强的AI模型,用于捕获通用知识以提升语义通信中信道解码器的数据重建能力。我们提出一种生成对抗网络,利用因果不变学习从数据中提取因果与非因果表征。因果表征具有不变性,包含识别数据标签的关键信息,可封装语义知识,促进接收端有效重建。同时,该机制确保在不同领域间学习到的表征保持一致,使系统在异构数据采集场景下仍具可靠性。针对用户随时间积累数据导致的知识漂移问题,我们设计稀疏更新协议,在最小化通信开销的同时增强知识的不变性。实验发现:第一,因果不变知识在不同设备间保持一致性,即使训练数据多样;第二,该知识在分类任务中表现优异,对目标导向的语义通信至关重要;第三,基于知识的数据重建展现出强鲁棒性,其峰值信噪比(PSNR)超越当前最先进的数据重建与语义压缩方法。
原文摘要 · Abstract (English)
In this study, we design a low-complexity and generalized AI model that can capture common knowledge to improve data reconstruction of the channel decoder for semantic communication. Specifically, we propose a generative adversarial network that leverages causality-invariant learning to extract causal and non-causal representations from the data. Causal representations are invariant and encompass crucial information to identify the data's label. They can encapsulate semantic knowledge and facilitate effective data reconstruction at the receiver. Moreover, the causal mechanism ensures that learned representations remain consistent across different domains, making the system reliable even with users collecting data from diverse domains. As user-collected data evolves over time causing knowledge divergence among users, we design sparse update protocols to improve the invariant properties of the knowledge while minimizing communication overheads. Three key observations were drawn from our empirical evaluations. Firstly, causality-invariant knowledge ensures consistency across different devices despite the diverse training data. Secondly, invariant knowledge has promising performance in classification tasks, which is pivotal for goal-oriented semantic communications. Thirdly, our knowledge-based data reconstruction highlights the robustness of our decoder, which surpasses other state-of-the-art data reconstruction and semantic compression methods in terms of Peak Signal-to-Noise Ratio (PSNR).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。