用WiFi信号生成室内3D点云,实现无线感知与环境建模。
Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer Networks
- 基于Transformer处理时序信道状态信息,捕捉空间时间关系。
- 在MM-Fi数据集上实现高精度3D重建,可区分远近物体。
- 适用于智能城市、工业5.0等需要实时环境感知的场景。
联合通信与感知(JC&S)正成为5G和6G网络的关键技术,能够动态适应环境变化,提升上下文感知能力以优化通信。通过利用实时环境数据,JC&S改善资源分配、降低延迟并提高能效,同时支持仿真与预测建模,是反应式系统与数字孪生的重要支撑。本工作提出一种基于Transformer的架构,处理时序信道状态信息(CSI)中的幅度与相位数据,生成室内环境的3D点云。模型采用多头注意力机制捕捉CSI数据中的复杂时空关系,并可适配不同CSI配置。我们在MM-Fi数据集上评估该架构,使用两种不同协议采集人体存在信息。结果表明系统具备较强的3D重建能力,能有效区分近距离与远距离物体,推动未来无线网络中空间感知的应用进展。
原文摘要 · Abstract (English)
Joint communication and sensing (JC\&S) is emerging as a key component in 5G and 6G networks, enabling dynamic adaptation to environmental changes and enhancing contextual awareness for optimized communication. By leveraging real-time environmental data, JC\&S improves resource allocation, reduces latency, and enhances power efficiency, while also supporting simulations and predictive modeling. This makes it a key technology for reactive systems and digital twins. These systems can respond to environmental events in real-time, offering transformative potential in sectors like smart cities, healthcare, and Industry 5.0, where adaptive and multimodal interaction is critical to enhance real-time decision-making. In this work, we present a transformer-based architecture that processes temporal Channel State Information (CSI) data, specifically amplitude and phase, to generate 3D point clouds of indoor environments. The model utilizes a multi-head attention to capture complex spatio-temporal relationships in CSI data and is adaptable to different CSI configurations. We evaluate the architecture on the MM-Fi dataset, using two different protocols to capture human presence in indoor environments. The system demonstrates strong potential for accurate 3D reconstructions and effectively distinguishes between close and distant objects, advancing JC\&S applications for spatial sensing in future wireless networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。