arXiv:2507.05121cs.ITcs.AI2025-07被引 15

直接用预训练视觉模型做无线信道任务,无需微调

LVM4CSI: Enabling Direct Application of Pre-Trained Large Vision Models for Wireless Channel Tasks

  • 将复数信道状态信息转为视觉图像,适配预训练大视觉模型
  • 信道估计性能提升超9.61 dB,定位误差降低约40%
  • 无需设计专用网络,参数量大幅减少,适合快速部署

精确的信道状态信息(CSI)对5G及未来6G无线通信系统至关重要。尽管人工智能在CSI获取与利用方面展现出潜力,但现有方法多依赖专家设计的任务特定神经网络,需大量训练数据,限制了泛化性和实用性。为此,本文提出LVM4CSI框架,利用CSI与计算机视觉数据的结构相似性,直接将大规模视觉模型(LVMs)应用于无线任务,无需任何微调。该方法将复杂值CSI转换为适配视觉模型的视觉格式,并引入轻量级可训练层,使提取特征适配具体通信目标。通过三个典型应用验证:信道估计、人体活动识别和用户定位。结果表明,LVM4CSI性能优于或相当任务特定神经网络,信道估计增益超过9.61 dB,定位误差降低约40%。同时显著减少可训练参数,省去任务专用网络设计。

原文摘要 · Abstract (English)

Accurate channel state information (CSI) is critical to the performance of wireless communication systems, especially with the increasing scale and complexity introduced by 5G and future 6G technologies. While artificial intelligence (AI) offers a promising approach to CSI acquisition and utilization, existing methods largely depend on task-specific neural networks (NNs) that require expert-driven design and large training datasets, limiting their generalizability and practicality. To address these challenges, we propose LVM4CSI, a general and efficient framework that leverages the structural similarity between CSI and computer vision (CV) data to directly apply large vision models (LVMs) pre-trained on extensive CV datasets to wireless tasks without any fine-tuning, in contrast to large language model-based methods that generally necessitate fine-tuning. LVM4CSI maps CSI tasks to analogous CV tasks, transforms complex-valued CSI into visual formats compatible with LVMs, and integrates lightweight trainable layers to adapt extracted features to specific communication objectives. We validate LVM4CSI through three representative case studies, including channel estimation, human activity recognition, and user localization. Results demonstrate that LVM4CSI achieves comparable or superior performance to task-specific NNs, including an improvement exceeding 9.61 dB in channel estimation and approximately 40% reduction in localization error. Furthermore, it significantly reduces the number of trainable parameters and eliminates the need for task-specific NN design.

无线通信视觉模型信道估计迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。