arXiv:2510.02276cs.AI2025-10被引 1

用轻量桥接网络实现生物信号跨模态无监督知识迁移

BioX-Bridge: Model Bridging for Unsupervised Cross-Modal Knowledge Transfer across Biosignals

  • 设计轻量桥接网络对齐不同生物信号的中间特征
  • 参数减少88%-99%仍保持或超越现有方法性能
  • 适合资源受限场景下的健康监测系统部署

生物信号能反映人体生理状态,不同模态间虽功能、质量、舒适度和成本各异,但存在内在关联,具备任务可迁移性。然而,大规模标注数据稀缺制约了特定模态模型训练。无监督跨模态知识迁移可通过已有模态知识支持新模态建模,现有方法多依赖知识蒸馏,需同时运行教师与学生模型,带来高计算与内存开销。尤其在大模型时代,这一问题更突出。为此,本文提出BioX-Bridge框架,通过训练轻量级桥接网络对齐基础模型间的中间表示,实现跨模态信息流动。提出高效对齐位置选择策略及灵活原型网络结构。在多个生物信号模态、任务和数据集上实验表明,该方法将可训练参数减少88%–99%,同时保持甚至提升迁移性能。

原文摘要 · Abstract (English)

Biosignals offer valuable insights into the physiological states of the human body. Although biosignal modalities differ in functionality, signal fidelity, sensor comfort, and cost, they are often intercorrelated, reflecting the holistic and interconnected nature of human physiology. This opens up the possibility of performing the same tasks using alternative biosignal modalities, thereby improving the accessibility, usability, and adaptability of health monitoring systems. However, the limited availability of large labeled datasets presents challenges for training models tailored to specific tasks and modalities of interest. Unsupervised cross-modal knowledge transfer offers a promising solution by leveraging knowledge from an existing modality to support model training for a new modality. Existing methods are typically based on knowledge distillation, which requires running a teacher model alongside student model training, resulting in high computational and memory overhead. This challenge is further exacerbated by the recent development of foundation models that demonstrate superior performance and generalization across tasks at the cost of large model sizes. To this end, we explore a new framework for unsupervised cross-modal knowledge transfer of biosignals by training a lightweight bridge network to align the intermediate representations and enable information flow between foundation models and across modalities. Specifically, we introduce an efficient strategy for selecting alignment positions where the bridge should be constructed, along with a flexible prototype network as the bridge architecture. Extensive experiments across multiple biosignal modalities, tasks, and datasets show that BioX-Bridge reduces the number of trainable parameters by 88--99\% while maintaining or even improving transfer performance compared to state-of-the-art methods.

跨模态迁移生物信号轻量化无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。