arXiv:2510.15748cs.AI2025-10被引 2

提出可灵活处理多模态数据的帕金森评估系统,提升实际应用适应性。

Towards Relaxed Multimodal Inputs for Gait-based Parkinson's Disease Assessment

  • 将多模态学习建模为多目标优化,支持异步训练与推理
  • 在三种数据集上异步设置下性能领先基线16.48%以上
  • 适合临床场景中模态缺失或不齐的帕金森评估应用

帕金森病评估近年来受到广泛关注,尤其得益于传感器数据与机器学习技术的发展。多模态方法通过融合多种数据源的互补信息展现出优异性能,但存在两大限制:训练时需同步所有模态,推理时依赖全部模态。为此,我们提出首个将多模态学习建模为多目标优化(MOO)问题的帕金森评估系统。该方法不仅在训练和推理阶段允许更灵活的模态配置,还能缓解多模态融合中的模态坍缩问题。此外,为解决单个模态内部类别不平衡,引入基于边距的类别重平衡策略以增强分类学习。我们在三个公开数据集上进行大量实验,涵盖同步与异步设置。结果表明,所提框架——面向宽松输入(TRIP)——在异步设置下分别超越最佳基线16.48、6.89和11.55个百分点,在同步设置下分别提升4.86和2.30个百分点,充分证明其有效性与适应性。

原文摘要 · Abstract (English)

Parkinson's disease assessment has garnered growing interest in recent years, particularly with the advent of sensor data and machine learning techniques. Among these, multimodal approaches have demonstrated strong performance by effectively integrating complementary information from various data sources. However, two major limitations hinder their practical application: (1) the need to synchronize all modalities during training, and (2) the dependence on all modalities during inference. To address these issues, we propose the first Parkinson's assessment system that formulates multimodal learning as a multi-objective optimization (MOO) problem. This not only allows for more flexible modality requirements during both training and inference, but also handles modality collapse issue during multimodal information fusion. In addition, to mitigate the imbalance within individual modalities, we introduce a margin-based class rebalancing strategy to enhance category learning. We conduct extensive experiments on three public datasets under both synchronous and asynchronous settings. The results show that our framework-Towards Relaxed InPuts (TRIP)-achieves state-of-the-art performance, outperforming the best baselines by 16.48, 6.89, and 11.55 percentage points in the asynchronous setting, and by 4.86 and 2.30 percentage points in the synchronous setting, highlighting its effectiveness and adaptability.

帕金森病多模态学习异步输入医疗评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。