arXiv:2508.16748cs.LGcs.AI2025-08被引 1

提出FAIRWELL框架,实现多模态健康预测中的公平表示学习。

FAIRWELL: Fair Multimodal Self-Supervised Learning for Wellbeing Prediction

  • 设计主体级损失函数,融合方差-不变性-协方差正则化机制
  • 在三个真实医疗数据集上提升公平性,性能下降极小
  • 适合关注医疗AI公平性的研究者与实践者

早期利用自监督学习(SSL)提升机器学习公平性的尝试已展现出潜力,但尚未在多模态场景中探索。已有研究表明,多模态数据中各模态包含独特信息,可互补增强整体表征。基于此,本文提出一种新型主体级损失函数FAIRWELL,通过改进方差-不变性-协方差正则化(VICReg)方法,实现三个机制:(i) 方差项减少对受保护属性的依赖;(ii) 不变性项确保相似个体预测一致;(iii) 协方差项最小化受保护属性的关联依赖。目标是获得主体无关的表示,强化多模态预测任务中的公平性。我们在三个挑战性的异构医疗数据集(D-Vlog、MIMIC、MODMA)上评估该方法,这些数据集包含不同长度的多模态数据和多种预测任务。结果表明,该框架在分类性能小幅下降的前提下显著提升了整体公平性,并大幅优化了性能-公平性帕累托前沿。

原文摘要 · Abstract (English)

Early efforts on leveraging self-supervised learning (SSL) to improve machine learning (ML) fairness has proven promising. However, such an approach has yet to be explored within a multimodal context. Prior work has shown that, within a multimodal setting, different modalities contain modality-unique information that can complement information of other modalities. Leveraging on this, we propose a novel subject-level loss function to learn fairer representations via the following three mechanisms, adapting the variance-invariance-covariance regularization (VICReg) method: (i) the variance term, which reduces reliance on the protected attribute as a trivial solution; (ii) the invariance term, which ensures consistent predictions for similar individuals; and (iii) the covariance term, which minimizes correlational dependence on the protected attribute. Consequently, our loss function, coined as FAIRWELL, aims to obtain subject-independent representations, enforcing fairness in multimodal prediction tasks. We evaluate our method on three challenging real-world heterogeneous healthcare datasets (i.e. D-Vlog, MIMIC and MODMA) which contain different modalities of varying length and different prediction tasks. Our findings indicate that our framework improves overall fairness performance with minimal reduction in classification performance and significantly improves on the performance-fairness Pareto frontier.

多模态公平性自监督学习健康预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。