arXiv:2604.16884cs.CV2026-04

提出可主动控偏的多模态医疗AI框架,提升诊断公平性与可靠性。

Bias-constrained multimodal intelligence for equitable and reliable clinical AI

  • 在模型设计中直接引入偏见控制机制,结合不确定性建模与人工干预
  • 在皮肤病变诊断上准确率提升超10%,小肿瘤分割Dice系数提升超20%
  • 适合临床部署,诊断性能超越人类专家且耗时更少

医学影像与临床文本的融合催生了通用医疗AI系统。然而,疾病分布不均、解剖区域偏差、成像协议异质及人口差异等普遍偏见,严重影响视觉-语言系统在真实临床环境中的公平性与可靠性。本文提出BiasCareVL,一种将偏见控制嵌入模型设计的多模态学习框架,而非事后修正。该框架采用自适应不确定性建模,并支持人机协同优化,以抑制主导数据模式的影响,促进分布失衡下的公平推理。在涵盖15种以上成像模态的344万样本上训练,支持视觉问答、疾病分类、分割与报告生成等多样化任务,统一于一个表示空间。在涵盖皮肤病学、肿瘤学、放射学和病理学的8个公开基准上,持续优于20种先进方法,尤其在复杂临床场景中表现突出:多类皮肤病变诊断准确率提升超10%,小肿瘤分割Dice系数提升超20%。经认证放射科医生评估,其诊断性能超越人类水平,且时间成本大幅降低。通过开源BiasCareVL,旨在推动医疗AI透明化、可复现与公平发展,助力通用、可信、临床可用的AI系统落地。

原文摘要 · Abstract (English)

The integration of medical imaging and clinical text has enabled the emergence of generalist artificial intelligence (AI) systems for healthcare. However, pervasive biases, such as imbalanced disease prevalence, skewed anatomical region distributions, heterogeneous imaging protocols, and demographic disparities, pose significant challenges to the fairness and reliability of vision-language systems in real-world clinical settings. Here we present BiasCareVL, a bias-aware multimodal learning framework that introduces bias control directly into model design, rather than treating it as a post hoc correction. BiasCareVL incorporates adaptive uncertainty modeling with optional human-in-the-loop refinement to regulate the influence of dominant data patterns and to promote equitable reasoning under distributional imbalance. Trained on 3.44 million samples spanning over 15 imaging modalities, the framework supports diverse clinical tasks, including visual question answering, disease classification, segmentation, and report generation within a unified representation space. Across eight public benchmarks covering dermatology, oncology, radiology, and pathology, BiasCareVL consistently outperforms 20 state-of-the-art methods, with pronounced gains in clinically challenging scenarios, including over 10% accuracy improvement in multi-class skin lesion diagnosis and more than 20% Dice improvement in small tumor segmentation. Furthermore, BiasCareVL achieves diagnostic performance exceeding human accuracy with substantially reduced time requirements when evaluated with board-certified radiologists. By open-sourcing BiasCareVL, we aim to promote a transparent, reproducible, and equitable future for AI in healthcare, paving the way for general-purpose, trustworthy, and clinically reliable AI systems.

医疗AI多模态公平性偏见控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。