一个单模型搞定胎儿超声的解读、检测与分割,适合资源匮乏地区使用。
FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model

- 用统一视觉语言模型实现解读优先的全流程处理,无需外部标注
- 分割Dice达0.8820,检测[email protected]为0.7671,解读合规率100%
- 可在手机上离线运行,仅需消费级显卡训练,适合基层医疗场景
全球超声技师短缺导致低收入和中等收入国家超过一半孕妇无法获得专业超声筛查。现有深度学习方法各自独立解决检测、分割或分类任务,需多个模型及专家标注。我们提出FADA,基于Qwen3.5-VL的统一视觉语言模型,通过单一解读优先流程实现临床解读、分类、检测与分割,无需外部标签。FADA通过离线特征缓存,从四个领域专用基础模型(FetalCLIP、UltraSAM、USF-MAE、UltraFedFM)中选择性蒸馏知识。选择性蒸馏仅对标注任务进行特征对齐,而解读采用标准微调,在多数评估维度优于全蒸馏。推荐版本FADA-SKD在分割任务上取得0.8820平均Dice,检测[email protected]为0.7671,解读结构化合规率达100%。237张图像的专家验证显示,自主与人机协同模式下输出均具临床可接受性,73.5%解读在医生指导下达到完美评分。系统可在单个消费级GPU上训练,支持离线部署。我们通过在高通骁龙7 Gen 1、12GB内存的智能手机上使用llama.cpp与GGUF量化压缩0.8B模型,完成完整的5阶段流程,耗时约60秒,完全离线运行。这为便携式超声设备集成AI辅助胎儿评估提供了可行路径,直接回应资源受限地区的诊断可及性问题。代码、模型与数据已开源于https://github.com/mahmoodphd/FADA。
原文摘要 · Abstract (English)
A global shortage of trained sonographers limits prenatal ultrasound screening in low- and middle-income countries, where over half of pregnant women receive no skilled sonography. Current deep learning approaches address detection, segmentation, or classification in isolation, each demanding a separate model and expert-specified labels at inference. We present FADA, a unified vision-language model built on Qwen3.5-VL that performs clinical interpretation, classification, detection, and segmentation through a single interpretation-first pipeline without external labels. FADA distills knowledge from four domain-specific foundation models (FetalCLIP, UltraSAM, USF-MAE, UltraFedFM) via offline pre-computed feature caching. Selective distillation, which applies feature alignment only to annotation tasks while interpretation relies on standard fine-tuning, consistently outperforms full distillation across most evaluation axes. The recommended variant, FADA-SKD, achieves 0.8820 mean Dice for segmentation, 0.7671 [email protected] for detection, and 100% structured interpretation compliance. Expert sonographer validation across 237 images confirms clinically acceptable outputs in both autonomous and human-in-the-loop modes, with 73.5% of interpretations scoring perfectly under clinician guidance. The system is trainable on a single consumer GPU and deployable without cloud connectivity. We validate edge deployment by running the compressed 0.8B model on a commodity smartphone (Qualcomm Snapdragon 7 Gen 1, 12 GB RAM) using llama.cpp with GGUF quantization, completing the full 5-phase pipeline in approximately 60 seconds entirely offline. This establishes a practical pathway for integrating AI-assisted fetal assessment with portable ultrasound devices, directly addressing diagnostic access gaps in resource-constrained settings. Code, models, and data are available at https://github.com/mahmoodphd/FADA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。