arXiv:2503.15161cs.CV2025-03

高效联邦学习框架,让多家医院协作训练手术工具检测模型。

UltraFlwr -- An Efficient Federated Surgical Object Detection Framework

  • 用部分聚合技术减少通信开销,支持边缘设备部署。
  • 骨干+颈部组件聚合效果接近全量聚合,通信成本更低。
  • 适合医疗数据异构场景,对隐私保护型协作有实用价值。

腹腔镜视频中的手术物体检测可实现器械实时识别,用于手术流程分析与技能评估,但训练如YOLO这类鲁棒模型面临数据有限、隐私约束及机构间差异的挑战。联邦学习(FL)可在不共享原始数据的前提下实现协作训练,但现有方案对异构手术数据下现代YOLO流水线的支持仍不足。本文提出UltraFlwr,一个开源、通信高效、支持边缘部署的框架,集成Ultralytics YOLO与Flower FL平台,并原生支持YOLO组件(骨干、颈部、头部)的部分聚合(PA)。基于两个公开的腹腔镜手术工具检测数据集,我们在独立同分布(IID)及多种临床相关异构场景(如数据整理方式、视频长度、标注可用性差异)下系统评估了联邦YOLO训练表现。结果表明:标准聚合器(如FedAvg)虽无法在各客户端上达到集中式训练水平,但能降低客户端间性能差异;同时聚合骨干与颈部组件即可实现接近全量聚合的效果,且通信开销显著降低。此外,提升客户端内数据一致性即使加剧客户端间分布偏移,也有助于联邦学习性能。这些发现为在异构手术环境中部署基于联邦YOLO的检测系统提供了实用指导。UltraFlwr已开源:https://github.com/KCL-BMEIS/UltraFlwr。

原文摘要 · Abstract (English)

Surgical object detection in laparoscopic videos enables real-time instrument identification for workflow analysis and skills assessment, but training robust models such as You Only Look Once (YOLO) is challenged by limited data, privacy constraints, and inter-institutional variability. Federated learning (FL) enables collaborative training without sharing raw data, yet practical support for modern YOLO pipelines under heterogeneous surgical data remains limited. We present UltraFlwr, an open-source, communication-efficient, and edge-deployable framework that integrates Ultralytics YOLO with the Flower FL platform and supports native Partial Aggregation (PA) of YOLO components (backbone, neck, head). Using two public laparoscopic surgical tool detection datasets, we conduct a systematic empirical study of federated YOLO training under Independent and Identically Distributed (IID) and multiple clinically motivated heterogeneous scenarios, including differences in data curation, video length, and label availability. Results show that standard FL aggregators (e.g., FedAvg) do not consistently match centralized training per client, but reduce inter-client performance variability. Aggregating both backbone and neck components achieves performance comparable to full aggregation with lower communication costs. Also, improving within-client data consistency can benefit FL even when it increases distribution shift across clients. These findings provide practical guidance for deploying federated YOLO-based object detection in heterogeneous surgical environments. UltraFlwr is publicly available at https://github.com/KCL-BMEIS/UltraFlwr.

联邦学习手术检测YOLO医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。