arXiv:2509.10557q-bio.NCcs.LG2025-09

HiLWS通过人机协同弱监督,提升居家与临床视频的运动症状标注质量。

HiLWS: A Human-in-the-Loop Weak Supervision Framework for Curating Clinical and Home Video Data for Neurological Assessment

  • 分阶段人机协同弱监督,先聚合专家标注生成概率标签,再迭代优化
  • 在多源视频中实现92%以上任务片段准确提取,显著降低标注噪声
  • 适合医疗视频数据清洗,尤其适用于帕金森病等神经疾病评估

基于视频的运动症状评估为帕金森病等疾病的远程监测提供了可扩展方案,但居家录制视频存在视觉退化、任务执行不一致、标注噪声和域偏移等挑战。本文提出HiLWS——一种分阶段人机协同弱监督框架,用于整理和标注来自临床与居家场景的手部运动任务视频。不同于传统单阶段弱监督方法,该框架首先利用弱监督将专家提供的标注聚合为概率标签,用于训练机器学习模型;随后结合模型预测与专家反馈,在第二阶段进一步优化标注。整个流程包含质量过滤、优化的姿态估计及任务特定片段提取,并采用上下文敏感的评估指标,优先识别模糊案例交由专家复核,兼顾视觉保真度与临床相关性。研究揭示了居家视频中的关键失效模式,强调了上下文感知数据清洗策略对鲁棒医学视频分析的重要性。

原文摘要 · Abstract (English)

Video-based assessment of motor symptoms in conditions such as Parkinson's disease (PD) offers a scalable alternative to in-clinic evaluations, but home-recorded videos introduce significant challenges, including visual degradation, inconsistent task execution, annotation noise, and domain shifts. We present HiLWS, a cascaded human-in-the-loop weak supervision framework for curating and annotating hand motor task videos from both clinical and home settings. Unlike conventional single-stage weak supervision methods, HiLWS employs a novel cascaded approach, first applies weak supervision to aggregate expert-provided annotations into probabilistic labels, which are then used to train machine learning models. Model predictions, combined with expert input, are subsequently refined through a second stage of weak supervision. The complete pipeline includes quality filtering, optimized pose estimation, and task-specific segment extraction, complemented by context-sensitive evaluation metrics that assess both visual fidelity and clinical relevance by prioritizing ambiguous cases for expert review. Our findings reveal key failure modes in home recorded data and emphasize the importance of context-sensitive curation strategies for robust medical video analysis.

医疗视频弱监督人机协同帕金森病

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。