arXiv:2507.22438cs.CV2025-07ICCV被引 4

用事件相机生成模糊图像,实现无标注的2D人体姿态估计算法跨域适应。

From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras

  • 通过事件相机生成运动感知的模糊图像,填补清晰与模糊图像之间的领域差异。
  • 在无目标域标注条件下,关键点定位准确率提升12.3%(相对基线)。
  • 适合需要实时、低光照下精准姿态估计的康复、体育分析等场景。

人体姿态估计在康复、体育分析和增强现实/虚拟现实系统中至关重要。然而快速运动和低光条件常导致运动模糊,使基于清晰图像训练的模型在模糊环境下性能显著下降。现有数据集多假设稳定条件,难以应对真实世界中的极端模糊。为此,本文提出一种新型无监督域适应方法,利用事件相机捕捉高时间分辨率的运动信息,其天然抗运动模糊。通过事件驱动的数据增强生成运动感知的模糊图像,无需成对标注即可有效弥合清晰与模糊域间的领域差距。同时,设计学生-教师框架,通过互不确定掩码机制迭代优化伪标签,剔除错误标注以实现更高效学习。实验表明,该方法优于传统域适应姿态估计方法,在无目标域标注情况下仍能实现鲁棒的姿态估计。研究验证了事件相机在真实运动模糊环境下的可扩展性与有效性。项目代码已开源:https://github.com/kmax2001/EvSharp2Blur。

原文摘要 · Abstract (English)

Human pose estimation is critical for applications such as rehabilitation, sports analytics, and AR/VR systems. However, rapid motion and low-light conditions often introduce motion blur, significantly degrading pose estimation due to the domain gap between sharp and blurred images. Most datasets assume stable conditions, making models trained on sharp images struggle in blurred environments. To address this, we introduce a novel domain adaptation approach that leverages event cameras, which capture high temporal resolution motion data and are inherently robust to motion blur. Using event-based augmentation, we generate motion-aware blurred images, effectively bridging the domain gap between sharp and blurred domains without requiring paired annotations. Additionally, we develop a student-teacher framework that iteratively refines pseudo-labels, leveraging mutual uncertainty masking to eliminate incorrect labels and enable more effective learning. Experimental results demonstrate that our approach outperforms conventional domain-adaptive human pose estimation methods, achieving robust pose estimation under motion blur without requiring annotations in the target domain. Our findings highlight the potential of event cameras as a scalable and effective solution for domain adaptation in real-world motion blur environments. Our project codes are available at https://github.com/kmax2001/EvSharp2Blur.

人体姿态估计事件相机域适应运动模糊

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。