用骨骼关键点生成被毯子遮挡的图像,提升床上姿势估计鲁棒性。
Geometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation

- 基于骨骼关键点直接生成遮挡图像,无需配对数据
- 在严重遮挡下定位准确率最高,接近全监督效果
- 适合缺乏标注数据的医疗或居家监测场景
由于大量被遮挡姿势的可靠标注数据稀缺,床内人体姿势估计在毯子遮挡下的鲁棒性仍是挑战。现有方法依赖多模态感知或图像到图像翻译框架,仍受可见源图像约束,限制可扩展性和姿势多样性。本文将遮挡感知增强重新定义为几何条件生成建模任务。系统比较了确定性掩码、无配对翻译、有配对扩散翻译以及提出的姿态条件潜空间扩散模型(Pose-LDM)。与图像引导方法不同,Pose-LDM直接从骨骼关键点生成覆盖毯子的图像,摆脱了配对监督和像素级源图像依赖,支持任意姿态输入。所有增强策略均在固定主干网络下评估其对下游姿势估计的影响。结果表明,Pose-LDM在严重遮挡下达到最高严格定位精度,整体检测性能与有配对扩散模型相当,接近完全监督训练表现。这证明几何条件扩散为无需修改传感流程的遮挡鲁棒床内姿势估计提供了高效且低监督路径。代码已开源:github.com/navidTerraNova/GeoDiffPose。
原文摘要 · Abstract (English)
Robust in-bed human pose estimation under blanket occlusion remains challenging due to the scarcity of reliable labeled training data for heavily covered poses. Existing approaches rely on multi-modal sensing or image-to-image translation frameworks that remain conditioned on visible source imagery, limiting scalability and pose diversity. In this work, we reformulate occlusion-aware augmentation as a geometry-conditioned generative modeling task. We conduct a systematic comparison of deterministic masking, unpaired translation, paired diffusion-based translation, and a proposed pose-conditioned Latent Diffusion Model (Pose-LDM). Unlike image-guided methods, Pose-LDM synthesizes blanket-covered images directly from skeletal keypoints, eliminating dependence on paired supervision and pixel-level source-image conditioning while enabling generation from arbitrary pose inputs. All augmentation strategies are evaluated through their impact on downstream pose estimation under a fixed backbone. Pose- LDM achieves the highest strict localization accuracy under severe occlusion while maintaining overall detection performance comparable to paired diffusion models, approaching the performance of fully supervised training. These results demonstrate that geometry-conditioned diffusion provides an effective and supervision-efficient pathway toward occlusion-robust inbed pose estimation without modifying the sensing pipeline. The code is available at: github.com/navidTerraNova/ GeoDiffPose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。