用骨骼姿态数据提升脊柱侧弯筛查的临床可解释性
Pose as Clinical Prior: Learning Dual Representations for Scoliosis Screening
- 构建双表示框架,融合连续骨架图与离散姿态不对称向量
- 在44.8万帧数据上实现当前最优筛查准确率
- 适合医学影像分析与可解释性AI研究者使用
现有基于AI的脊柱侧弯筛查方法多依赖大规模轮廓数据集,忽视了传统筛查中的关键临床指标——体态不对称。相比之下,姿态数据提供直观的骨骼结构表示,增强各类医疗应用的临床可解释性。然而,由于缺乏大规模标注的姿态数据集以及原始姿态坐标离散、易受噪声影响,姿态基筛查仍不充分。为此,我们构建了Scoliosis1K-Pose,一个扩展自原Scoliosis1K数据集的2D人体姿态标注集,包含1,050名青少年的447,900帧2D关键点。在此基础上,提出双表示框架(DRF),结合连续骨架图保留空间结构,与编码临床相关不对称特征的离散姿态不对称向量(PAV)。引入新颖的PAV引导注意力(PGA)模块,以PAV作为临床先验,指导骨架图特征提取,聚焦于临床意义显著的不对称区域。大量实验表明,DRF达到当前最佳性能。可视化进一步验证模型利用临床不对称线索引导特征提取,促进双表示间的协同作用。数据集与代码已公开于https://zhouzi180.github.io/Scoliosis1K/。
原文摘要 · Abstract (English)
Recent AI-based scoliosis screening methods primarily rely on large-scale silhouette datasets, often neglecting clinically relevant postural asymmetries-key indicators in traditional screening. In contrast, pose data provide an intuitive skeletal representation, enhancing clinical interpretability across various medical applications. However, pose-based scoliosis screening remains underexplored due to two main challenges: (1) the scarcity of large-scale, annotated pose datasets; and (2) the discrete and noise-sensitive nature of raw pose coordinates, which hinders the modeling of subtle asymmetries. To address these limitations, we introduce Scoliosis1K-Pose, a 2D human pose annotation set that extends the original Scoliosis1K dataset, comprising 447,900 frames of 2D keypoints from 1,050 adolescents. Building on this dataset, we introduce the Dual Representation Framework (DRF), which integrates a continuous skeleton map to preserve spatial structure with a discrete Postural Asymmetry Vector (PAV) that encodes clinically relevant asymmetry descriptors. A novel PAV-Guided Attention (PGA) module further uses the PAV as clinical prior to direct feature extraction from the skeleton map, focusing on clinically meaningful asymmetries. Extensive experiments demonstrate that DRF achieves state-of-the-art performance. Visualizations further confirm that the model leverages clinical asymmetry cues to guide feature extraction and promote synergy between its dual representations. The dataset and code are publicly available at https://zhouzi180.github.io/Scoliosis1K/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。