arXiv:2602.06743cs.CV2026-02

用视频+临床知识精准筛查青少年脊柱侧弯,避免重复数据造假。

Clinical-Prior Guided Multi-Modal Learning with Latent Attention Pooling for Gait-Based Scoliosis Screening

  • 结合临床知识图谱与潜空间注意力池化,融合视频、文本和医学先验信息。
  • 在300个独立个体测试集上达到新纪录,显著优于现有方法。
  • 适合医疗AI研究者,尤其关注可解释性与真实场景落地的团队。

青少年特发性脊柱侧弯(AIS)是一种常见脊柱畸形,早期发现可有效遏制进展。传统筛查方法主观性强、难以规模化,依赖专业临床经验。基于视频的步态分析提供了一种有前景的替代方案,但现有数据集和方法常因同一人视频重复出现导致性能虚高,或采用过于简化的模型缺乏临床可解释性。为此,我们提出ScoliGait基准数据集,包含1,572段用于训练的步态视频片段和300段完全独立的测试片段,每段视频均标注了影像学Cobb角及基于临床运动学先验的描述性文本。我们设计了一种多模态框架,整合临床先验引导的运动学知识图谱以实现可解释特征表示,并采用潜空间注意力池化机制融合视频、文本与知识图谱模态。该方法在真实、非重复受试者基准上建立新基准,展现出显著性能提升。本工作为可扩展、无创的AIS评估提供了稳健、可解释且临床可信的基础。

原文摘要 · Abstract (English)

Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity whose progression can be mitigated through early detection. Conventional screening methods are often subjective, difficult to scale, and reliant on specialized clinical expertise. Video-based gait analysis offers a promising alternative, but current datasets and methods frequently suffer from data leakage, where performance is inflated by repeated clips from the same individual, or employ oversimplified models that lack clinical interpretability. To address these limitations, we introduce ScoliGait, a new benchmark dataset comprising 1,572 gait video clips for training and 300 fully independent clips for testing. Each clip is annotated with radiographic Cobb angles and descriptive text based on clinical kinematic priors. We propose a multi-modal framework that integrates a clinical-prior-guided kinematic knowledge map for interpretable feature representation, alongside a latent attention pooling mechanism to fuse video, text, and knowledge map modalities. Our method establishes a new state-of-the-art, demonstrating a significant performance gap on a realistic, non-repeating subject benchmark. Our approach establishes a new state of the art, showing a significant performance gain on a realistic, subject-independent benchmark. This work provides a robust, interpretable, and clinically grounded foundation for scalable, non-invasive AIS assessment.

脊柱侧弯多模态学习可解释性视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。