arXiv:2511.14604cs.CV2025-11被引 1

用X光片和病历数据预测髋部骨密度,提升骨折风险评估准确率。

XAttn-BMD: Multimodal Deep Learning with Cross-Attention for Femoral Neck Bone Mineral Density Estimation

  • 通过双向交叉注意力融合影像与临床数据特征
  • 相比拼接方法,误差降低16.7%~6.03%,决定系数提升16.4%
  • 适合需要精准骨质疏松筛查的临床场景

骨质疏松症导致骨矿物密度(BMD)下降,增加骨折风险。本文提出XAttn-BMD框架,利用髋部X光片与结构化临床数据联合预测股骨头颈部位的BMD。该模型引入创新的双向交叉注意力机制,实现图像与临床信息的动态特征融合,促进跨模态相互增强。针对BMD分布不均的问题,设计加权平滑L1损失函数,重点优化临床关键病例。在赫特福德郡队列研究数据集上的实验表明,该模型在回归泛化性与鲁棒性上优于基线模型。消融实验证实交叉注意力融合与定制损失函数的有效性。与简单特征拼接相比,本方法使均方误差降低16.7%,平均绝对误差减少6.03%,决定系数(R²)提升16.4%。此外,在临床相关阈值下的二分类筛查表现验证了其在真实场景中的应用潜力。

原文摘要 · Abstract (English)

Poor bone health is a significant public health concern, and low bone mineral density (BMD) leads to an increased fracture risk, a key feature of osteoporosis. We present XAttn-BMD (Cross-Attention BMD), a multimodal deep learning framework that predicts femoral neck BMD from hip X-ray images and structured clinical metadata. It utilizes a novel bidirectional cross-attention mechanism to dynamically integrate image and metadata features for cross-modal mutual reinforcement. A Weighted Smooth L1 loss is tailored to address BMD imbalance and prioritize clinically significant cases. Extensive experiments on the data from the Hertfordshire Cohort Study show that our model outperforms the baseline models in regression generalization and robustness. Ablation studies confirm the effectiveness of both cross-attention fusion and the customized loss function. Experimental results show that the integration of multimodal data via cross-attention outperforms naive feature concatenation without cross-attention, reducing MSE by 16.7%, MAE by 6.03%, and increasing the R2 score by 16.4%, highlighting the effectiveness of the approach for femoral neck BMD estimation. Furthermore, screening performance was evaluated using binary classification at clinically relevant femoral neck BMD thresholds, demonstrating the model's potential in real-world scenarios.

骨密度估计多模态学习交叉注意力医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。