用可解释的逻辑推理实现基于骨骼的动作癫痫检测,准确率高且结果可审计。
A Neurosymbolic Framework for Interpretable Skeleton-Based Seizure Detection via Concept-Driven Logical Reasoning

- 结合深度学习与逻辑规则,从人体骨架中提取临床相关的运动特征
- 在两个公开数据集上达到89.78%敏感度,每小时仅0.06个误报
- 输出三层次可解释性,适合临床医生信任和使用
基于视频的癫痫发作检测对癫痫患者管理至关重要,是脑电图的非侵入性补充。尽管已有多种深度学习方法用于视频癫痫检测,但均缺乏内在可解释性,限制了其在临床中的应用。本文首次提出一种神经符号框架,直接解决该问题。该方法(1)通过提示引导的基础模型从癫痫监护室中提取以患者为中心的骨架序列;(2)基于临床运动半体学指南预测二值时空概念激活;(3)通过可微逻辑将这些概念组合成可解释的布尔规则,并可追溯每条规则的贡献。为减少传统二分类(发作 vs 非发作)带来的误报,我们进一步将非发作段细分为临床相关的正常活动,提供细粒度判别监督。在两个公开癫痫视频基准数据集上,模型在SAHZU上实现89.78%敏感度、每小时0.06个误报,在IEEE上实现85.27%敏感度、每小时0.09个误报。所有预测均可分解为:检测到哪些运动基元、如何逻辑组合、各规则贡献度。代码与数据已公开于https://github.com/Mr-TalhaIlyas/CDSD/
原文摘要 · Abstract (English)
Video-based seizure detection is essential for the management of epilepsy patients, offering a non-invasive complement to electroencephalography. While several deep learning approaches have been developed for video-based seizure detection, none are inherently interpretable, limiting their adoption and translation into clinical practice. We present, to our knowledge, the first exploration of a neurosymbolic framework for video-based seizure detection that directly addresses this gap. Our approach (1) extracts patient-centric skeleton sequences from epilepsy monitoring units via a prompt-guided foundation model, (2) predicts binary spatio-temporal concept activations grounded in clinical motor semiology guidelines, and (3) composes them via differentiable logic into interpretable Boolean rules with auditable contributions. Furthermore, to mitigate false positives arising from the traditional binary formulation (seizure vs.\ non-seizure), we sub-classify non-seizure segments into clinically relevant normal activities, providing the model with fine-grained discriminative supervision. Evaluated on two public seizure video benchmarks, our framework achieves 89.78% sensitivity with 0.06 false detections per hour on SAHZU and 85.27%,0.09 on IEEE, while producing complete three-level interpretability: every prediction decomposes into which motor primitives were detected, how they were logically composed, and how much each rule contributed to the clinical decision. We publicly release all annotations, extracted pose sequences, our data pipeline and code, https://github.com/Mr-TalhaIlyas/CDSD/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。