arXiv:2601.21802cs.AI2026-01

用大模型实现气管插管吸痰动作识别与可解释反馈

A Unified XAI-LLM Approach for EndotrachealSuctioning Activity Recognition

  • 以大语言模型为核心,结合时空分析与可解释AI进行动作识别
  • 准确率和F1值比基线提升约15-20%
  • 自动生成自然语言反馈,适合护理培训与居家教学

气管插管吸痰(ES)是关键但高风险的临床操作,尤其在家庭护理和教学场景中,缺乏持续督导。现有自动化识别与反馈系统研究不足。本文提出一种以大语言模型(LLM)为核心的统一框架,用于视频驱动的动作识别,优于传统机器学习与深度学习方法。该框架中,LLM作为核心推理模块,完成时空活动识别与可解释决策分析,并能将技术洞察转化为自然语言反馈。实验表明,该方法在准确率和F1分数上较基线提升约15-20%。此外,系统集成基于异常检测与可解释AI(XAI)的初步学生支持模块,提供自动、可解释的反馈,指出正确操作并建议改进方向。本研究为护理教育提供了可扩展、可解释、数据驱动的新范式,有助于提升培训效率与患者安全。

原文摘要 · Abstract (English)

Endotracheal suctioning (ES) is an invasive yet essential clinical procedure that requires a high degree of skill to minimize patient risk - particularly in home care and educational settings, where consistent supervision may be limited. Despite its critical importance, automated recognition and feedback systems for ES training remain underexplored. To address this gap, this study proposes a unified, LLM-centered framework for video-based activity recognition benchmarked against conventional machine learning and deep learning approaches, and a pilot study on feedback generation. Within this framework, the Large Language Model (LLM) serves as the central reasoning module, performing both spatiotemporal activity recognition and explainable decision analysis from video data. Furthermore, the LLM is capable of verbalizing feedback in natural language, thereby translating complex technical insights into accessible, human-understandable guidance for trainees. Experimental results demonstrate that the proposed LLM-based approach outperforms baseline models, achieving an improvement of approximately 15-20\% in both accuracy and F1 score. Beyond recognition, the framework incorporates a pilot student-support module built upon anomaly detection and explainable AI (XAI) principles, which provides automated, interpretable feedback highlighting correct actions and suggesting targeted improvements. Collectively, these contributions establish a scalable, interpretable, and data-driven foundation for advancing nursing education, enhancing training efficiency, and ultimately improving patient safety.

大模型动作识别可解释AI护理教育

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。