用视频序列估计患者自述疼痛,性能优于当前最好方法。
PainNet: Statistical Relation Network with Episode-Based Training for Pain Estimation
- 设计统计关系网络,通过对比视频对判断疼痛类别是否相同
- 采用统计层+RNN提取紧凑视频特征,支持端到端训练
- 基于样本集的训练方式提升模型泛化能力,适合临床疼痛评估
尽管已有研究尝试从面部表情估算疼痛,但针对患者自述、临床常用的序列级疼痛估计仍较少。本文提出一种名为PainNet的统计关系网络,用于序列级疼痛估计。该模型包含嵌入模块与关系模块,通过比较视频对生成归属同一疼痛类别的关系分数。嵌入模块核心为置于RNN之上的统计层,用于提取紧凑的视频级特征,且作为深度架构一部分实现。这一设计将以往多阶段训练整合为单一端到端训练流程。模型采用基于样本的训练策略,即以查询视频与代表不同疼痛类别的视频集进行比较。实验表明,统计层与基于样本的训练策略显著提升性能,且在自述疼痛估计任务上超越现有最优结果。
原文摘要 · Abstract (English)
Despite the span in estimating pain from facial expressions, limited works have focused on estimating the sequence-level pain, which is reported by patients and used commonly in clinics. In this paper, we introduce a novel Statistical Relation Network, referred to as PainNet, designed for the estimation of the sequence-level pain. PainNet employs two key modules, the embedding and the relation modules, for comparing pairs of pain videos, and producing relation scores indicating if each pair belongs to the same pain category or not. At the core of the embedding module is a statistical layer mounted on the top of a RNN for extracting compact video-level features. The statistical layer is implemented as part of the deep architecture. Doing so, allows combining multiple training stages used in previous research, into a single end-to-end training stage. PainNet is trained using the episode-based training scheme, which involves comparing a query video with a set of videos representing the different pain categories. Experimental results show the benefit of using the statistical layer and the episode-based training in the proposed model. Furthermore, PainNet outperforms the state-of-the-art results on self-reported pain estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。