用合成数据提升视频痛感识别,解决伦理难题。
Towards Synthetic Data Generation for Improved Pain Recognition in Videos under Patient Constraints
- 从少量真人捕捉表情,生成8600个3D虚拟人脸
- 合成数据+少量真实数据使模型识别准确率显著提升
- 保护隐私且可公开共享,适合医疗AI研究者
视频中痛感识别对改善人机交互至关重要,但传统数据采集面临重大伦理与操作挑战。本研究提出一种新方法,利用合成数据提升基于视频的痛感识别模型性能,提供伦理且可扩展的替代方案。我们构建了一个流程:通过小规模参与者捕捉细微面部动作,将这些动态映射到多样化的合成角色上,生成8600个逼真的3D人脸,覆盖不同角度与视角下的真实痛感表达。结合先进面部捕获技术,并借助公开数据集CelebV-HQ与FFHQ-UV实现人口统计多样性,新合成数据集显著增强模型训练效果,同时通过面部替换实现身份匿名化,保障隐私。实验表明,使用合成数据与少量真实数据混合训练的模型在痛感识别任务中表现更优,有效弥合了合成模拟与现实应用之间的差距。该方法缓解了数据稀缺与伦理问题,为痛感检测及隐私保护数据生成开辟新路径。所有资源均公开可用,以促进该领域进一步创新。
原文摘要 · Abstract (English)
Recognizing pain in video is crucial for improving patient-computer interaction systems, yet traditional data collection in this domain raises significant ethical and logistical challenges. This study introduces a novel approach that leverages synthetic data to enhance video-based pain recognition models, providing an ethical and scalable alternative. We present a pipeline that synthesizes realistic 3D facial models by capturing nuanced facial movements from a small participant pool, and mapping these onto diverse synthetic avatars. This process generates 8,600 synthetic faces, accurately reflecting genuine pain expressions from varied angles and perspectives. Utilizing advanced facial capture techniques, and leveraging public datasets like CelebV-HQ and FFHQ-UV for demographic diversity, our new synthetic dataset significantly enhances model training while ensuring privacy by anonymizing identities through facial replacements. Experimental results demonstrate that models trained on combinations of synthetic data paired with a small amount of real participants achieve superior performance in pain recognition, effectively bridging the gap between synthetic simulations and real-world applications. Our approach addresses data scarcity and ethical concerns, offering a new solution for pain detection and opening new avenues for research in privacy-preserving dataset generation. All resources are publicly available to encourage further innovation in this field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。