用合成数据解决老年患者疼痛评估的多样性与偏见问题
SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressions
- 用商业生成AI创建跨族裔、年龄、性别的合成面部表情数据
- 合成疼痛表情在临床工具下评分显著高于中性与非疼痛表情
- 可用于检测模型偏见,提升真实临床数据上的检测性能
针对失语老人(如重度痴呆者)的疼痛评估是重大医疗挑战。现有疼痛检测数据集存在种族多样性不足、隐私限制及老年人代表性弱等问题。我们提出SynPAIN,一个大规模合成数据集,包含10,710张面部表情图像,覆盖五个人种/种族、两个年龄组和两种性别。利用商业生成式AI工具,构建了具有临床意义的疼痛表情的平衡合成身份。验证显示,合成疼痛表情在基于面部动作单元分析的临床评估工具下得分显著高于中性和非疼痛表情。实验表明,该数据集可有效揭示现有模型中的算法偏见,发现显著的跨人口统计特征性能差异,这些差异在小规模、低多样性数据集中难以察觉。此外,采用年龄匹配的合成数据增强可使真实临床数据上的平均精度提升2.4个百分点。SynPAIN填补了老年疼痛检测研究中公开、多样化合成数据的空白,并建立了衡量与缓解算法偏见的框架。数据、代码和训练模型已公开:https://mmzml.github.io/SynPAIN
原文摘要 · Abstract (English)
Accurate pain assessment in patients with limited ability to communicate, such as older adults with severe dementia, represents a critical healthcare challenge. Robust automated systems of pain behavior detection may facilitate such assessments. Existing pain detection datasets, however, suffer from limited ethnic/racial diversity, privacy constraints, and underrepresentation of older adults who are the primary target population for clinical deployment. We present SynPAIN, a large-scale synthetic dataset containing 10,710 facial expression images across five ethnicities/races, representing two age groups, and two genders. Using commercial generative AI tools, we created demographically balanced synthetic identities with clinically meaningful pain expressions. Our validation demonstrates that synthetic pain expressions exhibit expected pain patterns, scoring significantly higher than neutral and non-pain expressions using clinically validated pain assessment tools based on facial action unit analysis. We experimentally demonstrate SynPAIN's utility in identifying algorithmic bias in existing pain detection models. Through comprehensive bias evaluation, we reveal substantial performance disparities across demographics characteristics. These performance disparities were previously undetectable with smaller, less diverse datasets. Furthermore, we demonstrate that age-matched synthetic data augmentation improves pain detection performance on real clinical data, achieving a 2.4 percentage point improvement in average precision. SynPAIN addresses critical gaps in pain assessment research by providing the first publicly available, demographically diverse synthetic dataset specifically designed for older adult pain detection, while establishing a framework for measuring and mitigating algorithmic bias. The dataset, code, and trained models is available at https://mmzml.github.io/SynPAIN
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。