arXiv:2605.03615cs.CV2026-05被引 1

通过注入先验知识提升面部视频中的参与度估计精度

PriorNet: Prior-Guided Engagement Estimation from Face Video

论文配图:PriorNet: Prior-Guided Engagement Estimation from Face Video
图 1 · 摘自论文原文
  • 在预处理、模型适配和目标函数中注入任务相关先验
  • 在多个数据集上均优于现有最强基线方法
  • 适合关注面部行为分析与低资源场景建模的研究者

从面部视频中进行参与度估计仍具挑战,因面部证据常不完整、标注数据有限且标注主观。我们提出 PriorNet,一个在三个阶段注入任务相关先验的框架:预处理阶段将人脸检测失败转化为显式零帧占位符,确保缺失人脸事件在输入序列中仍被保留;模型适配阶段通过先验引导的低秩适配模块(Prior-LoRA)微调冻结的自监督视频面部情感感知器(SVFAP)骨干网络,实现参数高效定制;目标设计阶段在硬标签监督下采用狄利克雷确信度加权损失函数。我们在 EngageNet、DAiSEE、DREAMS 和 PAFE 上评估 PriorNet,使用各数据集原生评估协议。跨多个基准测试,PriorNet 在每个数据集的评估框架内均超越最强已有参考方法。在 EngageNet 与 DAiSEE 上的组件消融实验表明,性能提升来自预处理、适配与目标级先验的互补贡献。结果支持显式注入先验作为该任务在当前研究条件下的有效设计原则。

原文摘要 · Abstract (English)

Engagement estimation from face video remains challenging because facial evidence is often incomplete, labeled data are limited, and engagement annotations are subjective. We present PriorNet, a prior-guided framework that injects task-relevant priors at three stages of the pipeline: preprocessing, model adaptation, and objective design. PriorNet converts face-detection failures into explicit zero-frame placeholders so that missing-face events remain represented in the input sequence, adapts a frozen Self-supervised Video Facial Affect Perceiver (SVFAP) backbone through a Prior-guided Low-Rank Adaptation module (Prior-LoRA) for parameter-efficient specialization, and trains with a Dirichlet-evidential, uncertainty-weighted objective under hard-label supervision. We evaluate PriorNet on EngageNet, DAiSEE, DREAMS, and PAFE using each dataset's native evaluation protocol. Across these benchmarks, PriorNet improves over the strongest listed prior reference within each dataset's evaluation framing, while component ablations on EngageNet and DAiSEE indicate that the gains arise from complementary contributions of preprocessing, adaptation, and objective-level priors. These results support explicit prior injection as a useful design principle for face-video engagement estimation under the benchmark conditions studied in this work.

参与度估计面部视频先验注入低秩适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。