arXiv:2607.16290cs.CV2026-07

提出强弱均衡的专家集成方法,提升多任务情感识别性能。

Strength-Parity Ensembling with Parameter-Isolated Experts for Multi-Task Affect Recognition

  • 基于共享情感潜在空间,设计强弱均衡规则筛选新增专家。
  • 新方法使集成模型在多个任务上达到1.7259的验证分数,显著超越基线。
  • 参数隔离实现专家间低相关性与近似准确率,适合多任务情感分析研究者。

在第11届ABAW挑战赛的多任务赛道中,领先方案依赖大量集成,但未明确哪些成员值得加入已强的集成。本文针对单张非约束人脸下的联合效价-唤醒估计、8类表情识别和12类动作单元检测,在部分标签、长尾分布且禁止使用Aff-Wild2预训练的前提下展开研究。基于共享情感潜在空间,通过归一化两个情感监督骨干网络中的缺失标签,提出强弱均衡规则:新增成员仅当其与现有成员预测不相关且个体准确率相近时才能降低集成误差。该规则揭示一个障碍:同一骨干网络的不同微调策略仍会收敛至0.98的相关性,无法引入多样性。参数隔离机制解决此问题:将各适配限定在共享骨干的独立低秩子空间中,使专家间相关性保持在0.91,同时维持近似准确率,其中在AffectNet上适应的专家表现最强。最终系统整体验证分数达1.6949,优于组织方基线(0.45);结合逐AU校准及共享潜头输出的效价-唤醒副产品作为近似同行,最优配置达1.7259。代码已开源。

原文摘要 · Abstract (English)

Leading entries on the multi-task track of the 11th ABAW challenge rely on heavy ensembling, yet which member is worth adding to an already strong ensemble is rarely made explicit. We study this question for joint valence-arousal estimation, 8-way expression recognition, and 12-way action-unit detection from a single unconstrained face, under partial, long-tailed labels and a rule that forbids pretraining on Aff-Wild2. Building on a shared affect-latent that marginalizes the missing labels across two affect-supervised backbones, we propose a strength-parity rule: an added member lowers the ensemble error only when it is both decorrelated from the current members and a near-peer of them in individual accuracy. The rule exposes a concrete obstacle, as on a single backbone re-seeding and even distinct fine-tuning curricula re-converge to a prediction correlation of 0.98 and add no diversity. Parameter-isolation removes it: confining each adaptation to a disjoint low-rank subspace of a shared backbone yields experts that stay decorrelated at 0.91 while remaining near-peers, the strongest of them an AffectNet-adapted expert. The resulting system raises the overall validation score to 1.6949, against the organizers ConvNeXt-with-MixAugment baseline of 0.45; with per-AU calibration and by pooling the shared-latent heads valence-arousal byproduct as a further near-peer, the strongest configuration reaches 1.7259. Source code are available at https://github.com/cprl-team/MTL-ABAW-11th.

多任务学习情感识别集成学习参数隔离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。