arXiv:2508.06951cs.CVeess.IV2025-08CVPR被引 11

首个手语生成竞赛,评测文本转骨骼动作的准确性与自然度。

SLRTP2025 Sign Language Production Challenge: Methodology, Results, and Future Work

  • 采用检索+预训练语言模型,将语音转为手语骨骼动作序列。
  • 冠军团队在BLEU-1达31.40,动态时间规整误差仅0.0574。
  • 公开标准化评估框架,推动手语生成研究可比性提升。

手语生成(SLP)旨在将口语输入转化为手语视频。近年来深度学习方法显著提升了生成结果的真实感与自然度,但缺乏统一的评估标准,阻碍了不同系统间的有效比较。为此,我们在CVPR 2025第三届SLRTP研讨会上举办首个手语生成挑战赛,聚焦文本到骨骼动作(T2P)转换,评估多种指标。使用德国手语天气播报数据集RWTH-PHOENIX-Weather-2014T,并额外构建了一个同领域隐藏测试集。共吸引33名参与者提交231项方案,最优团队取得BLEU-1 31.40、DTW-MJE 0.0574的成绩。其方法基于检索框架与预训练语言模型。研讨会同步发布标准化评估网络,包含高质量骨骼关键点提取,为该领域建立一致基线,助力未来研究对比。

原文摘要 · Abstract (English)

Sign Language Production (SLP) is the task of generating sign language video from spoken language inputs. The field has seen a range of innovations over the last few years, with the introduction of deep learning-based approaches providing significant improvements in the realism and naturalness of generated outputs. However, the lack of standardized evaluation metrics for SLP approaches hampers meaningful comparisons across different systems. To address this, we introduce the first Sign Language Production Challenge, held as part of the third SLRTP Workshop at CVPR 2025. The competition's aims are to evaluate architectures that translate from spoken language sentences to a sequence of skeleton poses, known as Text-to-Pose (T2P) translation, over a range of metrics. For our evaluation data, we use the RWTH-PHOENIX-Weather-2014T dataset, a German Sign Language - Deutsche Gebardensprache (DGS) weather broadcast dataset. In addition, we curate a custom hidden test set from a similar domain of discourse. This paper presents the challenge design and the winning methodologies. The challenge attracted 33 participants who submitted 231 solutions, with the top-performing team achieving BLEU-1 scores of 31.40 and DTW-MJE of 0.0574. The winning approach utilized a retrieval-based framework and a pre-trained language model. As part of the workshop, we release a standardized evaluation network, including high-quality skeleton extraction-based keypoints establishing a consistent baseline for the SLP field, which will enable future researchers to compare their work against a broader range of methods.

手语生成文本转动作评估基准骨骼序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。