arXiv:2609.03415cs.CVcs.MM2026-09

用几何监督生成精准互动手印,助力印度古典舞传承

Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage

论文配图:Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage
图 1 · 摘自论文原文
  • 引入关键点、空间偏移和形态一致性三重几何监督
  • 生成图像在真实感与手部结构准确性上超越现有方法
  • 适合文化保护与舞蹈教育领域应用

自动生成手势对印度古典舞的传承至关重要,但相关数据集稀缺,且许多手印的梵文定义缺乏精确描述,限制了传统文本引导生成模型的效果。本文提出MudraGen,一种条件扩散框架,用于合成婆罗多舞(Bharatanatyam)中交互式双手手印(Samyukta Hasta Mudras)的逼真RGB图像。不同于以往针对单手或简单手势的工作,MudraGen引入几何感知监督,以捕捉双手间的精确协调、解剖合理性与文化细节。设计三种几何目标:关键点损失(3D关节对齐)、关节偏移损失(双手空间一致性)与形态一致性(通过鼓励一致的手部形态实现解剖正则化,同时允许独立手姿)。这些目标共同引导扩散模型生成解剖合理且姿态协调的手部配置,实现高保真、姿态准确的手印图像合成。实验表明,MudraGen在视觉真实感、解剖正确性及细粒度姿态结构保留方面均优于现有先进方法,可忠实复现复杂的交互式手印。其生成的文化契合与结构一致的手势具有实际应用价值,尤其在文化遗产保护与舞蹈教学中。

原文摘要 · Abstract (English)

Automatic generation of hand gestures is essential for the transmission of Indian classical dance and critical for its preservation. Indian classical dance gesture datasets are inherently low-resource, and the canonical Sanskrit definitions of many mudras lack precise textual descriptions, limiting the effectiveness of conventional text-conditioned image generation models. We present \textbf{MudraGen}, a conditional diffusion framework that synthesizes realistic RGB images of \textit{Samyukta Hasta Mudras} -- interactive two-hand gestures from Bharatanatyam (an Indian classical dance form). Unlike prior work on simple hand signs or single-hand gestures, MudraGen introduces geometry-aware supervision to capture the precise coordination, anatomical validity, and cultural nuance of interacting hands. We formulate three geometry-aware objectives: Keypoint Loss for 3D joint alignment, Joint Offset Loss for inter-hand spatial coherence, and Shape Consistency, which serves as an anatomical regularizer by encouraging consistent hand morphology while allowing independent hand poses. Together, these objectives guide the diffusion model toward anatomically plausible and well-coordinated hand configurations, enabling the synthesis of photorealistic and pose-accurate gesture images. Experimental results show that MudraGen surpasses existing state-of-the-art generative approaches in visual realism, anatomical correctness, and preservation of fine hand-pose structure, enabling faithful reproduction of complex Samyukta Hasta mudras. Beyond quantitative gains, its ability to generate culturally grounded and structurally consistent gestures highlights practical applications in cultural preservation and dance education.

手势生成文化传承扩散模型几何监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。