根据目标轮廓生成双手影子姿势,让手影精准还原指定形状。
Hand-Shadow Poser
- 分三阶段设计:先生成手形假设,再粗略对齐,最后精细优化姿态。
- 在210种不同复杂度的影子上,85%以上案例成功生成合理双手法姿。
- 无需专门数据集,可直接用通用手部数据训练,适合创意设计与教育应用。
手影艺术是一种通过手部阴影在墙上呈现生动形象的创意形式。本文研究一个逆问题:给定一个目标形状,寻找左右手的最佳三维姿态组合,使投影出的影子尽可能匹配输入。该问题具有挑战性,因3D手部姿态空间巨大且受解剖结构限制,同时输入仅含轮廓信息,无颜色和纹理。为此,我们提出Hand-Shadow Poser,一种三阶段流水线:(i) 生成模块,探索多样且合理的左右手形假设;(ii) 广义手影对齐模块,基于相似性策略筛选假设并推断粗略姿态;(iii) 阴影特征感知优化模块,提升姿态的物理合理性与特征保留能力。方法可直接在通用公开手部数据上训练,无需专用数据集。为验证性能,我们构建包含210种复杂度各异手影形状的基准集,并引入基于DINOv2的新评价指标。大量对比实验与用户研究证明,该方法在超过85%的测试案例中能有效生成适用于多种手形的双手法姿。
原文摘要 · Abstract (English)
Hand shadow art is a captivating art form, creatively using hand shadows to reproduce expressive shapes on the wall. In this work, we study an inverse problem: given a target shape, find the poses of left and right hands that together best produce a shadow resembling the input. This problem is nontrivial, since the design space of 3D hand poses is huge while being restrictive due to anatomical constraints. Also, we need to attend to the input's shape and crucial features, though the input is colorless and textureless. To meet these challenges, we design Hand-Shadow Poser, a three-stage pipeline, to decouple the anatomical constraints (by hand) and semantic constraints (by shadow shape): (i) a generative hand assignment module to explore diverse but reasonable left/right-hand shape hypotheses; (ii) a generalized hand-shadow alignment module to infer coarse hand poses with a similarity-driven strategy for selecting hypotheses; and (iii) a shadow-feature-aware refinement module to optimize the hand poses for physical plausibility and shadow feature preservation. Further, we design our pipeline to be trainable on generic public hand data, thus avoiding the need for any specialized training dataset. For method validation, we build a benchmark of 210 diverse shadow shapes of varying complexity and a comprehensive set of metrics, including a novel DINOv2-based evaluation metric. Through extensive comparisons with multiple baselines and user studies, our approach is demonstrated to effectively generate bimanual hand poses for a large variety of hand shapes for over 85% of the benchmark cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。